-- Logs begin at Wed 2022-10-19 01:38:52 UTC, end at Wed 2022-10-19 02:59:52 UTC. -- Oct 19 02:11:03.625907 dv-cinder-861491-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 19 02:11:03.635761 dv-cinder-861491-4-smb devstack@keystone.service[81656]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 19 02:11:03.638455 dv-cinder-861491-4-smb devstack@keystone.service[81656]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 19 02:11:03 2022] *** Oct 19 02:11:03.638643 dv-cinder-861491-4-smb devstack@keystone.service[81656]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 19 02:11:03.638852 dv-cinder-861491-4-smb devstack@keystone.service[81656]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 19 02:11:03.639030 dv-cinder-861491-4-smb devstack@keystone.service[81656]: nodename: dv-cinder-861491-4-smb Oct 19 02:11:03.639186 dv-cinder-861491-4-smb devstack@keystone.service[81656]: machine: x86_64 Oct 19 02:11:03.639346 dv-cinder-861491-4-smb devstack@keystone.service[81656]: clock source: unix Oct 19 02:11:03.639491 dv-cinder-861491-4-smb devstack@keystone.service[81656]: pcre jit disabled Oct 19 02:11:03.639657 dv-cinder-861491-4-smb devstack@keystone.service[81656]: detected number of CPU cores: 4 Oct 19 02:11:03.639657 dv-cinder-861491-4-smb devstack@keystone.service[81656]: current working directory: / Oct 19 02:11:03.639657 dv-cinder-861491-4-smb devstack@keystone.service[81656]: detected binary path: /usr/bin/uwsgi-core Oct 19 02:11:03.639657 dv-cinder-861491-4-smb devstack@keystone.service[81656]: your processes number limit is 47680 Oct 19 02:11:03.639657 dv-cinder-861491-4-smb devstack@keystone.service[81656]: your memory page size is 4096 bytes Oct 19 02:11:03.639657 dv-cinder-861491-4-smb devstack@keystone.service[81656]: detected max file descriptor number: 2048 Oct 19 02:11:03.639657 dv-cinder-861491-4-smb devstack@keystone.service[81656]: lock engine: pthread robust mutexes Oct 19 02:11:03.640066 dv-cinder-861491-4-smb devstack@keystone.service[81656]: thunder lock: enabled Oct 19 02:11:03.640066 dv-cinder-861491-4-smb devstack@keystone.service[81656]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 19 02:11:03.640066 dv-cinder-861491-4-smb devstack@keystone.service[81656]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 19 02:11:03.679353 dv-cinder-861491-4-smb devstack@keystone.service[81656]: Python main interpreter initialized at 0x563b604bf9c0 Oct 19 02:11:03.679353 dv-cinder-861491-4-smb devstack@keystone.service[81656]: python threads support enabled Oct 19 02:11:03.679353 dv-cinder-861491-4-smb devstack@keystone.service[81656]: your server socket listen backlog is limited to 100 connections Oct 19 02:11:03.679353 dv-cinder-861491-4-smb devstack@keystone.service[81656]: your mercy for graceful operations on workers is 90 seconds Oct 19 02:11:03.679680 dv-cinder-861491-4-smb devstack@keystone.service[81656]: mapped 403077 bytes (393 KB) for 2 cores Oct 19 02:11:03.679754 dv-cinder-861491-4-smb devstack@keystone.service[81656]: *** Operational MODE: preforking *** Oct 19 02:11:03.680029 dv-cinder-861491-4-smb devstack@keystone.service[81656]: *** uWSGI is running in multiple interpreter mode *** Oct 19 02:11:03.680029 dv-cinder-861491-4-smb devstack@keystone.service[81656]: spawned uWSGI master process (pid: 81656) Oct 19 02:11:03.680227 dv-cinder-861491-4-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 19 02:11:03.682296 dv-cinder-861491-4-smb devstack@keystone.service[81656]: spawned uWSGI worker 1 (pid: 81670, cores: 1) Oct 19 02:11:03.682296 dv-cinder-861491-4-smb devstack@keystone.service[81656]: spawned uWSGI worker 2 (pid: 81671, cores: 1) Oct 19 02:11:03.682296 dv-cinder-861491-4-smb devstack@keystone.service[81656]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 19 02:11:07.990483 dv-cinder-861491-4-smb devstack@keystone.service[81671]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 02:11:07.990483 dv-cinder-861491-4-smb devstack@keystone.service[81671]: from cryptography.utils import int_from_bytes Oct 19 02:11:07.991322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 02:11:07.991322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: from cryptography.utils import int_from_bytes Oct 19 02:11:07.991788 dv-cinder-861491-4-smb devstack@keystone.service[81670]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 02:11:07.991788 dv-cinder-861491-4-smb devstack@keystone.service[81670]: from cryptography.utils import int_from_bytes Oct 19 02:11:07.992264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 02:11:07.992264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: from cryptography.utils import int_from_bytes Oct 19 02:11:08.043209 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 02:11:08.043409 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 02:11:08.043602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] command line args: [] {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 02:11:08.043874 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 02:11:08.043972 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 02:11:08.044048 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ================================================================================ {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 02:11:08.044133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 02:11:08.044291 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] admin_token = **** {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.044376 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] command line args: [] {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 02:11:08.044536 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] config_dir = [] {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.044616 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 02:11:08.044722 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.044801 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ================================================================================ {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 02:11:08.044904 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] config_source = [] {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.044979 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] admin_token = **** {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.045082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] debug = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.045222 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] config_dir = [] {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.045304 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.045513 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.045582 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] config_source = [] {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.045670 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.045807 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] debug = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.045910 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.046015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.046143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.046249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.046343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.046448 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.046546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] list_limit = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.046639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.046736 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] log_config_append = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.046868 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.046981 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.047074 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] log_dir = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.047166 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] list_limit = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.047257 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] log_file = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.047374 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] log_config_append = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.047474 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.047573 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.047672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] log_dir = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.047796 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.047896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] log_file = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.048006 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.048091 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.048163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.048284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.048359 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.048478 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.048558 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.048678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.048753 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.048873 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.048948 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.049066 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.049146 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.049295 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.049378 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.049524 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.049599 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.049760 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.049884 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.050015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.050229 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.050311 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.050395 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.050506 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.050593 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.050760 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.051022 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.051101 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.058010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] publish_errors = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.058149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.058238 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.058238 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.058365 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.058504 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.058578 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] publish_errors = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.058645 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.058719 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.058799 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.058799 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] standard_threads = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.058973 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.058973 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.059103 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.059183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.059252 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.059252 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.059385 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.059458 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] use_journal = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.059527 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] standard_threads = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.059601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] use_json = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.059601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] use_stderr = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.059779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.059853 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] use_syslog = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.059920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.059988 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.060064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.060064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] use_journal = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.060186 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.060255 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] use_json = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.060322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.060390 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] use_stderr = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.060785 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.060862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] use_syslog = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.060931 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.060999 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 02:11:08.061073 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.061148 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.061225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.061301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.061370 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.061438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.061505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.061572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.061647 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.061721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.061791 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.061859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.061932 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.062001 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.062079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.062148 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.062221 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.062296 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.062371 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.062440 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.062515 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.062590 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.062659 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.062758 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.062896 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.062982 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.063054 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.063122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.063189 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.063257 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.063324 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.063403 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.063478 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.063547 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.063615 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.063683 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.063750 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.063825 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.063942 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.064021 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.064099 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.064169 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.064237 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.064384 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.064457 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.064525 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.064598 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.064672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.064741 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.064817 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.064887 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.064955 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.065027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.065096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.065169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.065247 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.065316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.065383 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.065451 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.065451 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.065572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.065646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.065715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.065782 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.065849 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.065849 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.065981 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.065981 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.066118 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.066186 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.066258 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.066332 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.066400 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.066482 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.066553 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.066620 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.066687 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.066785 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.066886 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.066969 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.067041 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.067146 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.067247 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.067341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.067928 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.068039 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.068648 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.068736 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.068857 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.068972 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.069056 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.069137 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.069209 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.069331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.069444 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.069602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.069689 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.069761 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.069886 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.069999 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.070080 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.070195 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.070269 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.070381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.070463 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.070535 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.070654 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.070729 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.070729 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.070983 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.071067 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.071182 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.071263 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.071333 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.071446 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.071529 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.071529 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.071711 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.071711 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.071887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.071961 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.072072 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.072154 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.072225 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.072338 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.072418 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.072489 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.072601 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.072683 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.072762 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.072762 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.072935 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.073009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.073121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.073203 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.073280 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.073352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.073421 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.073421 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.073591 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.073741 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.073814 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.073890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.073977 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.074048 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.074118 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.074275 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.074468 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.074566 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.074649 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.074710 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.074839 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.074936 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.075021 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.075104 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.075244 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.075319 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.075400 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.075470 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.075548 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.075625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.075695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.075764 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.075832 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.075901 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.076023 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.076099 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.076169 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.076238 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.076307 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.076376 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.076455 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.076532 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.076602 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.076671 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.076740 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.076809 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.076885 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.076962 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.077038 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.077109 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.077208 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.077308 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.077393 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.077471 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.077547 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.077623 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.077623 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.077748 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.077824 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.077895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.077964 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.078032 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.078209 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.078289 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.078438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.078568 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.078685 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.078768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.078966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.079048 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.085206 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.085325 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.085401 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] auth.external = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.085472 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.085543 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.085612 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.085691 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.085764 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.085860 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.085943 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.086016 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] auth.password = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.086086 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.086156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] auth.token = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.086226 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.086306 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.086380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.086450 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.086520 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] auth.external = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.086590 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.086660 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.086743 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.086873 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.086951 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.087022 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.087092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.087172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] auth.password = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.087253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.087325 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] auth.token = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.087406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] credential.caching = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.087478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.087555 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.087627 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.087704 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.087784 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.087855 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.087925 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.087995 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.088070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.088148 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.088219 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.088289 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.088358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.088427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.088496 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] credential.caching = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.088574 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.088646 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.088721 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.088721 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.088848 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.088848 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.088988 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.089060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.089129 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.089198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.089268 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.089418 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.089492 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.089562 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.089631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.089631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] federation.caching = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.089765 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.089843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.089915 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.089987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.090057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.090127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.090196 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.090273 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.090369 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.090511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.090587 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.090658 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.090727 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.090809 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.090905 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.090976 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.091046 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] federation.caching = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.091115 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.091185 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.091266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.091354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.091526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.091606 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.091677 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] identity.caching = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.091748 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.091827 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.091899 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.091969 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.092039 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.092108 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.092177 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.092255 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.092327 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.092397 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.092466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.092536 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.092605 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.092687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.092760 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.092830 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.092900 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] identity.caching = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.092969 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.093039 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.093116 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.093187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.093257 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.093327 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.093398 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.093467 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.093545 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.093616 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.093681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.093819 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.093894 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.093953 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.094031 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.094103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.094169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.094228 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.094297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.094367 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.094444 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.094516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.094580 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.094649 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.094718 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.094788 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.094901 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.094976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.095046 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.095046 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.095172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.095250 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.095322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.095392 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.095462 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.095658 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.095738 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.095901 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.095983 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.096146 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.096225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.096382 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.096461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.096622 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.096727 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.096897 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.096977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.097138 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.097215 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.097371 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.097449 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.097610 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.097686 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.097842 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.097985 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.098079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.098224 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.098301 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.098477 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.098571 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.098788 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.099344 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.099434 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.099434 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.099574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.099574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.099696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.099840 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.099920 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.100070 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.100149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.100314 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.100390 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.100551 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.100630 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.100785 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.100861 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.101022 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.101100 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.101260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.101339 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.101492 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.user = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.101570 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.101731 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.101808 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.101986 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.102065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.102216 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.102292 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.102468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.102587 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.102714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.102795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.102989 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.103069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.103228 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.103307 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.103458 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.103538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.103694 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.103772 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.103931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.104007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.104166 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.user = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.104245 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.104395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.104471 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.104642 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.104720 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.104887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.104964 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.105129 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.105206 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.105376 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.105453 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.105619 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.105697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.105847 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.105925 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.106093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.106170 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.106331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.106417 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.106567 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.106645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.106804 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.106914 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.107061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.107141 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.107306 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.107383 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.107553 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.107629 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.107788 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.107866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.108038 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.108115 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.108266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.108342 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.108514 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.108632 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.108755 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.108833 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.108995 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.109162 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.109242 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.109314 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.109461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.109540 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.109698 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.109783 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.109927 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.110005 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.110163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.110241 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.110410 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] resource.caching = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.110496 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.110659 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.110738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.110913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.110995 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.111154 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.111244 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.111393 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.111471 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.111635 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.111713 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.111867 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.111952 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.112111 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.112189 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.112347 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.112472 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.112602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.112692 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.112806 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] role.caching = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.112892 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.113050 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] role.driver = sql {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.113128 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] resource.caching = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.113279 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.113365 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.113526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.113605 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.113772 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.113851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.114017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.114104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.114261 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.114376 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.114640 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.115099 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.115176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.119532 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.119532 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.119781 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.119859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.119930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.120000 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.120084 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] role.caching = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.120157 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.120228 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] role.driver = sql {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.120298 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.120369 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.120439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.120517 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.120595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.120667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.120667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.120794 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.120864 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.120941 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.121013 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.121084 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.121153 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.121223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.121292 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.121370 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.121442 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.121512 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.121582 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.121651 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.121729 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.121801 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.121870 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.121941 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.122010 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.122080 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.122157 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.122229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.122229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.122362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.122432 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.122502 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.122579 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.122652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.122722 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.122792 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.122917 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.122917 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.123050 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.123123 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.123192 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.123262 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.123331 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.123400 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] token.caching = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.123477 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.123549 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.123618 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.123687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.123796 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.123879 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.123959 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.124032 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.124101 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.124170 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.124239 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.124309 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.124386 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.124447 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.124516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.124586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.124695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.124772 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.124851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.124928 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.125000 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.125068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.125138 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.125207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.125284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] token.caching = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.125345 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.125414 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.125483 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.125552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.125662 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.125754 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.125836 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.125939 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.126007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.126079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.126138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] database.connection = **** {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.126207 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.126285 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.126357 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.126427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.126497 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.126566 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.126635 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.126712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.126784 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.126877 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.126949 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.127018 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.127088 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.127170 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.127170 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.127289 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.127419 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.127500 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.127656 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.127744 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.127901 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.128063 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.128139 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.128209 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.128370 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.128449 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] database.connection = **** {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.128604 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.128684 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.128849 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.128927 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.129079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.129157 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.129318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.129398 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.129554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.129632 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.129723 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 02:11:08.129801 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.130565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.130794 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.131065 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.131307 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.131555 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.131793 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.132044 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.132284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.132576 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.132808 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.133052 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.133290 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 02:11:08.133465 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 02:11:08.159921 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.160144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.160367 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.163345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.163579 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.163806 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.168834 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.172204 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.199131 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.199356 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.201290 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.201520 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.254578 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.254727 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.303826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.304051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.305063 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.305302 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.464281 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.464496 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.464716 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.464935 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.465021 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.465154 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.465239 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.465370 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.465454 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.465652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.465875 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.466096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.488185 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.488302 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.488419 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.488504 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.488649 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.488749 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.488875 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.488959 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.489095 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.489178 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.490005 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.490181 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.490313 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.490397 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.501553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.501698 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.514387 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.514546 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.514635 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.514784 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.514894 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.515046 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.515136 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.515262 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.515345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.515478 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.515571 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.515692 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81671) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.515775 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.515905 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81670) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 02:11:08.533033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.533243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 19 02:11:08.539747 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.539747 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 19 02:11:08.539747 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.539963 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.539963 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 19 02:11:08.540095 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.540095 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.540216 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.540216 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 19 02:11:08.540335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.540405 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.540405 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.540405 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.540405 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.544553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.544835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.545109 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.545395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.546010 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.546299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.546579 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.546908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.552921 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81671) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.554507 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81670) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.555830 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81671) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.556118 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.556401 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.556686 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.556975 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.557241 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.557486 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81670) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.557568 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.557774 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.557855 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.558046 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.558127 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.558321 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.558453 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.558592 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.558672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.558899 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.559179 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.559458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.559737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.560057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.560333 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.581427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.582918 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81671) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.583722 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.584146 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.585656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81670) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.585948 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.588465 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81671) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.588753 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.589039 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.590702 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81670) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.591016 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.591307 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.595359 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81671) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.597147 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.597838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81670) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.598131 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.601558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81671) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.601858 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.602151 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.602450 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.602736 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.603049 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.603326 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.603597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.604265 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81670) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.604573 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.604873 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.605171 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.605458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.605739 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.606016 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.606293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.619827 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.620109 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.624367 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.624367 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.624608 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81671) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.626555 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81670) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.627282 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.627584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.629837 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.630286 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.631893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81671) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.634517 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81670) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.635040 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81671) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.637621 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81670) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.638252 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.638553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.638857 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.639146 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.639435 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.639769 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.640954 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.641259 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.641553 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.641845 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.642129 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.642415 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.655605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81671) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.655896 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.656166 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.656431 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.658579 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81670) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.658895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.659180 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.659437 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.663921 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.665467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.666940 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.667026 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.667290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.668641 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.669933 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81671) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.670079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.670228 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.670379 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.670497 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.670784 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.671206 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.672989 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81670) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.677558 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.677558 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.677558 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.677558 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.682432 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81671) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.682720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.683027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.683317 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.683698 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.683995 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.684279 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.686023 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81670) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.686314 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.686600 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.686909 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.687298 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.687585 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.687870 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.700379 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81671) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.703279 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81671) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.704221 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81670) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.706216 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.707208 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81670) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.707679 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.709194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81671) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.709481 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.709888 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.710286 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.711839 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.713345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81670) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.713636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.714050 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.716268 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.717721 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81671) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.720470 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.720606 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.721007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.721301 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.721586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.721934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81670) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.725645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.726048 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.726341 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.726622 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.730067 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81671) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.730364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.730650 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.734538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81670) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.734854 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.735147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.737625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81671) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.737914 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.738200 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.738488 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.738766 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.739067 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.739435 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.739794 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.740095 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.740337 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.740659 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.740930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.741198 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.741470 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81671) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.742289 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81670) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 02:11:08.742582 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.742896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.743179 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.743457 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.743736 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.744016 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.744302 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.744590 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.744872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.745158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.745425 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.745702 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.746096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81670) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 02:11:08.776544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563b604bf9c0 pid: 81671 (default app) Oct 19 02:11:08.779794 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95f3a7-d72a-4714-a4db-3ebbfbbcff78 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:08.780079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95f3a7-d72a-4714-a4db-3ebbfbbcff78 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:08.780351 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95f3a7-d72a-4714-a4db-3ebbfbbcff78 None None] PATH_INFO: `/v3` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:08.781568 dv-cinder-861491-4-smb devstack@keystone.service[81670]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563b604bf9c0 pid: 81670 (default app) Oct 19 02:11:08.784491 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Wed Oct 19 02:11:08 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:16.462850 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1b83d-fb3c-4ef2-8603-69c47534ada2 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:16.463461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1b83d-fb3c-4ef2-8603-69c47534ada2 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:16.463461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1b83d-fb3c-4ef2-8603-69c47534ada2 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:16.467673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 02:11:16.473183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1963b03-c599-4aac-8516-2e45a1309757 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:16.474246 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1963b03-c599-4aac-8516-2e45a1309757 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:16.474343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1963b03-c599-4aac-8516-2e45a1309757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:16.546370 dv-cinder-861491-4-smb devstack@keystone.service[81671]: INFO dbcounter [None req-b1963b03-c599-4aac-8516-2e45a1309757 None None] Registered counter for database keystone Oct 19 02:11:16.567535 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG oslo_db.sqlalchemy.engines [None req-b1963b03-c599-4aac-8516-2e45a1309757 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 02:11:16.573870 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writer thread running {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 02:11:16.755580 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG passlib.handlers.bcrypt [None req-b1963b03-c599-4aac-8516-2e45a1309757 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81671) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 19 02:11:16.755887 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG passlib.handlers.bcrypt [None req-b1963b03-c599-4aac-8516-2e45a1309757 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81671) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 19 02:11:16.814108 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-b1963b03-c599-4aac-8516-2e45a1309757 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:16.815744 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-b1963b03-c599-4aac-8516-2e45a1309757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:16.947097 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 19 02:11:17.249239 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1b83d-fb3c-4ef2-8603-69c47534ada2 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:17.322407 dv-cinder-861491-4-smb devstack@keystone.service[81670]: INFO dbcounter [None req-87f1b83d-fb3c-4ef2-8603-69c47534ada2 None None] Registered counter for database keystone Oct 19 02:11:17.341499 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG oslo_db.sqlalchemy.engines [None req-87f1b83d-fb3c-4ef2-8603-69c47534ada2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 02:11:17.347634 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writer thread running {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 02:11:17.471005 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1b83d-fb3c-4ef2-8603-69c47534ada2 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:17.475784 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89132773-9cc6-4a52-9ee4-5f0f0f9764cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:17.476407 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89132773-9cc6-4a52-9ee4-5f0f0f9764cb admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:17.476683 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89132773-9cc6-4a52-9ee4-5f0f0f9764cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:17.476951 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89132773-9cc6-4a52-9ee4-5f0f0f9764cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:17.485194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89132773-9cc6-4a52-9ee4-5f0f0f9764cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:17.539401 dv-cinder-861491-4-smb devstack@keystone.service[81670]: WARNING keystone.common.rbac_enforcer.enforcer [None req-89132773-9cc6-4a52-9ee4-5f0f0f9764cb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 19 02:11:17.539742 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89132773-9cc6-4a52-9ee4-5f0f0f9764cb admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:17.549003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Oct 19 02:11:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 02:11:17.555513 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1963b03-c599-4aac-8516-2e45a1309757 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:17.573034 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1963b03-c599-4aac-8516-2e45a1309757 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:17.577436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2526c08-b603-4caf-8309-ca6510ebae59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:17.578541 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2526c08-b603-4caf-8309-ca6510ebae59 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:17.578839 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2526c08-b603-4caf-8309-ca6510ebae59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:17.579120 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2526c08-b603-4caf-8309-ca6510ebae59 admin admin] PATH_INFO: `/v3/projects/223a4736f80b47779a253b8ee6250bb6` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:17.580721 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2526c08-b603-4caf-8309-ca6510ebae59 admin admin] RBAC: Authorizing `identity:get_project(project_id=223a4736f80b47779a253b8ee6250bb6)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:17.634561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e2526c08-b603-4caf-8309-ca6510ebae59 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 19 02:11:17.634936 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2526c08-b603-4caf-8309-ca6510ebae59 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:17.639429 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Oct 19 02:11:17 2022] GET /identity/v3/projects/223a4736f80b47779a253b8ee6250bb6 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:19.742391 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f18a6-4267-43a7-bd62-85ac18fdf9fc None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:19.743046 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f18a6-4267-43a7-bd62-85ac18fdf9fc None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:19.743046 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f18a6-4267-43a7-bd62-85ac18fdf9fc None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:19.747061 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 02:11:19.752501 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a65fd-35c1-4eaa-9173-8f6562b596a3 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:19.752927 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a65fd-35c1-4eaa-9173-8f6562b596a3 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:19.753059 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a65fd-35c1-4eaa-9173-8f6562b596a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:19.773444 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-784a65fd-35c1-4eaa-9173-8f6562b596a3 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:19.775008 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-784a65fd-35c1-4eaa-9173-8f6562b596a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:19.782727 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 02:11:20.049771 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f18a6-4267-43a7-bd62-85ac18fdf9fc None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:20.062289 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f18a6-4267-43a7-bd62-85ac18fdf9fc None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:20.066478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7579b37-67d6-4663-a348-df0645807dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:20.067982 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7579b37-67d6-4663-a348-df0645807dba admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:20.067982 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7579b37-67d6-4663-a348-df0645807dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:20.068176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7579b37-67d6-4663-a348-df0645807dba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:20.075785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7579b37-67d6-4663-a348-df0645807dba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:20.077566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7579b37-67d6-4663-a348-df0645807dba admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:20.086965 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Oct 19 02:11:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:11:20.092135 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a65fd-35c1-4eaa-9173-8f6562b596a3 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:20.101518 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a65fd-35c1-4eaa-9173-8f6562b596a3 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:20.105850 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece5bc6-6386-4f09-8baf-9289177471d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:20.106542 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece5bc6-6386-4f09-8baf-9289177471d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:20.106850 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece5bc6-6386-4f09-8baf-9289177471d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:20.107123 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece5bc6-6386-4f09-8baf-9289177471d7 admin admin] PATH_INFO: `/v3/users/517e3692b01845c4bdf9eea0a2aadadc` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:20.108426 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece5bc6-6386-4f09-8baf-9289177471d7 admin admin] RBAC: Authorizing `identity:get_user(user_id=517e3692b01845c4bdf9eea0a2aadadc)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:20.110257 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece5bc6-6386-4f09-8baf-9289177471d7 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:20.111806 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Wed Oct 19 02:11:20 2022] GET /identity/v3/users/517e3692b01845c4bdf9eea0a2aadadc => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:22.398741 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972c9c0-20a2-488f-bf79-ff46a07b2444 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:22.399293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972c9c0-20a2-488f-bf79-ff46a07b2444 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:22.399387 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972c9c0-20a2-488f-bf79-ff46a07b2444 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:22.400648 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:22.405781 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110020dc-247e-466d-b3a8-419d0d444ee2 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:22.406217 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110020dc-247e-466d-b3a8-419d0d444ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:22.406323 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110020dc-247e-466d-b3a8-419d0d444ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:22.424888 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-110020dc-247e-466d-b3a8-419d0d444ee2 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:22.426093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-110020dc-247e-466d-b3a8-419d0d444ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:22.448865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeabe11-0d31-4031-a833-8f4b5b9b23b3 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:22.449152 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeabe11-0d31-4031-a833-8f4b5b9b23b3 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:22.449431 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeabe11-0d31-4031-a833-8f4b5b9b23b3 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:22.450751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 02:11:22.455796 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2901e12-9564-4573-91a0-86194c54c97d None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:22.456080 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2901e12-9564-4573-91a0-86194c54c97d None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:22.456354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2901e12-9564-4573-91a0-86194c54c97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:22.499472 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG passlib.handlers.bcrypt [None req-c2901e12-9564-4573-91a0-86194c54c97d None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81670) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 19 02:11:22.499791 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG passlib.handlers.bcrypt [None req-c2901e12-9564-4573-91a0-86194c54c97d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81670) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 19 02:11:22.508332 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:11:22.549352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-c2901e12-9564-4573-91a0-86194c54c97d None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:22.550972 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-c2901e12-9564-4573-91a0-86194c54c97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:22.650170 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 02:11:22.783013 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110020dc-247e-466d-b3a8-419d0d444ee2 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:22.808420 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:22.887491 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110020dc-247e-466d-b3a8-419d0d444ee2 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:22.916139 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2901e12-9564-4573-91a0-86194c54c97d None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:22.923582 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92d553-2f38-4736-8463-d421c5a88962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:22.924220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92d553-2f38-4736-8463-d421c5a88962 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:22.924497 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92d553-2f38-4736-8463-d421c5a88962 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:22.924770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92d553-2f38-4736-8463-d421c5a88962 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:22.936092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92d553-2f38-4736-8463-d421c5a88962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:11:22.945466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-3c92d553-2f38-4736-8463-d421c5a88962 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:11:22.945466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:11:22.945466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:11:22.945466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:11:22.945466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:11:22.945466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:11:22.945466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:11:22.945466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:11:22.945466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:11:22.945466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:11:22.945466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:11:22.945466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:11:22.945466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:11:22.945466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:11:22.945466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:11:22.945466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:11:22.946494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:11:22.946494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:11:22.946494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:11:22.946494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:11:22.946494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:11:22.946494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:11:22.946494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:11:22.946494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:11:22.946494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:11:22.946494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:11:22.946494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:11:22.946494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:11:22.946494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:11:22.946494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:11:22.946494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:11:22.946494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:11:22.947585 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:11:22.947585 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:11:22.947585 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:11:22.947585 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:11:22.947585 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:11:22.947585 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:11:22.947585 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:11:22.947585 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:11:22.947585 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:11:22.947585 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:11:22.947585 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:11:22.947585 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:11:22.947585 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 02:11:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:11:22.952261 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92d553-2f38-4736-8463-d421c5a88962 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:23.022164 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2901e12-9564-4573-91a0-86194c54c97d None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:23.024533 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:23.033721 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:23.051204 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92d553-2f38-4736-8463-d421c5a88962 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:23.057813 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff8a15-a8d8-45bc-92b7-8fdeb9670c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:23.058683 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff8a15-a8d8-45bc-92b7-8fdeb9670c0d None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:23.059001 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff8a15-a8d8-45bc-92b7-8fdeb9670c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:23.059276 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff8a15-a8d8-45bc-92b7-8fdeb9670c0d None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:23.060262 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff8a15-a8d8-45bc-92b7-8fdeb9670c0d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:23.061988 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff8a15-a8d8-45bc-92b7-8fdeb9670c0d None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:23.086663 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cafd8f-84d5-49ad-a6f8-076240e73e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:23.087311 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cafd8f-84d5-49ad-a6f8-076240e73e67 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:23.087581 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cafd8f-84d5-49ad-a6f8-076240e73e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:23.087853 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cafd8f-84d5-49ad-a6f8-076240e73e67 None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:23.088542 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cafd8f-84d5-49ad-a6f8-076240e73e67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:23.088845 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cafd8f-84d5-49ad-a6f8-076240e73e67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:23.090249 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cafd8f-84d5-49ad-a6f8-076240e73e67 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:23.102289 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:11:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:11:23.107953 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cafd8f-84d5-49ad-a6f8-076240e73e67 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:23.165978 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.sql.core [None req-c3ff8a15-a8d8-45bc-92b7-8fdeb9670c0d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 02:11:23.165978 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 02:11:23.165978 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [parameters: {'id': '4a5a663d926442b49999ef15b7ef9fa3', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 19 02:11:23.165978 dv-cinder-861491-4-smb devstack@keystone.service[81670]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81670) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 02:11:23.184923 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-c3ff8a15-a8d8-45bc-92b7-8fdeb9670c0d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 19 02:11:23.184923 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:11:23.184923 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 02:11:23.184923 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 02:11:23.184923 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 02:11:23.184923 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 02:11:23.184923 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 02:11:23.184923 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 02:11:23.184923 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 02:11:23.184923 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application conn.query(q) Oct 19 02:11:23.184923 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 02:11:23.184923 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 02:11:23.184923 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 02:11:23.184923 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application result.read() Oct 19 02:11:23.186047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 02:11:23.186047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 02:11:23.186047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 02:11:23.186047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 02:11:23.186047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 02:11:23.186047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 02:11:23.186047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 02:11:23.186047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 02:11:23.186047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 02:11:23.186047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:11:23.186047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 02:11:23.186047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:11:23.186047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:11:23.186047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 02:11:23.186047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 02:11:23.186047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 19 02:11:23.186047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 19 02:11:23.186047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 02:11:23.186970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application next(self.gen) Oct 19 02:11:23.186970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 02:11:23.186970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application yield resource Oct 19 02:11:23.186970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 02:11:23.186970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application next(self.gen) Oct 19 02:11:23.186970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 02:11:23.186970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 02:11:23.186970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 02:11:23.186970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 02:11:23.186970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 02:11:23.186970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise self.value Oct 19 02:11:23.186970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 02:11:23.186970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 02:11:23.186970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 02:11:23.186970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application session.commit() Oct 19 02:11:23.186970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 02:11:23.186970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 02:11:23.188011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 02:11:23.188011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 02:11:23.188011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 02:11:23.188011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self.session.flush() Oct 19 02:11:23.188011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 02:11:23.188011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 02:11:23.188011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 02:11:23.188011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 02:11:23.188011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 02:11:23.188011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application compat.raise_( Oct 19 02:11:23.188011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 02:11:23.188011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception Oct 19 02:11:23.188011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 02:11:23.188011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 02:11:23.188011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 02:11:23.188011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 02:11:23.188011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 02:11:23.189150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 02:11:23.189150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 02:11:23.189150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 02:11:23.189150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 19 02:11:23.189150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 19 02:11:23.189150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 02:11:23.189150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 02:11:23.189150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 02:11:23.189150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 02:11:23.189150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 02:11:23.189150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 02:11:23.189150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 02:11:23.189150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 02:11:23.189150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 02:11:23.189150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 02:11:23.190074 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 02:11:23.190074 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception Oct 19 02:11:23.190074 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 02:11:23.190074 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 02:11:23.190074 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 02:11:23.190074 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 02:11:23.190074 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 02:11:23.190074 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 02:11:23.190074 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 02:11:23.190074 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application conn.query(q) Oct 19 02:11:23.190074 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 02:11:23.190074 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 02:11:23.190074 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 02:11:23.190074 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application result.read() Oct 19 02:11:23.190074 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 02:11:23.190074 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 02:11:23.190074 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 02:11:23.191155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 02:11:23.191155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 02:11:23.191155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 02:11:23.191155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 02:11:23.191155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 02:11:23.191155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 02:11:23.191155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 02:11:23.191155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [parameters: {'id': '4a5a663d926442b49999ef15b7ef9fa3', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 19 02:11:23.191155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 02:11:23.191155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:11:23.191155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:11:23.191155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:11:23.191155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:11:23.191155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 19 02:11:23.191155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 19 02:11:23.192678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 02:11:23.192678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 02:11:23.192678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 19 02:11:23.192678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:11:23.192678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:11:23.192678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:11:23.192678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:11:23.192678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:11:23.192678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:11:23.192678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:11:23.192678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:11:23.192678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:11:23.192678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:11:23.192678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:11:23.192678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:11:23.192678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:11:23.192678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:11:23.193811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 19 02:11:23.193811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 19 02:11:23.193811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:11:23.193811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:11:23.193811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 19 02:11:23.193811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 19 02:11:23.193811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:11:23.193811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:11:23.193811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 19 02:11:23.193811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 19 02:11:23.193811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 19 02:11:23.193811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:11:23.193811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 8/16] 10.222.0.16 () {60 vars in 1137 bytes} [Wed Oct 19 02:11:22 2022] POST /identity/v3/domains => generated 190 bytes in 271 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:11:23.193811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff8a15-a8d8-45bc-92b7-8fdeb9670c0d None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:23.217509 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cafd8f-84d5-49ad-a6f8-076240e73e67 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:23.251244 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0656200-b974-4dd4-9806-dc8febdbdaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:23.251875 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0656200-b974-4dd4-9806-dc8febdbdaea None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:23.252162 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0656200-b974-4dd4-9806-dc8febdbdaea None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:23.252441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0656200-b974-4dd4-9806-dc8febdbdaea None admin] PATH_INFO: `/v3/users/517e3692b01845c4bdf9eea0a2aadadc` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:23.253611 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0656200-b974-4dd4-9806-dc8febdbdaea None admin] RBAC: Authorizing `identity:get_user(user_id=517e3692b01845c4bdf9eea0a2aadadc)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:23.255771 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0656200-b974-4dd4-9806-dc8febdbdaea None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:23.257554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:11:23 2022] GET /identity/v3/users/517e3692b01845c4bdf9eea0a2aadadc => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:11:23.262678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0656200-b974-4dd4-9806-dc8febdbdaea None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:23.278956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:23.296631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff8a15-a8d8-45bc-92b7-8fdeb9670c0d None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:23.331785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f5154-d375-48ab-b1c9-20e804adcb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:23.332632 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f5154-d375-48ab-b1c9-20e804adcb6c None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:23.333459 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f5154-d375-48ab-b1c9-20e804adcb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:23.333734 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f5154-d375-48ab-b1c9-20e804adcb6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:23.351891 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f5154-d375-48ab-b1c9-20e804adcb6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:23.359659 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f5154-d375-48ab-b1c9-20e804adcb6c None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:23.365135 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0656200-b974-4dd4-9806-dc8febdbdaea None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:23.369703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-f18f5154-d375-48ab-b1c9-20e804adcb6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:11:23.369703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:11:23.369703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:11:23.369703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:11:23.369703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:11:23.369703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:11:23.369703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:11:23.369703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:11:23.369703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:11:23.369703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:11:23.369703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:11:23.369703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:11:23.369703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:11:23.369703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:11:23.369703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:11:23.369703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:11:23.370545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:11:23.370545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:11:23.370545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:11:23.370545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:11:23.370545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:11:23.370545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:11:23.370545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:11:23.370545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:11:23.370545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:11:23.370545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:11:23.370545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:11:23.370545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:11:23.370545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:11:23.370545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:11:23.370545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:11:23.370545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:11:23.370545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:11:23.371474 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:11:23.371474 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:11:23.371474 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:11:23.371474 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:11:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:11:23.376624 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f5154-d375-48ab-b1c9-20e804adcb6c None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:23.398897 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:23.405440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c0bec-6904-493f-963b-622f3f937e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:23.405440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c0bec-6904-493f-963b-622f3f937e3d None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:23.405440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c0bec-6904-493f-963b-622f3f937e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:23.405440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c0bec-6904-493f-963b-622f3f937e3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:23.405783 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c0bec-6904-493f-963b-622f3f937e3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:23.405783 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c0bec-6904-493f-963b-622f3f937e3d None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:23.407443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:11:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:11:23.413259 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c0bec-6904-493f-963b-622f3f937e3d None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:23.479227 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f5154-d375-48ab-b1c9-20e804adcb6c None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:23.493894 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:23.512791 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c0bec-6904-493f-963b-622f3f937e3d None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:23.514298 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2c1c2-1620-414c-a776-903c2e848eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:23.514952 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2c1c2-1620-414c-a776-903c2e848eef None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:23.515235 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2c1c2-1620-414c-a776-903c2e848eef None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:23.515505 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2c1c2-1620-414c-a776-903c2e848eef None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:23.516153 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2c1c2-1620-414c-a776-903c2e848eef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:23.516455 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2c1c2-1620-414c-a776-903c2e848eef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:23.517824 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2c1c2-1620-414c-a776-903c2e848eef None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:23.534984 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 10/20] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:11:23.547441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0550cf-7a57-4416-9330-5cd3b7a27d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:23.548049 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0550cf-7a57-4416-9330-5cd3b7a27d25 None admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:23.548328 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0550cf-7a57-4416-9330-5cd3b7a27d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:23.548605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0550cf-7a57-4416-9330-5cd3b7a27d25 None admin] PATH_INFO: `/v3/domains/default/users/517e3692b01845c4bdf9eea0a2aadadc/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:23.550682 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0550cf-7a57-4416-9330-5cd3b7a27d25 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=517e3692b01845c4bdf9eea0a2aadadc, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:23.552899 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0550cf-7a57-4416-9330-5cd3b7a27d25 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:23.749550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 11/21] 10.222.0.16 () {58 vars in 1361 bytes} [Wed Oct 19 02:11:23 2022] PUT /identity/v3/domains/default/users/517e3692b01845c4bdf9eea0a2aadadc/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:11:26.014553 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900d3fc-f20d-49b8-b062-4891ada3c40c None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:26.015104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900d3fc-f20d-49b8-b062-4891ada3c40c None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:26.015214 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900d3fc-f20d-49b8-b062-4891ada3c40c None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:26.016804 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 11/22] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:26.023914 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b45f5-66c4-4058-8c70-ef81a81b0d13 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:26.024393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b45f5-66c4-4058-8c70-ef81a81b0d13 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:26.024466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b45f5-66c4-4058-8c70-ef81a81b0d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:26.047699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-1a5b45f5-66c4-4058-8c70-ef81a81b0d13 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:26.049209 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-1a5b45f5-66c4-4058-8c70-ef81a81b0d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:26.148452 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 12/23] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 02:11:26.248513 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd02418-56f0-4924-826d-8aa29cf4d9ac None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:26.249169 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd02418-56f0-4924-826d-8aa29cf4d9ac None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:26.249661 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd02418-56f0-4924-826d-8aa29cf4d9ac None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:26.251211 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:26.257238 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2fd7b-34ea-4ddc-a5a5-61e10494c1ca None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:26.257528 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2fd7b-34ea-4ddc-a5a5-61e10494c1ca None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:26.257804 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2fd7b-34ea-4ddc-a5a5-61e10494c1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:26.284401 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-01c2fd7b-34ea-4ddc-a5a5-61e10494c1ca None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:26.285519 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-01c2fd7b-34ea-4ddc-a5a5-61e10494c1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:26.372530 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:26.377469 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 13/25] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 02:11:26.625365 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976511f0-8656-47c2-bc82-bfddd2b8ae81 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:26.626083 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976511f0-8656-47c2-bc82-bfddd2b8ae81 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:26.626568 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976511f0-8656-47c2-bc82-bfddd2b8ae81 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:26.628610 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 13/26] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:26.634479 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba3ede-e6ad-4409-968f-28a78b3a03a2 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:26.634778 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba3ede-e6ad-4409-968f-28a78b3a03a2 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:26.635068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba3ede-e6ad-4409-968f-28a78b3a03a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:26.656765 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976511f0-8656-47c2-bc82-bfddd2b8ae81 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:26.658244 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-e7ba3ede-e6ad-4409-968f-28a78b3a03a2 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:26.659465 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-e7ba3ede-e6ad-4409-968f-28a78b3a03a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:26.801111 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 14/27] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:11:26.807206 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba3ede-e6ad-4409-968f-28a78b3a03a2 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:26.820609 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:26.853870 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976511f0-8656-47c2-bc82-bfddd2b8ae81 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:26.917615 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17400f89-0467-4cc1-ba95-dae5d84e9d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:26.918174 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17400f89-0467-4cc1-ba95-dae5d84e9d92 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:26.918449 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17400f89-0467-4cc1-ba95-dae5d84e9d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:26.918720 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17400f89-0467-4cc1-ba95-dae5d84e9d92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:26.936540 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17400f89-0467-4cc1-ba95-dae5d84e9d92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:26.938031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17400f89-0467-4cc1-ba95-dae5d84e9d92 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:26.967070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-17400f89-0467-4cc1-ba95-dae5d84e9d92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:11:26.967070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:11:26.967070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:11:26.967070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:11:26.967070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:11:26.967070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:11:26.967070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:11:26.967070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:11:26.967070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:11:26.967070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:11:26.967070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:11:26.967070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:11:26.967070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:11:26.967070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:11:26.967070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:11:26.967070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:11:26.967987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:11:26.967987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:11:26.967987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:11:26.967987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:11:26.967987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:11:26.967987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:11:26.967987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:11:26.967987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:11:26.967987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:11:26.967987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:11:26.967987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:11:26.967987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:11:26.967987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:11:26.967987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:11:26.967987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:11:26.967987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:11:26.967987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:11:26.968785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:11:26.968785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:11:26.968785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:11:26.968785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 14/28] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:11:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:11:26.969369 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4623fd-2650-468e-b8e8-3831171116a2 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:26.969805 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4623fd-2650-468e-b8e8-3831171116a2 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:26.970201 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4623fd-2650-468e-b8e8-3831171116a2 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:26.971589 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 15/29] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:26.978929 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4623fd-2650-468e-b8e8-3831171116a2 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:27.021585 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba3ede-e6ad-4409-968f-28a78b3a03a2 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:27.069838 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:27.083989 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b3842-ae76-482d-b3c0-ced14fbef768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:27.084678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b3842-ae76-482d-b3c0-ced14fbef768 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:27.085002 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b3842-ae76-482d-b3c0-ced14fbef768 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:27.085277 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b3842-ae76-482d-b3c0-ced14fbef768 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:27.104009 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b3842-ae76-482d-b3c0-ced14fbef768 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:11:27.110502 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-361b3842-ae76-482d-b3c0-ced14fbef768 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:11:27.110502 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:11:27.110502 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:11:27.110502 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:11:27.110502 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:11:27.110502 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:11:27.110502 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:11:27.110502 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:11:27.110502 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:11:27.110502 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:11:27.110502 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:11:27.110502 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:11:27.110502 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:11:27.110502 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:11:27.110502 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:11:27.110502 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:11:27.111389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:11:27.111389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:11:27.111389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:11:27.111389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:11:27.111389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:11:27.111389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:11:27.111389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:11:27.111389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:11:27.111389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:11:27.111389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:11:27.111389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:11:27.111389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:11:27.111389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:11:27.111389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:11:27.111389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:11:27.111389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:11:27.112134 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:11:27.112134 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:11:27.112134 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:11:27.112134 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:11:27.112134 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:11:27.112134 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:11:27.112134 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:11:27.112134 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:11:27.112134 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:11:27.112134 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:11:27.112134 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:11:27.112134 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:11:27.114626 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 15/30] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 02:11:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:11:27.116656 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6dc0d-a151-41d3-bd95-623b76a467ee None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:27.117156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6dc0d-a151-41d3-bd95-623b76a467ee None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:27.117630 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6dc0d-a151-41d3-bd95-623b76a467ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:27.141725 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4623fd-2650-468e-b8e8-3831171116a2 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:27.157363 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-f5f6dc0d-a151-41d3-bd95-623b76a467ee None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:27.158575 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-f5f6dc0d-a151-41d3-bd95-623b76a467ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:27.186675 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:27.192725 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6630d-2d17-4115-a114-0ee85e8fd0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:27.193357 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6630d-2d17-4115-a114-0ee85e8fd0b8 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:27.193637 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6630d-2d17-4115-a114-0ee85e8fd0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:27.193908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6630d-2d17-4115-a114-0ee85e8fd0b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:27.194560 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6630d-2d17-4115-a114-0ee85e8fd0b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:27.198356 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6630d-2d17-4115-a114-0ee85e8fd0b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:27.198356 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6630d-2d17-4115-a114-0ee85e8fd0b8 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:27.210272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 16/31] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:27.211274 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6630d-2d17-4115-a114-0ee85e8fd0b8 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:27.238202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 16/32] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:11:27.247932 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6dc0d-a151-41d3-bd95-623b76a467ee None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:27.325841 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6630d-2d17-4115-a114-0ee85e8fd0b8 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:27.365541 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e87335-c886-4c7c-ba8c-6712c838ff2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:27.366164 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e87335-c886-4c7c-ba8c-6712c838ff2a None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:27.366501 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e87335-c886-4c7c-ba8c-6712c838ff2a None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:27.366783 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e87335-c886-4c7c-ba8c-6712c838ff2a None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:27.367540 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e87335-c886-4c7c-ba8c-6712c838ff2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:27.367851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e87335-c886-4c7c-ba8c-6712c838ff2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:27.369254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e87335-c886-4c7c-ba8c-6712c838ff2a None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:27.382871 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 17/33] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:11:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:27.383774 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e87335-c886-4c7c-ba8c-6712c838ff2a None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:27.446261 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6dc0d-a151-41d3-bd95-623b76a467ee None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:27.453460 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:27.505281 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e87335-c886-4c7c-ba8c-6712c838ff2a None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:27.507179 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:27.543220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb0f45-c596-4c61-80b9-cf33711491ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:27.544061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb0f45-c596-4c61-80b9-cf33711491ac None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:27.544350 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb0f45-c596-4c61-80b9-cf33711491ac None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:27.544631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb0f45-c596-4c61-80b9-cf33711491ac None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:27.545305 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb0f45-c596-4c61-80b9-cf33711491ac None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:27.545472 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966c8b2-0ed4-4c0d-aab5-f73f4fd51ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:27.546227 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966c8b2-0ed4-4c0d-aab5-f73f4fd51ad0 None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:27.546673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966c8b2-0ed4-4c0d-aab5-f73f4fd51ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:27.546957 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb0f45-c596-4c61-80b9-cf33711491ac None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:27.547258 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966c8b2-0ed4-4c0d-aab5-f73f4fd51ad0 None admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:27.548094 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966c8b2-0ed4-4c0d-aab5-f73f4fd51ad0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:27.549681 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966c8b2-0ed4-4c0d-aab5-f73f4fd51ad0 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:27.656829 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 17/34] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Oct 19 02:11:27 2022] POST /identity/v3/roles => generated 225 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:11:27.657670 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb0f45-c596-4c61-80b9-cf33711491ac None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:27.807552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 18/35] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 02:11:27 2022] POST /identity/v3/projects => generated 301 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:11:27.809640 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b5eff-3102-4909-91c5-17b8405797f4 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:27.810196 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b5eff-3102-4909-91c5-17b8405797f4 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:27.810970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b5eff-3102-4909-91c5-17b8405797f4 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:27.812605 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:27.813682 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b5eff-3102-4909-91c5-17b8405797f4 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:27.914484 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb0f45-c596-4c61-80b9-cf33711491ac None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:27.966297 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b5eff-3102-4909-91c5-17b8405797f4 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:27.979054 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:27.980041 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223c9ed-a92a-4c66-b5ac-d012c787fddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:27.980918 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223c9ed-a92a-4c66-b5ac-d012c787fddb None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:27.982463 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223c9ed-a92a-4c66-b5ac-d012c787fddb None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:27.983435 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223c9ed-a92a-4c66-b5ac-d012c787fddb None admin] PATH_INFO: `/v3/users/517e3692b01845c4bdf9eea0a2aadadc` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:27.985297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223c9ed-a92a-4c66-b5ac-d012c787fddb None admin] RBAC: Authorizing `identity:get_user(user_id=517e3692b01845c4bdf9eea0a2aadadc)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:27.987709 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223c9ed-a92a-4c66-b5ac-d012c787fddb None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:27.990129 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 18/37] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:11:27 2022] GET /identity/v3/users/517e3692b01845c4bdf9eea0a2aadadc => generated 247 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:27.992099 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65ff53-4a52-4508-bce5-98bc53273501 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:27.992618 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65ff53-4a52-4508-bce5-98bc53273501 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:27.993127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65ff53-4a52-4508-bce5-98bc53273501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:28.015521 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-8a65ff53-4a52-4508-bce5-98bc53273501 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:28.016747 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-8a65ff53-4a52-4508-bce5-98bc53273501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:28.023179 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1eee2-c6d4-4d9d-9755-a56ab187d332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:28.023878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1eee2-c6d4-4d9d-9755-a56ab187d332 None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:28.024169 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1eee2-c6d4-4d9d-9755-a56ab187d332 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:28.024538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1eee2-c6d4-4d9d-9755-a56ab187d332 None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:28.025290 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1eee2-c6d4-4d9d-9755-a56ab187d332 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:28.027434 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1eee2-c6d4-4d9d-9755-a56ab187d332 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:28.068035 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:28.077033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 20/38] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Oct 19 02:11:27 2022] POST /identity/v3/roles => generated 219 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:11:28.077684 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1eee2-c6d4-4d9d-9755-a56ab187d332 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:28.103530 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 19/39] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:11:28.105004 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbc320-b7c6-42fb-abf6-06af654f5e1c None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:28.105461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbc320-b7c6-42fb-abf6-06af654f5e1c None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:28.105747 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbc320-b7c6-42fb-abf6-06af654f5e1c None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:28.107339 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 20/40] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:28.113804 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade99844-6b7d-4279-be57-6d9044ba79fc None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:28.114582 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade99844-6b7d-4279-be57-6d9044ba79fc None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:28.116929 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade99844-6b7d-4279-be57-6d9044ba79fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:28.146265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-ade99844-6b7d-4279-be57-6d9044ba79fc None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:28.148797 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ade99844-6b7d-4279-be57-6d9044ba79fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:28.236067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1eee2-c6d4-4d9d-9755-a56ab187d332 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:28.261992 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 21/41] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 19 02:11:28.283250 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c958849-5dca-4ae9-b81b-f3c195877761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:28.283963 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c958849-5dca-4ae9-b81b-f3c195877761 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:28.284253 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c958849-5dca-4ae9-b81b-f3c195877761 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:28.284480 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c958849-5dca-4ae9-b81b-f3c195877761 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:28.286295 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c958849-5dca-4ae9-b81b-f3c195877761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:28.289703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c958849-5dca-4ae9-b81b-f3c195877761 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:28.289703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 21/42] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:11:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:28.295522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade99844-6b7d-4279-be57-6d9044ba79fc None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:28.402924 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade99844-6b7d-4279-be57-6d9044ba79fc None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:28.413259 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:28.424081 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c958849-5dca-4ae9-b81b-f3c195877761 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:28.439518 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be3ab2-8aec-42aa-8c75-14d40b2356f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:28.440235 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be3ab2-8aec-42aa-8c75-14d40b2356f6 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:28.440520 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be3ab2-8aec-42aa-8c75-14d40b2356f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:28.440791 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be3ab2-8aec-42aa-8c75-14d40b2356f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:28.441513 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be3ab2-8aec-42aa-8c75-14d40b2356f6 None admin] RBAC: Adding query filter params (role.id=e2e7c80d19c141bc9f9bfc13c2ec2a12, scope.domain.id=default, user.id=517e3692b01845c4bdf9eea0a2aadadc) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:28.442118 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be3ab2-8aec-42aa-8c75-14d40b2356f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:28.443788 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be3ab2-8aec-42aa-8c75-14d40b2356f6 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:28.452179 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 22/43] 10.222.0.16 () {56 vars in 1322 bytes} [Wed Oct 19 02:11:28 2022] GET /identity/v3/role_assignments?user.id=517e3692b01845c4bdf9eea0a2aadadc&scope.domain.id=default&role.id=e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 530 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:28.462977 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:28.539820 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c958849-5dca-4ae9-b81b-f3c195877761 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:28.548021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be3ab2-8aec-42aa-8c75-14d40b2356f6 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:28.580181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01259f88-8a14-4df4-a70b-7fedb560fe0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:28.580935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01259f88-8a14-4df4-a70b-7fedb560fe0d None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:28.581220 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01259f88-8a14-4df4-a70b-7fedb560fe0d None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:28.581501 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01259f88-8a14-4df4-a70b-7fedb560fe0d None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:28.582251 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01259f88-8a14-4df4-a70b-7fedb560fe0d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:28.584910 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01259f88-8a14-4df4-a70b-7fedb560fe0d None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:28.662691 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be3ab2-8aec-42aa-8c75-14d40b2356f6 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:28.698461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37509ad5-1632-4fc0-8d31-8544e3bc0ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:28.701317 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37509ad5-1632-4fc0-8d31-8544e3bc0ebd None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:28.701317 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37509ad5-1632-4fc0-8d31-8544e3bc0ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:28.701317 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37509ad5-1632-4fc0-8d31-8544e3bc0ebd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:28.701317 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37509ad5-1632-4fc0-8d31-8544e3bc0ebd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:28.702341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37509ad5-1632-4fc0-8d31-8544e3bc0ebd None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:28.703944 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 23/44] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:11:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:11:28.709940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37509ad5-1632-4fc0-8d31-8544e3bc0ebd None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:28.752938 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:28.773260 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Oct 19 02:11:28 2022] POST /identity/v3/roles => generated 223 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:11:28.815893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37509ad5-1632-4fc0-8d31-8544e3bc0ebd None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:28.854804 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a630201-9705-471b-b4fd-1fc418319928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:28.855444 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a630201-9705-471b-b4fd-1fc418319928 None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:28.855725 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a630201-9705-471b-b4fd-1fc418319928 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:28.855996 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a630201-9705-471b-b4fd-1fc418319928 None admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:28.856785 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a630201-9705-471b-b4fd-1fc418319928 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:28.858267 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a630201-9705-471b-b4fd-1fc418319928 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:28.972690 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 02:11:28 2022] POST /identity/v3/projects => generated 312 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:11:31.129828 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167a3af-0379-4044-a1cb-2c703ef1c013 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:31.130348 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167a3af-0379-4044-a1cb-2c703ef1c013 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:31.130457 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167a3af-0379-4044-a1cb-2c703ef1c013 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:31.131765 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 23/47] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:31.136935 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79113621-7e08-4bb4-93e0-f318ed9cd52b None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:31.137341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79113621-7e08-4bb4-93e0-f318ed9cd52b None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:31.137494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79113621-7e08-4bb4-93e0-f318ed9cd52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:31.155460 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-79113621-7e08-4bb4-93e0-f318ed9cd52b None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:31.156651 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-79113621-7e08-4bb4-93e0-f318ed9cd52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:31.221755 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 25/48] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:11:31.492708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167a3af-0379-4044-a1cb-2c703ef1c013 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:31.585693 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:31.593025 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167a3af-0379-4044-a1cb-2c703ef1c013 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:31.625769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68925139-bea3-4e87-8a08-9f93219a20e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:31.626387 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68925139-bea3-4e87-8a08-9f93219a20e4 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:31.626667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68925139-bea3-4e87-8a08-9f93219a20e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:31.626970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68925139-bea3-4e87-8a08-9f93219a20e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:31.628092 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68925139-bea3-4e87-8a08-9f93219a20e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:31.630146 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68925139-bea3-4e87-8a08-9f93219a20e4 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:31.631744 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 24/49] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:11:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:31.637249 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79113621-7e08-4bb4-93e0-f318ed9cd52b None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:31.662363 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:31.736940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79113621-7e08-4bb4-93e0-f318ed9cd52b None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:31.769670 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe70bbc-78ff-4468-b7f4-2fb5c84fb7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:31.771209 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe70bbc-78ff-4468-b7f4-2fb5c84fb7f9 None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:31.771490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe70bbc-78ff-4468-b7f4-2fb5c84fb7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:31.771760 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe70bbc-78ff-4468-b7f4-2fb5c84fb7f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:31.772405 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe70bbc-78ff-4468-b7f4-2fb5c84fb7f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:31.773854 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe70bbc-78ff-4468-b7f4-2fb5c84fb7f9 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:31.852493 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Oct 19 02:11:31 2022] POST /identity/v3/projects => generated 298 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:11:34.001879 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fff18b-83df-4afc-9957-1a3fb4f9a835 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:34.002429 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fff18b-83df-4afc-9957-1a3fb4f9a835 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:34.002429 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fff18b-83df-4afc-9957-1a3fb4f9a835 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:34.003837 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 25/51] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:34.009848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de9ee6-34f1-4974-8fff-57ec0b28934a None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:34.010272 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de9ee6-34f1-4974-8fff-57ec0b28934a None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:34.010407 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de9ee6-34f1-4974-8fff-57ec0b28934a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:34.028275 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-26de9ee6-34f1-4974-8fff-57ec0b28934a None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:34.029462 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-26de9ee6-34f1-4974-8fff-57ec0b28934a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:34.094015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 27/52] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:11:34.366290 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fff18b-83df-4afc-9957-1a3fb4f9a835 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:34.465608 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fff18b-83df-4afc-9957-1a3fb4f9a835 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:34.499189 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1d6d5-53b2-496a-9762-c7c4e5cdd893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:34.499810 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1d6d5-53b2-496a-9762-c7c4e5cdd893 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:34.500094 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1d6d5-53b2-496a-9762-c7c4e5cdd893 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:34.500368 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1d6d5-53b2-496a-9762-c7c4e5cdd893 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:34.501478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1d6d5-53b2-496a-9762-c7c4e5cdd893 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:34.502953 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1d6d5-53b2-496a-9762-c7c4e5cdd893 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:34.504607 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:11:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:34.510062 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de9ee6-34f1-4974-8fff-57ec0b28934a None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:34.513154 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:34.606694 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de9ee6-34f1-4974-8fff-57ec0b28934a None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:34.639731 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddea4e5-ff54-4edd-ba9d-9e5d32392a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:34.640277 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddea4e5-ff54-4edd-ba9d-9e5d32392a82 None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:34.640564 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddea4e5-ff54-4edd-ba9d-9e5d32392a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:34.640843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddea4e5-ff54-4edd-ba9d-9e5d32392a82 None admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:34.641503 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddea4e5-ff54-4edd-ba9d-9e5d32392a82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:34.642990 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddea4e5-ff54-4edd-ba9d-9e5d32392a82 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:34.806418 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 28/54] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 02:11:34 2022] POST /identity/v3/users => generated 275 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:11:37.934666 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8f91c-cdc9-45a0-88bb-c3f9fe87c501 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:37.936031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8f91c-cdc9-45a0-88bb-c3f9fe87c501 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:37.936527 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8f91c-cdc9-45a0-88bb-c3f9fe87c501 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:37.938093 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 27/55] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:37.944412 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5054739-b8de-4ae2-814c-2e5675b4ed2c None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:37.945274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5054739-b8de-4ae2-814c-2e5675b4ed2c None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:37.945765 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5054739-b8de-4ae2-814c-2e5675b4ed2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:37.977389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-f5054739-b8de-4ae2-814c-2e5675b4ed2c None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:37.979368 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-f5054739-b8de-4ae2-814c-2e5675b4ed2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:38.099246 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:38.115466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 29/56] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 02:11:38.174264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd88dd5-cc3f-4390-8352-4945b4b5df44 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:38.174938 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd88dd5-cc3f-4390-8352-4945b4b5df44 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:38.175431 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd88dd5-cc3f-4390-8352-4945b4b5df44 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:38.178386 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 28/57] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:38.184135 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca253f41-427c-4e48-ab19-28e45759b538 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:38.184431 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca253f41-427c-4e48-ab19-28e45759b538 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:38.184769 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca253f41-427c-4e48-ab19-28e45759b538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:38.207414 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-ca253f41-427c-4e48-ab19-28e45759b538 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:38.211193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ca253f41-427c-4e48-ab19-28e45759b538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:38.302370 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 30/58] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:11:38.486602 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb296de4-6597-468b-b3d2-64324d410c95 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:38.487296 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb296de4-6597-468b-b3d2-64324d410c95 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:38.487797 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb296de4-6597-468b-b3d2-64324d410c95 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:38.490022 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 29/59] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:38.495591 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2778511-6cea-43c3-a375-30381ceebf7c None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:38.496165 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2778511-6cea-43c3-a375-30381ceebf7c None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:38.496652 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2778511-6cea-43c3-a375-30381ceebf7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:38.520585 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb296de4-6597-468b-b3d2-64324d410c95 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:38.525207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-d2778511-6cea-43c3-a375-30381ceebf7c None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:38.526395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-d2778511-6cea-43c3-a375-30381ceebf7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:38.559157 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:38.646096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb296de4-6597-468b-b3d2-64324d410c95 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:38.669207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 31/60] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:11:38.670357 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2778511-6cea-43c3-a375-30381ceebf7c None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:38.689750 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469ea48-4e2f-4e13-b320-fd768e6978c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:38.690649 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469ea48-4e2f-4e13-b320-fd768e6978c8 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:38.691115 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469ea48-4e2f-4e13-b320-fd768e6978c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:38.692088 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469ea48-4e2f-4e13-b320-fd768e6978c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:38.706619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469ea48-4e2f-4e13-b320-fd768e6978c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:11:38.713880 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-d469ea48-4e2f-4e13-b320-fd768e6978c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:11:38.713880 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:11:38.713880 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:11:38.713880 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:11:38.713880 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:11:38.713880 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:11:38.713880 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:11:38.713880 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:11:38.713880 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:11:38.713880 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:11:38.713880 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:11:38.713880 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:11:38.713880 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:11:38.713880 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:11:38.713880 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:11:38.713880 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:11:38.714768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:11:38.714768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:11:38.714768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:11:38.714768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:11:38.714768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:11:38.714768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:11:38.714768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:11:38.714768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:11:38.714768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:11:38.714768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:11:38.714768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:11:38.714768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:11:38.714768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:11:38.714768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:11:38.714768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:11:38.714768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:11:38.715991 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:11:38.715991 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:11:38.715991 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:11:38.715991 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:11:38.715991 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:11:38.715991 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:11:38.715991 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:11:38.715991 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:11:38.715991 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:11:38.715991 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:11:38.715991 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:11:38.715991 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:11:38.723111 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:11:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:11:38.723111 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90661c-1165-4a48-b889-828499d40a41 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:38.723438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90661c-1165-4a48-b889-828499d40a41 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:38.723570 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90661c-1165-4a48-b889-828499d40a41 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:38.724770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 31/62] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:38.726464 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90661c-1165-4a48-b889-828499d40a41 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:38.740419 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:38.795404 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2778511-6cea-43c3-a375-30381ceebf7c None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:38.839863 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5d5ae-8176-427e-8318-ac145fcb9316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:38.841101 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5d5ae-8176-427e-8318-ac145fcb9316 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:38.841590 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5d5ae-8176-427e-8318-ac145fcb9316 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:38.842055 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5d5ae-8176-427e-8318-ac145fcb9316 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:38.855100 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5d5ae-8176-427e-8318-ac145fcb9316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:11:38.859444 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:38.860573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-60f5d5ae-8176-427e-8318-ac145fcb9316 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:11:38.860573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:11:38.860573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:11:38.860573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:11:38.860573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:11:38.860573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:11:38.860573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:11:38.860573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:11:38.860573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:11:38.860573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:11:38.860573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:11:38.860573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:11:38.860573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:11:38.860573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:11:38.860573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:11:38.860573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:11:38.861382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:11:38.861382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:11:38.861382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:11:38.861382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:11:38.861382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:11:38.861382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:11:38.861382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:11:38.861382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:11:38.861382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:11:38.861382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:11:38.861382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:11:38.861382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:11:38.861382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:11:38.861382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:11:38.861382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:11:38.861382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:11:38.862143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:11:38.862143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:11:38.862143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:11:38.862143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:11:38.862143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:11:38.862143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:11:38.862143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:11:38.862143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:11:38.862143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:11:38.862143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:11:38.862143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:11:38.862143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:11:38.865619 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 32/63] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 02:11:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:11:38.867640 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6b3d3-9f61-42ee-9456-fdadbdfbb787 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:38.868139 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6b3d3-9f61-42ee-9456-fdadbdfbb787 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:38.868623 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6b3d3-9f61-42ee-9456-fdadbdfbb787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:38.876885 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90661c-1165-4a48-b889-828499d40a41 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:38.887181 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-a7b6b3d3-9f61-42ee-9456-fdadbdfbb787 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:38.888618 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-a7b6b3d3-9f61-42ee-9456-fdadbdfbb787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:38.915080 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71bce7a-e6b1-45f6-9e8e-92bc847765d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:38.915696 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bce7a-e6b1-45f6-9e8e-92bc847765d7 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:38.915983 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bce7a-e6b1-45f6-9e8e-92bc847765d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:38.916248 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bce7a-e6b1-45f6-9e8e-92bc847765d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:38.916908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71bce7a-e6b1-45f6-9e8e-92bc847765d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:38.917211 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71bce7a-e6b1-45f6-9e8e-92bc847765d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:38.918595 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71bce7a-e6b1-45f6-9e8e-92bc847765d7 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:38.932921 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 32/64] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 02:11:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:11:38.933847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71bce7a-e6b1-45f6-9e8e-92bc847765d7 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:38.963260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 33/65] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:11:38.964900 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6b3d3-9f61-42ee-9456-fdadbdfbb787 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:39.012894 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:39.074195 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6b3d3-9f61-42ee-9456-fdadbdfbb787 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:39.110485 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02740d04-918f-4ae9-be30-1469bffa679f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:39.111510 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02740d04-918f-4ae9-be30-1469bffa679f None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:39.112023 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02740d04-918f-4ae9-be30-1469bffa679f None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:39.112499 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02740d04-918f-4ae9-be30-1469bffa679f None admin] PATH_INFO: `/v3/users/947420b556064f1388b8623a98f5073e` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:39.130883 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02740d04-918f-4ae9-be30-1469bffa679f None admin] RBAC: Authorizing `identity:get_user(user_id=947420b556064f1388b8623a98f5073e)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:39.132357 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02740d04-918f-4ae9-be30-1469bffa679f None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:39.134298 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 34/66] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:11:38 2022] GET /identity/v3/users/947420b556064f1388b8623a98f5073e => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:39.135541 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3b0e5-aa79-467e-8259-508f8861fc36 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:39.135826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3b0e5-aa79-467e-8259-508f8861fc36 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:39.136098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3b0e5-aa79-467e-8259-508f8861fc36 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:39.137441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 35/67] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:39.138037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3b0e5-aa79-467e-8259-508f8861fc36 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:39.160164 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71bce7a-e6b1-45f6-9e8e-92bc847765d7 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:39.197409 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b42f80-a040-47ad-ac6b-9984d593d645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:39.198719 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b42f80-a040-47ad-ac6b-9984d593d645 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:39.199535 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b42f80-a040-47ad-ac6b-9984d593d645 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:39.200037 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b42f80-a040-47ad-ac6b-9984d593d645 None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:39.201374 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b42f80-a040-47ad-ac6b-9984d593d645 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:39.202034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b42f80-a040-47ad-ac6b-9984d593d645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:39.203902 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b42f80-a040-47ad-ac6b-9984d593d645 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:39.221913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 33/68] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:11:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:39.221913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b42f80-a040-47ad-ac6b-9984d593d645 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:39.235740 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:39.250991 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:39.256053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3b0e5-aa79-467e-8259-508f8861fc36 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:39.290209 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372f50a-86f6-4db4-871f-9eb4341dfcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:39.290792 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372f50a-86f6-4db4-871f-9eb4341dfcbd None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:39.291106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372f50a-86f6-4db4-871f-9eb4341dfcbd None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:39.291383 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372f50a-86f6-4db4-871f-9eb4341dfcbd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:39.301407 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372f50a-86f6-4db4-871f-9eb4341dfcbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:11:39.306625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-2372f50a-86f6-4db4-871f-9eb4341dfcbd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 02:11:39.306625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:11:39.306625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:11:39.306625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:11:39.306625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:11:39.306625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:11:39.306625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:11:39.306625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:11:39.306625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:11:39.306625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:11:39.306625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:11:39.306625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:11:39.306625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:11:39.306625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:11:39.306625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:11:39.306625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:11:39.307490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:11:39.307490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:11:39.307490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:11:39.307490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:11:39.307490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:11:39.307490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:11:39.307490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:11:39.307490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:11:39.307490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:11:39.307490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:11:39.307490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:11:39.307490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:11:39.307490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:11:39.307490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:11:39.307490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:11:39.307490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:11:39.308274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:11:39.308274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:11:39.308274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:11:39.308274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:11:39.308274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:11:39.308274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:11:39.308274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:11:39.308274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:11:39.308274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:11:39.308274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:11:39.308274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 02:11:39.308274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:11:39.308274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 36/69] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 02:11:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:11:39.309269 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d571b-6949-430d-ae86-aed83c861f02 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:39.309564 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d571b-6949-430d-ae86-aed83c861f02 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:39.310243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d571b-6949-430d-ae86-aed83c861f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:39.327715 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-e38d571b-6949-430d-ae86-aed83c861f02 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:39.328660 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b42f80-a040-47ad-ac6b-9984d593d645 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:39.328905 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-e38d571b-6949-430d-ae86-aed83c861f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:39.364270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1771850-e6f1-4942-a364-a648f008f691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:39.365627 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1771850-e6f1-4942-a364-a648f008f691 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:39.365922 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1771850-e6f1-4942-a364-a648f008f691 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:39.366205 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1771850-e6f1-4942-a364-a648f008f691 None admin] PATH_INFO: `/v3/projects/40691146f4bd45d4b515421ef1deba9e` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:39.367463 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1771850-e6f1-4942-a364-a648f008f691 None admin] RBAC: Authorizing `identity:get_project(project_id=40691146f4bd45d4b515421ef1deba9e)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:39.368914 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1771850-e6f1-4942-a364-a648f008f691 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:39.371011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 34/70] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:11:39 2022] GET /identity/v3/projects/40691146f4bd45d4b515421ef1deba9e => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:39.372155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1771850-e6f1-4942-a364-a648f008f691 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:39.396944 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 37/71] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:11:39.397785 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d571b-6949-430d-ae86-aed83c861f02 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:39.457661 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:39.477078 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1771850-e6f1-4942-a364-a648f008f691 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:39.485698 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:39.497962 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d571b-6949-430d-ae86-aed83c861f02 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:39.516629 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2929ff7-e8c0-46ca-b463-2cbadf4f5e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:39.517265 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2929ff7-e8c0-46ca-b463-2cbadf4f5e55 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:39.517619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2929ff7-e8c0-46ca-b463-2cbadf4f5e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:39.517881 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2929ff7-e8c0-46ca-b463-2cbadf4f5e55 None admin] PATH_INFO: `/v3/users/517e3692b01845c4bdf9eea0a2aadadc` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:39.519298 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2929ff7-e8c0-46ca-b463-2cbadf4f5e55 None admin] RBAC: Authorizing `identity:get_user(user_id=517e3692b01845c4bdf9eea0a2aadadc)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:39.521384 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2929ff7-e8c0-46ca-b463-2cbadf4f5e55 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:39.522978 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 35/72] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:11:39 2022] GET /identity/v3/users/517e3692b01845c4bdf9eea0a2aadadc => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:39.523817 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2929ff7-e8c0-46ca-b463-2cbadf4f5e55 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:39.539345 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb5de9-5744-4e5f-b37e-1bfe193114fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:39.539989 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb5de9-5744-4e5f-b37e-1bfe193114fe None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:39.540322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb5de9-5744-4e5f-b37e-1bfe193114fe None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:39.540535 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb5de9-5744-4e5f-b37e-1bfe193114fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:39.541636 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb5de9-5744-4e5f-b37e-1bfe193114fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:39.543221 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb5de9-5744-4e5f-b37e-1bfe193114fe None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:39.544798 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 38/73] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:11:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:39.547603 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb5de9-5744-4e5f-b37e-1bfe193114fe None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:39.630548 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2929ff7-e8c0-46ca-b463-2cbadf4f5e55 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:39.651684 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb5de9-5744-4e5f-b37e-1bfe193114fe None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:39.667902 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2206e-91f6-4a69-84cb-bc5f0c558cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:39.668523 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2206e-91f6-4a69-84cb-bc5f0c558cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:39.668809 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2206e-91f6-4a69-84cb-bc5f0c558cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:39.669088 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2206e-91f6-4a69-84cb-bc5f0c558cc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:39.669761 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2206e-91f6-4a69-84cb-bc5f0c558cc9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:39.670071 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2206e-91f6-4a69-84cb-bc5f0c558cc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:39.671476 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2206e-91f6-4a69-84cb-bc5f0c558cc9 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:39.680795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 36/74] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:11:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:39.682727 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2206e-91f6-4a69-84cb-bc5f0c558cc9 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:39.688320 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd506786-d483-4e50-9323-427dd5d1d1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:39.688979 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd506786-d483-4e50-9323-427dd5d1d1c8 None admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:39.689286 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd506786-d483-4e50-9323-427dd5d1d1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:39.689555 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd506786-d483-4e50-9323-427dd5d1d1c8 None admin] PATH_INFO: `/v3/projects/40691146f4bd45d4b515421ef1deba9e/users/947420b556064f1388b8623a98f5073e/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:39.692058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd506786-d483-4e50-9323-427dd5d1d1c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=40691146f4bd45d4b515421ef1deba9e, user_id=947420b556064f1388b8623a98f5073e, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:39.693528 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd506786-d483-4e50-9323-427dd5d1d1c8 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:39.698431 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:39.782799 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2206e-91f6-4a69-84cb-bc5f0c558cc9 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:39.788643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 39/75] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 02:11:39 2022] PUT /identity/v3/projects/40691146f4bd45d4b515421ef1deba9e/users/947420b556064f1388b8623a98f5073e/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:11:39.789622 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd506786-d483-4e50-9323-427dd5d1d1c8 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:39.813099 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:39.825124 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569180fd-4881-41b8-b47b-0deddfcecfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:39.825792 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569180fd-4881-41b8-b47b-0deddfcecfd7 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:39.826073 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569180fd-4881-41b8-b47b-0deddfcecfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:39.826350 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569180fd-4881-41b8-b47b-0deddfcecfd7 None admin] PATH_INFO: `/v3/projects/40691146f4bd45d4b515421ef1deba9e` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:39.827623 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569180fd-4881-41b8-b47b-0deddfcecfd7 None admin] RBAC: Authorizing `identity:get_project(project_id=40691146f4bd45d4b515421ef1deba9e)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:39.829147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569180fd-4881-41b8-b47b-0deddfcecfd7 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:39.836340 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 37/76] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:11:39 2022] GET /identity/v3/projects/40691146f4bd45d4b515421ef1deba9e => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:39.836340 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569180fd-4881-41b8-b47b-0deddfcecfd7 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:39.910868 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd506786-d483-4e50-9323-427dd5d1d1c8 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:39.927649 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:39.951103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569180fd-4881-41b8-b47b-0deddfcecfd7 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:39.951301 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf0a4a-264e-454b-b8eb-93e1e2479611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:39.951939 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf0a4a-264e-454b-b8eb-93e1e2479611 None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:39.952224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf0a4a-264e-454b-b8eb-93e1e2479611 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:39.952505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf0a4a-264e-454b-b8eb-93e1e2479611 None admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:39.953176 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf0a4a-264e-454b-b8eb-93e1e2479611 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:39.954899 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf0a4a-264e-454b-b8eb-93e1e2479611 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:39.988840 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee31ca3-0525-49b8-9002-6b3160464e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:39.989753 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee31ca3-0525-49b8-9002-6b3160464e71 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:39.990039 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee31ca3-0525-49b8-9002-6b3160464e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:39.990311 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee31ca3-0525-49b8-9002-6b3160464e71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:40.000427 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee31ca3-0525-49b8-9002-6b3160464e71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:11:40.006438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-6ee31ca3-0525-49b8-9002-6b3160464e71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:11:40.006438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:11:40.006438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:11:40.006438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:11:40.006438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:11:40.006438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:11:40.006438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:11:40.006438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:11:40.006438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:11:40.006438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:11:40.006438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:11:40.006438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:11:40.006438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:11:40.006438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:11:40.006438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:11:40.006438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:11:40.008096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:11:40.008096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:11:40.008096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:11:40.008096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:11:40.008096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:11:40.008096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:11:40.008096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:11:40.008096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:11:40.008096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:11:40.008096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:11:40.008096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:11:40.008096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:11:40.008096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:11:40.008096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:11:40.008096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:11:40.008096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:11:40.008865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:11:40.008865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:11:40.008865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:11:40.008865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:11:40.008865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:11:40.008865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:11:40.008865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:11:40.008865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:11:40.008865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:11:40.008865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:11:40.008865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:11:40.008865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:11:40.008865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 38/77] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:11:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:11:40.008865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee31ca3-0525-49b8-9002-6b3160464e71 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:40.029354 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 40/78] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 02:11:39 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:11:40.030339 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf0a4a-264e-454b-b8eb-93e1e2479611 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:40.136404 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee31ca3-0525-49b8-9002-6b3160464e71 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:40.143168 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:40.181921 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf0a4a-264e-454b-b8eb-93e1e2479611 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:40.185143 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6adf066-1513-4ef6-aa4a-5606f0ae8ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:40.186182 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6adf066-1513-4ef6-aa4a-5606f0ae8ece None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:40.186536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6adf066-1513-4ef6-aa4a-5606f0ae8ece None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:40.186919 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6adf066-1513-4ef6-aa4a-5606f0ae8ece None admin] PATH_INFO: `/v3/users/947420b556064f1388b8623a98f5073e` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:40.188315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6adf066-1513-4ef6-aa4a-5606f0ae8ece None admin] RBAC: Authorizing `identity:get_user(user_id=947420b556064f1388b8623a98f5073e)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:40.189924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6adf066-1513-4ef6-aa4a-5606f0ae8ece None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:40.192595 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 39/79] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:11:40 2022] GET /identity/v3/users/947420b556064f1388b8623a98f5073e => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:40.193472 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6adf066-1513-4ef6-aa4a-5606f0ae8ece None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:40.205694 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:40.233418 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b4ff3-5d3a-4c75-80be-b8fd5ead15e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:40.234099 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b4ff3-5d3a-4c75-80be-b8fd5ead15e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:40.234376 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b4ff3-5d3a-4c75-80be-b8fd5ead15e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:40.234646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b4ff3-5d3a-4c75-80be-b8fd5ead15e1 None admin] PATH_INFO: `/v3/projects/40691146f4bd45d4b515421ef1deba9e/users/517e3692b01845c4bdf9eea0a2aadadc/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:40.236765 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b4ff3-5d3a-4c75-80be-b8fd5ead15e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=40691146f4bd45d4b515421ef1deba9e, user_id=517e3692b01845c4bdf9eea0a2aadadc, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:40.240412 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b4ff3-5d3a-4c75-80be-b8fd5ead15e1 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:40.320142 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6adf066-1513-4ef6-aa4a-5606f0ae8ece None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:40.352367 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 41/80] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 02:11:40 2022] PUT /identity/v3/projects/40691146f4bd45d4b515421ef1deba9e/users/517e3692b01845c4bdf9eea0a2aadadc/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:11:40.353703 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b4ff3-5d3a-4c75-80be-b8fd5ead15e1 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:40.360779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fbba1-ea47-4629-b912-957bf3088f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:40.361408 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fbba1-ea47-4629-b912-957bf3088f89 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:40.361692 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fbba1-ea47-4629-b912-957bf3088f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:40.361970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fbba1-ea47-4629-b912-957bf3088f89 None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:40.362652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084fbba1-ea47-4629-b912-957bf3088f89 None admin] RBAC: Adding query filter params (name=member) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:40.362983 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084fbba1-ea47-4629-b912-957bf3088f89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:40.368150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084fbba1-ea47-4629-b912-957bf3088f89 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:40.377750 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 40/81] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 02:11:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:40.383466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fbba1-ea47-4629-b912-957bf3088f89 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:40.492442 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:40.507947 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b4ff3-5d3a-4c75-80be-b8fd5ead15e1 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:40.533173 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fbba1-ea47-4629-b912-957bf3088f89 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:40.549460 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:40.561549 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0ee79-9ae1-4bd6-841b-2f9e633d5286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:40.562452 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0ee79-9ae1-4bd6-841b-2f9e633d5286 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:40.563021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0ee79-9ae1-4bd6-841b-2f9e633d5286 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:40.563439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0ee79-9ae1-4bd6-841b-2f9e633d5286 None admin] PATH_INFO: `/v3/projects/40691146f4bd45d4b515421ef1deba9e` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:40.565427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0ee79-9ae1-4bd6-841b-2f9e633d5286 None admin] RBAC: Authorizing `identity:get_project(project_id=40691146f4bd45d4b515421ef1deba9e)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:40.567687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0ee79-9ae1-4bd6-841b-2f9e633d5286 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:40.570459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 42/82] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:11:40 2022] GET /identity/v3/projects/40691146f4bd45d4b515421ef1deba9e => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:40.577035 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0ee79-9ae1-4bd6-841b-2f9e633d5286 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:40.586308 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c93535-49d0-42b3-8b4d-d871bbe8aa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:40.587117 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c93535-49d0-42b3-8b4d-d871bbe8aa47 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:40.587506 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c93535-49d0-42b3-8b4d-d871bbe8aa47 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:40.587864 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c93535-49d0-42b3-8b4d-d871bbe8aa47 None admin] PATH_INFO: `/v3/users/947420b556064f1388b8623a98f5073e` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:40.589171 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c93535-49d0-42b3-8b4d-d871bbe8aa47 None admin] RBAC: Authorizing `identity:get_user(user_id=947420b556064f1388b8623a98f5073e)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:40.591358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c93535-49d0-42b3-8b4d-d871bbe8aa47 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:40.593947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 41/83] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:11:40 2022] GET /identity/v3/users/947420b556064f1388b8623a98f5073e => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:11:40.599923 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c93535-49d0-42b3-8b4d-d871bbe8aa47 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:40.697214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0ee79-9ae1-4bd6-841b-2f9e633d5286 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:40.735910 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444441d-bc7a-407a-8275-87fb1690cc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:40.736587 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444441d-bc7a-407a-8275-87fb1690cc71 None admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:40.737041 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444441d-bc7a-407a-8275-87fb1690cc71 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:40.737328 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444441d-bc7a-407a-8275-87fb1690cc71 None admin] PATH_INFO: `/v3/projects/40691146f4bd45d4b515421ef1deba9e/users/947420b556064f1388b8623a98f5073e/roles/619c0bef418849679ac636aa63923dc9` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:40.740845 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444441d-bc7a-407a-8275-87fb1690cc71 None admin] RBAC: Authorizing `identity:create_grant(project_id=40691146f4bd45d4b515421ef1deba9e, user_id=947420b556064f1388b8623a98f5073e, role_id=619c0bef418849679ac636aa63923dc9)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:40.742340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444441d-bc7a-407a-8275-87fb1690cc71 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:40.787252 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c93535-49d0-42b3-8b4d-d871bbe8aa47 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:40.814204 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 43/84] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 02:11:40 2022] PUT /identity/v3/projects/40691146f4bd45d4b515421ef1deba9e/users/947420b556064f1388b8623a98f5073e/roles/619c0bef418849679ac636aa63923dc9 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:11:40.826687 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8602f8c-83d5-43f2-8698-b815b50e88da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:40.827376 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8602f8c-83d5-43f2-8698-b815b50e88da None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:40.827663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8602f8c-83d5-43f2-8698-b815b50e88da None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:40.828031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8602f8c-83d5-43f2-8698-b815b50e88da None admin] PATH_INFO: `/v3/projects/8c912040a53d4205a0a40e015bb00e76` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:40.829312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8602f8c-83d5-43f2-8698-b815b50e88da None admin] RBAC: Authorizing `identity:get_project(project_id=8c912040a53d4205a0a40e015bb00e76)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:40.831022 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8602f8c-83d5-43f2-8698-b815b50e88da None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:40.833531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 42/85] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:11:40 2022] GET /identity/v3/projects/8c912040a53d4205a0a40e015bb00e76 => generated 312 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:11:40.839518 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444441d-bc7a-407a-8275-87fb1690cc71 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:40.913965 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:40.972348 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444441d-bc7a-407a-8275-87fb1690cc71 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:41.014708 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd91e2-e4c8-4dcd-9928-5af754cffe1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:41.015424 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd91e2-e4c8-4dcd-9928-5af754cffe1b None admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:41.015705 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd91e2-e4c8-4dcd-9928-5af754cffe1b None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:41.015981 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd91e2-e4c8-4dcd-9928-5af754cffe1b None admin] PATH_INFO: `/v3/projects/8c912040a53d4205a0a40e015bb00e76/users/947420b556064f1388b8623a98f5073e/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:41.018041 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd91e2-e4c8-4dcd-9928-5af754cffe1b None admin] RBAC: Authorizing `identity:create_grant(project_id=8c912040a53d4205a0a40e015bb00e76, user_id=947420b556064f1388b8623a98f5073e, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:41.019805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd91e2-e4c8-4dcd-9928-5af754cffe1b None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:41.093089 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 44/86] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 02:11:40 2022] PUT /identity/v3/projects/8c912040a53d4205a0a40e015bb00e76/users/947420b556064f1388b8623a98f5073e/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:11:42.802810 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2269c60-06e7-4fef-83fc-23969073fa83 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:42.803391 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2269c60-06e7-4fef-83fc-23969073fa83 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:42.803391 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2269c60-06e7-4fef-83fc-23969073fa83 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:42.804730 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 43/87] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:42.810308 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40dfcf-c0f7-4fb8-be20-89fd8193b514 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:42.811047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40dfcf-c0f7-4fb8-be20-89fd8193b514 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:42.811222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40dfcf-c0f7-4fb8-be20-89fd8193b514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:42.839129 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-4d40dfcf-c0f7-4fb8-be20-89fd8193b514 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:42.840373 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-4d40dfcf-c0f7-4fb8-be20-89fd8193b514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:42.929806 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 45/88] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:11:43.489930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2269c60-06e7-4fef-83fc-23969073fa83 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:43.501390 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:43.601055 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df0554-50d0-4093-a239-303b5162e7b5 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:43.601725 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df0554-50d0-4093-a239-303b5162e7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:43.602208 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df0554-50d0-4093-a239-303b5162e7b5 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:43.604319 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 46/89] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:43.609698 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060deef-dd29-4c94-a4b1-8dfb4e03bdb3 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:43.610263 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060deef-dd29-4c94-a4b1-8dfb4e03bdb3 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:43.610754 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060deef-dd29-4c94-a4b1-8dfb4e03bdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:43.640762 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-4060deef-dd29-4c94-a4b1-8dfb4e03bdb3 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:43.642274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-4060deef-dd29-4c94-a4b1-8dfb4e03bdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:43.645054 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2269c60-06e7-4fef-83fc-23969073fa83 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:43.693216 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a75922-f0a6-421a-b178-b62caee205c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:43.693854 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a75922-f0a6-421a-b178-b62caee205c7 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:43.694133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a75922-f0a6-421a-b178-b62caee205c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:43.694403 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a75922-f0a6-421a-b178-b62caee205c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:43.718482 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a75922-f0a6-421a-b178-b62caee205c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:11:43.721944 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:43.725895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-45a75922-f0a6-421a-b178-b62caee205c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:11:43.725895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:11:43.725895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:11:43.725895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:11:43.725895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:11:43.725895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:11:43.725895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:11:43.725895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:11:43.725895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:11:43.725895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:11:43.725895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:11:43.725895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:11:43.725895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:11:43.725895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:11:43.725895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:11:43.725895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:11:43.726737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:11:43.726737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:11:43.726737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:11:43.726737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:11:43.726737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:11:43.726737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:11:43.726737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:11:43.726737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:11:43.726737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:11:43.726737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:11:43.726737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:11:43.726737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:11:43.726737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:11:43.726737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:11:43.726737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:11:43.726737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:11:43.727532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:11:43.727532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:11:43.727532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:11:43.727532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:11:43.727532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:11:43.727532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:11:43.727532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:11:43.727532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:11:43.727532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:11:43.727532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:11:43.727532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:11:43.727532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:11:43.728124 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 44/90] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:11:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:11:43.734003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a953f7-e813-4df1-8e95-fbe43097ced6 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:43.734003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a953f7-e813-4df1-8e95-fbe43097ced6 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:43.734003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a953f7-e813-4df1-8e95-fbe43097ced6 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:43.734003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 45/91] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:43.734003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af39b46-e65d-4f53-9b36-bf84ce084b61 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:43.734003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af39b46-e65d-4f53-9b36-bf84ce084b61 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:43.737782 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af39b46-e65d-4f53-9b36-bf84ce084b61 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:43.739380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 46/92] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:43.739882 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af39b46-e65d-4f53-9b36-bf84ce084b61 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:43.758948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 47/93] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 02:11:43.759417 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b32aa-7778-4495-b4dd-51076072f562 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:43.759701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b32aa-7778-4495-b4dd-51076072f562 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:43.759972 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b32aa-7778-4495-b4dd-51076072f562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:43.785937 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-908b32aa-7778-4495-b4dd-51076072f562 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:43.787714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-908b32aa-7778-4495-b4dd-51076072f562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:43.822227 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:43.862417 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af39b46-e65d-4f53-9b36-bf84ce084b61 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:43.880008 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 48/94] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:11:43.882557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b918b28-c800-493f-bc02-42171a1fde3f None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:43.883075 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b918b28-c800-493f-bc02-42171a1fde3f None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:43.883500 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b918b28-c800-493f-bc02-42171a1fde3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:43.900227 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56712ff7-7246-4726-836b-bb4150067fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:43.901118 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56712ff7-7246-4726-836b-bb4150067fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:43.901523 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56712ff7-7246-4726-836b-bb4150067fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:43.901892 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56712ff7-7246-4726-836b-bb4150067fc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:43.902699 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56712ff7-7246-4726-836b-bb4150067fc3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:43.903130 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56712ff7-7246-4726-836b-bb4150067fc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:43.904662 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56712ff7-7246-4726-836b-bb4150067fc3 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:43.907710 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-6b918b28-c800-493f-bc02-42171a1fde3f None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:43.909066 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-6b918b28-c800-493f-bc02-42171a1fde3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:43.915053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 47/95] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 02:11:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:43.916394 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0b345-a944-422f-8493-a54a18cac349 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:43.916796 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0b345-a944-422f-8493-a54a18cac349 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:43.917212 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0b345-a944-422f-8493-a54a18cac349 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:43.918767 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 48/96] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:43.923566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0b345-a944-422f-8493-a54a18cac349 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:43.998933 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 49/97] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:11:44.000575 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb73dd-5fc2-47c4-9710-8b2ff490b379 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:44.000991 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb73dd-5fc2-47c4-9710-8b2ff490b379 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:44.001404 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb73dd-5fc2-47c4-9710-8b2ff490b379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:44.022901 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-b5bb73dd-5fc2-47c4-9710-8b2ff490b379 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:44.024300 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-b5bb73dd-5fc2-47c4-9710-8b2ff490b379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:44.064674 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:44.087112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0b345-a944-422f-8493-a54a18cac349 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:44.102985 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 50/98] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:11:44.137623 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:44.149870 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcdfd0-4e74-451e-9f00-7b7ff84e5f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:44.150540 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcdfd0-4e74-451e-9f00-7b7ff84e5f95 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:44.150838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcdfd0-4e74-451e-9f00-7b7ff84e5f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:44.151112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcdfd0-4e74-451e-9f00-7b7ff84e5f95 None admin] PATH_INFO: `/v3/users/947420b556064f1388b8623a98f5073e` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:44.152283 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bcdfd0-4e74-451e-9f00-7b7ff84e5f95 None admin] RBAC: Authorizing `identity:get_user(user_id=947420b556064f1388b8623a98f5073e)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:44.153898 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bcdfd0-4e74-451e-9f00-7b7ff84e5f95 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:44.155495 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 49/99] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:11:43 2022] GET /identity/v3/users/947420b556064f1388b8623a98f5073e => generated 275 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:44.161930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb73dd-5fc2-47c4-9710-8b2ff490b379 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:44.204076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcdfd0-4e74-451e-9f00-7b7ff84e5f95 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:44.317181 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb73dd-5fc2-47c4-9710-8b2ff490b379 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:44.368779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcdfd0-4e74-451e-9f00-7b7ff84e5f95 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:44.379803 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110091b-25d7-49e2-8e2a-3ac92f76a3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:44.380433 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110091b-25d7-49e2-8e2a-3ac92f76a3b7 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:44.380716 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110091b-25d7-49e2-8e2a-3ac92f76a3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:44.380992 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110091b-25d7-49e2-8e2a-3ac92f76a3b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:44.408286 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b86f5e-6d7e-4d09-87d6-60da834fc779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:44.408924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b86f5e-6d7e-4d09-87d6-60da834fc779 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:44.409199 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b86f5e-6d7e-4d09-87d6-60da834fc779 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:44.409691 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b86f5e-6d7e-4d09-87d6-60da834fc779 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:44.429870 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b86f5e-6d7e-4d09-87d6-60da834fc779 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:11:44.436673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-f8b86f5e-6d7e-4d09-87d6-60da834fc779 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 02:11:44.436673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:11:44.436673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:11:44.436673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:11:44.436673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:11:44.436673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:11:44.436673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:11:44.436673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:11:44.436673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:11:44.436673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:11:44.436673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:11:44.436673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:11:44.436673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:11:44.436673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:11:44.436673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:11:44.436673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:11:44.437548 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:11:44.437548 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:11:44.437548 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:11:44.437548 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:11:44.437548 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:11:44.437548 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:11:44.437548 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:11:44.437548 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:11:44.437548 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:11:44.437548 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:11:44.437548 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:11:44.437548 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:11:44.437548 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:11:44.437548 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:11:44.437548 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:11:44.437548 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:11:44.438326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:11:44.438326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:11:44.438326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:11:44.438326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:11:44.438326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:11:44.438326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:11:44.438326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:11:44.438326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:11:44.438326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:11:44.438326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:11:44.438326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 02:11:44.438326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:11:44.438326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 50/100] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:11:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:11:44.438976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b86f5e-6d7e-4d09-87d6-60da834fc779 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:44.449054 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:44.480128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110091b-25d7-49e2-8e2a-3ac92f76a3b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:44.481589 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110091b-25d7-49e2-8e2a-3ac92f76a3b7 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:44.512246 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:44.556196 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b86f5e-6d7e-4d09-87d6-60da834fc779 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:44.580862 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 51/101] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:11:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:44.584150 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1378794-5ebd-4e31-b105-9b548d2306d1 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:44.584437 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1378794-5ebd-4e31-b105-9b548d2306d1 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:44.584709 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1378794-5ebd-4e31-b105-9b548d2306d1 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:44.585979 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 52/102] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:44.586664 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1378794-5ebd-4e31-b105-9b548d2306d1 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:44.590963 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29229d81-7f58-4ee5-a2be-83439c258420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:44.591605 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29229d81-7f58-4ee5-a2be-83439c258420 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:44.591890 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29229d81-7f58-4ee5-a2be-83439c258420 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:44.592169 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29229d81-7f58-4ee5-a2be-83439c258420 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:44.603156 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29229d81-7f58-4ee5-a2be-83439c258420 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:11:44.609396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-29229d81-7f58-4ee5-a2be-83439c258420 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:11:44.609396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:11:44.609396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:11:44.609396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:11:44.609396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:11:44.609396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:11:44.609396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:11:44.609396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:11:44.609396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:11:44.609396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:11:44.609396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:11:44.609396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:11:44.609396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:11:44.609396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:11:44.609396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:11:44.609396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:11:44.610232 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:11:44.610232 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:11:44.610232 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:11:44.610232 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:11:44.610232 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:11:44.610232 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:11:44.610232 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:11:44.610232 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:11:44.610232 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:11:44.610232 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:11:44.610232 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:11:44.610232 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:11:44.610232 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:11:44.610232 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:11:44.610232 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:11:44.610232 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:11:44.614639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:11:44.614639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:11:44.614639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:11:44.614639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:11:44.614639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:11:44.614639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:11:44.614639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:11:44.614639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:11:44.614639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:11:44.614639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:11:44.614639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:11:44.614639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:11:44.614639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 51/103] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 02:11:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:11:44.614639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29229d81-7f58-4ee5-a2be-83439c258420 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:44.660639 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:44.692404 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1378794-5ebd-4e31-b105-9b548d2306d1 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:44.711987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29229d81-7f58-4ee5-a2be-83439c258420 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:44.726354 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0202b-81ba-4e9f-aa51-73980e986a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:44.727028 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0202b-81ba-4e9f-aa51-73980e986a16 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:44.727312 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0202b-81ba-4e9f-aa51-73980e986a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:44.727587 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0202b-81ba-4e9f-aa51-73980e986a16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:44.727991 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:44.738363 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0202b-81ba-4e9f-aa51-73980e986a16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:11:44.743678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-d4d0202b-81ba-4e9f-aa51-73980e986a16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 02:11:44.743678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:11:44.743678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:11:44.743678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:11:44.743678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:11:44.743678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:11:44.743678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:11:44.743678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:11:44.743678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:11:44.743678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:11:44.743678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:11:44.743678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:11:44.743678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:11:44.743678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:11:44.743678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:11:44.743678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:11:44.744526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:11:44.744526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:11:44.744526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:11:44.744526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:11:44.744526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:11:44.744526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:11:44.744526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:11:44.744526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:11:44.744526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:11:44.744526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:11:44.744526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:11:44.744526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:11:44.744526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:11:44.744526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:11:44.744526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:11:44.744526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:11:44.745516 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:11:44.745516 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:11:44.745516 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:11:44.745516 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:11:44.745516 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:11:44.745516 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:11:44.745516 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:11:44.745516 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:11:44.745516 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:11:44.745516 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:11:44.745516 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 02:11:44.745516 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:11:44.745516 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 53/104] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 02:11:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:11:44.746468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0202b-81ba-4e9f-aa51-73980e986a16 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:44.746546 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de951c3c-7600-4a2e-a8a8-91f50ef3ae74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:44.746779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de951c3c-7600-4a2e-a8a8-91f50ef3ae74 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:44.747015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de951c3c-7600-4a2e-a8a8-91f50ef3ae74 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:44.747292 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de951c3c-7600-4a2e-a8a8-91f50ef3ae74 None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:44.747990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de951c3c-7600-4a2e-a8a8-91f50ef3ae74 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:44.748295 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de951c3c-7600-4a2e-a8a8-91f50ef3ae74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:44.749769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de951c3c-7600-4a2e-a8a8-91f50ef3ae74 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:44.759143 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 52/105] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 02:11:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:44.759981 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de951c3c-7600-4a2e-a8a8-91f50ef3ae74 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:44.846865 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0202b-81ba-4e9f-aa51-73980e986a16 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:44.859939 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de951c3c-7600-4a2e-a8a8-91f50ef3ae74 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:44.874683 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:44.881428 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e18e54-7413-47aa-b450-1b15b2eaafd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:44.882054 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e18e54-7413-47aa-b450-1b15b2eaafd4 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:44.882333 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e18e54-7413-47aa-b450-1b15b2eaafd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:44.882612 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e18e54-7413-47aa-b450-1b15b2eaafd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:44.883744 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e18e54-7413-47aa-b450-1b15b2eaafd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:44.885263 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e18e54-7413-47aa-b450-1b15b2eaafd4 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:44.886839 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 54/106] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:11:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:44.887941 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239ab16-7428-452f-9d88-7c519d07dc75 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:44.890438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239ab16-7428-452f-9d88-7c519d07dc75 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:44.890438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239ab16-7428-452f-9d88-7c519d07dc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:44.895676 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a0547-6881-40db-9d68-8558ba72e2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:44.896310 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a0547-6881-40db-9d68-8558ba72e2ed None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:44.896594 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a0547-6881-40db-9d68-8558ba72e2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:44.896869 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a0547-6881-40db-9d68-8558ba72e2ed None admin] PATH_INFO: `/v3/projects/40691146f4bd45d4b515421ef1deba9e` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:44.898009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a0547-6881-40db-9d68-8558ba72e2ed None admin] RBAC: Authorizing `identity:get_project(project_id=40691146f4bd45d4b515421ef1deba9e)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:44.899472 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a0547-6881-40db-9d68-8558ba72e2ed None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:44.901098 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 53/107] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:11:44 2022] GET /identity/v3/projects/40691146f4bd45d4b515421ef1deba9e => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:44.907237 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a0547-6881-40db-9d68-8558ba72e2ed None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:44.907787 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-9239ab16-7428-452f-9d88-7c519d07dc75 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:44.910408 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-9239ab16-7428-452f-9d88-7c519d07dc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:44.955169 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:44.980322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 55/108] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:11:44.983716 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239ab16-7428-452f-9d88-7c519d07dc75 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:45.017074 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a0547-6881-40db-9d68-8558ba72e2ed None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:45.054342 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d77f0-f408-40b2-bacc-8a9835a6a14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:45.054982 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d77f0-f408-40b2-bacc-8a9835a6a14e None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:45.055255 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d77f0-f408-40b2-bacc-8a9835a6a14e None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:45.055528 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d77f0-f408-40b2-bacc-8a9835a6a14e None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:45.056182 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d77f0-f408-40b2-bacc-8a9835a6a14e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:45.056482 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d77f0-f408-40b2-bacc-8a9835a6a14e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:45.057855 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d77f0-f408-40b2-bacc-8a9835a6a14e None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:45.066671 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 54/109] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:11:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:45.071030 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d77f0-f408-40b2-bacc-8a9835a6a14e None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:45.091389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239ab16-7428-452f-9d88-7c519d07dc75 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:45.119014 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:45.127128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc47f20-1c9a-48da-9edd-de0846329b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:45.127813 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc47f20-1c9a-48da-9edd-de0846329b42 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:45.128002 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc47f20-1c9a-48da-9edd-de0846329b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:45.128270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc47f20-1c9a-48da-9edd-de0846329b42 None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:45.128958 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc47f20-1c9a-48da-9edd-de0846329b42 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:45.129260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc47f20-1c9a-48da-9edd-de0846329b42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:45.130920 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc47f20-1c9a-48da-9edd-de0846329b42 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:45.138991 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 56/110] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:11:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:45.139931 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc47f20-1c9a-48da-9edd-de0846329b42 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:45.187266 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d77f0-f408-40b2-bacc-8a9835a6a14e None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:45.197266 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:45.226034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f391f-cb12-459a-b0bb-0645d1fd2994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:45.226664 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f391f-cb12-459a-b0bb-0645d1fd2994 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:45.226976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f391f-cb12-459a-b0bb-0645d1fd2994 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:45.227252 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f391f-cb12-459a-b0bb-0645d1fd2994 None admin] PATH_INFO: `/v3/users/9ad2d7c743d4402eab69921c2e383e71` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:45.245520 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f391f-cb12-459a-b0bb-0645d1fd2994 None admin] RBAC: Authorizing `identity:get_user(user_id=9ad2d7c743d4402eab69921c2e383e71)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:45.247019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f391f-cb12-459a-b0bb-0645d1fd2994 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:45.252966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 55/111] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:11:45 2022] GET /identity/v3/users/9ad2d7c743d4402eab69921c2e383e71 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:45.252966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f391f-cb12-459a-b0bb-0645d1fd2994 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:45.255918 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc47f20-1c9a-48da-9edd-de0846329b42 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:45.289460 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198288b0-5411-4d31-b38c-0dc5699ec736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:45.290909 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198288b0-5411-4d31-b38c-0dc5699ec736 None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:45.291181 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198288b0-5411-4d31-b38c-0dc5699ec736 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:45.291457 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198288b0-5411-4d31-b38c-0dc5699ec736 None admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:45.292109 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198288b0-5411-4d31-b38c-0dc5699ec736 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:45.293606 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198288b0-5411-4d31-b38c-0dc5699ec736 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:45.356039 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f391f-cb12-459a-b0bb-0645d1fd2994 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:45.390404 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52039a-a829-43d3-9748-44b029575998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:45.390990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52039a-a829-43d3-9748-44b029575998 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:45.391272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52039a-a829-43d3-9748-44b029575998 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:45.391541 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52039a-a829-43d3-9748-44b029575998 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:45.392267 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52039a-a829-43d3-9748-44b029575998 None admin] RBAC: Adding query filter params (role.id=bacc420f29704ec89e015525d8143d62, scope.project.id=40691146f4bd45d4b515421ef1deba9e, user.id=947420b556064f1388b8623a98f5073e) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:45.392565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52039a-a829-43d3-9748-44b029575998 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:45.393995 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52039a-a829-43d3-9748-44b029575998 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:45.402780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 56/112] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 02:11:45 2022] GET /identity/v3/role_assignments?user.id=947420b556064f1388b8623a98f5073e&scope.project.id=40691146f4bd45d4b515421ef1deba9e&role.id=bacc420f29704ec89e015525d8143d62 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:45.430844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 57/113] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 02:11:45 2022] POST /identity/v3/projects => generated 302 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:11:45.430844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198288b0-5411-4d31-b38c-0dc5699ec736 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:45.431171 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52039a-a829-43d3-9748-44b029575998 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:45.459663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:45.500846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:45.554658 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52039a-a829-43d3-9748-44b029575998 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:45.586599 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198288b0-5411-4d31-b38c-0dc5699ec736 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:45.600738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae270c-2aff-49e6-8027-e6d5a1281a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:45.601518 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae270c-2aff-49e6-8027-e6d5a1281a7c None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:45.601870 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae270c-2aff-49e6-8027-e6d5a1281a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:45.602558 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae270c-2aff-49e6-8027-e6d5a1281a7c None admin] PATH_INFO: `/v3/users/517e3692b01845c4bdf9eea0a2aadadc` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:45.603583 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae270c-2aff-49e6-8027-e6d5a1281a7c None admin] RBAC: Authorizing `identity:get_user(user_id=517e3692b01845c4bdf9eea0a2aadadc)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:45.605835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae270c-2aff-49e6-8027-e6d5a1281a7c None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:45.612304 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 57/114] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:11:45 2022] GET /identity/v3/users/517e3692b01845c4bdf9eea0a2aadadc => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:45.614039 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae270c-2aff-49e6-8027-e6d5a1281a7c None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:45.636186 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1dca43-d05e-4861-8267-95c150120dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:45.637217 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dca43-d05e-4861-8267-95c150120dbf None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:45.637507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dca43-d05e-4861-8267-95c150120dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:45.638449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dca43-d05e-4861-8267-95c150120dbf None admin] PATH_INFO: `/v3/users/947420b556064f1388b8623a98f5073e` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:45.639286 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1dca43-d05e-4861-8267-95c150120dbf None admin] RBAC: Authorizing `identity:get_user(user_id=947420b556064f1388b8623a98f5073e)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:45.640811 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1dca43-d05e-4861-8267-95c150120dbf None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:45.643225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 58/115] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:11:45 2022] GET /identity/v3/users/947420b556064f1388b8623a98f5073e => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:45.644418 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1dca43-d05e-4861-8267-95c150120dbf None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:45.734964 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:45.739780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae270c-2aff-49e6-8027-e6d5a1281a7c None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:45.758761 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1dca43-d05e-4861-8267-95c150120dbf None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:45.770350 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:45.780880 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdabc70-885d-4855-aeb2-0ee28c912c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:45.781729 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdabc70-885d-4855-aeb2-0ee28c912c4e None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:45.782013 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdabc70-885d-4855-aeb2-0ee28c912c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:45.782289 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdabc70-885d-4855-aeb2-0ee28c912c4e None admin] PATH_INFO: `/v3/projects/40691146f4bd45d4b515421ef1deba9e` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:45.783451 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdabc70-885d-4855-aeb2-0ee28c912c4e None admin] RBAC: Authorizing `identity:get_project(project_id=40691146f4bd45d4b515421ef1deba9e)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:45.784886 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdabc70-885d-4855-aeb2-0ee28c912c4e None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:45.787656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 58/116] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:11:45 2022] GET /identity/v3/projects/40691146f4bd45d4b515421ef1deba9e => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:45.788516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdabc70-885d-4855-aeb2-0ee28c912c4e None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:45.802789 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06717adb-e9a8-4dfc-89d1-4e61ca6e7978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:45.803461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06717adb-e9a8-4dfc-89d1-4e61ca6e7978 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:45.803743 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06717adb-e9a8-4dfc-89d1-4e61ca6e7978 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:45.804017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06717adb-e9a8-4dfc-89d1-4e61ca6e7978 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:45.815259 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06717adb-e9a8-4dfc-89d1-4e61ca6e7978 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:11:45.821207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-06717adb-e9a8-4dfc-89d1-4e61ca6e7978 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:11:45.821207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:11:45.821207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:11:45.821207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:11:45.821207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:11:45.821207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:11:45.821207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:11:45.821207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:11:45.821207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:11:45.821207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:11:45.821207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:11:45.821207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:11:45.821207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:11:45.821207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:11:45.821207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:11:45.821207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:11:45.822125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:11:45.822125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:11:45.822125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:11:45.822125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:11:45.822125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:11:45.822125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:11:45.822125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:11:45.822125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:11:45.822125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:11:45.822125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:11:45.822125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:11:45.822125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:11:45.822125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:11:45.822125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:11:45.822125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:11:45.822125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:11:45.822956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:11:45.822956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:11:45.822956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:11:45.822956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:11:45.822956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:11:45.822956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:11:45.822956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:11:45.822956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:11:45.822956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:11:45.822956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:11:45.822956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:11:45.822956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:11:45.822956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 59/117] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:11:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:11:45.823627 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06717adb-e9a8-4dfc-89d1-4e61ca6e7978 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:45.907301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdabc70-885d-4855-aeb2-0ee28c912c4e None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:45.931902 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06717adb-e9a8-4dfc-89d1-4e61ca6e7978 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:45.944378 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8524c-cc7a-4164-a55a-72fccee8cf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:45.944995 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8524c-cc7a-4164-a55a-72fccee8cf79 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:45.945285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8524c-cc7a-4164-a55a-72fccee8cf79 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:45.945563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8524c-cc7a-4164-a55a-72fccee8cf79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:45.969643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d28e9-ecb4-42fa-b9bb-9b2a5c5f06e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:45.970260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d28e9-ecb4-42fa-b9bb-9b2a5c5f06e6 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:45.970542 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d28e9-ecb4-42fa-b9bb-9b2a5c5f06e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:45.970849 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d28e9-ecb4-42fa-b9bb-9b2a5c5f06e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:45.982276 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:46.016040 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:46.020500 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8524c-cc7a-4164-a55a-72fccee8cf79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:46.021998 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8524c-cc7a-4164-a55a-72fccee8cf79 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:46.044158 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d28e9-ecb4-42fa-b9bb-9b2a5c5f06e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:46.045678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d28e9-ecb4-42fa-b9bb-9b2a5c5f06e6 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:46.131706 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 59/118] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:11:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:46.132552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8524c-cc7a-4164-a55a-72fccee8cf79 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:46.153418 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 60/119] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:11:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:46.154671 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d28e9-ecb4-42fa-b9bb-9b2a5c5f06e6 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:46.218428 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:46.230288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:46.254962 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8524c-cc7a-4164-a55a-72fccee8cf79 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:46.262278 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d28e9-ecb4-42fa-b9bb-9b2a5c5f06e6 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:46.293115 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667ff30-86e8-4446-94fc-5da2438bef11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:46.293836 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667ff30-86e8-4446-94fc-5da2438bef11 None admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:46.294194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667ff30-86e8-4446-94fc-5da2438bef11 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:46.294571 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667ff30-86e8-4446-94fc-5da2438bef11 None admin] PATH_INFO: `/v3/projects/40691146f4bd45d4b515421ef1deba9e/users/9ad2d7c743d4402eab69921c2e383e71/roles/a2f123a9ec8440cba593773aabc0f2fc` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:46.296645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667ff30-86e8-4446-94fc-5da2438bef11 None admin] RBAC: Authorizing `identity:create_grant(project_id=40691146f4bd45d4b515421ef1deba9e, user_id=9ad2d7c743d4402eab69921c2e383e71, role_id=a2f123a9ec8440cba593773aabc0f2fc)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:46.297488 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87aed4-c565-4a39-84f6-934a2e4a7292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:46.298094 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87aed4-c565-4a39-84f6-934a2e4a7292 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:46.298194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667ff30-86e8-4446-94fc-5da2438bef11 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:46.298373 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87aed4-c565-4a39-84f6-934a2e4a7292 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:46.298647 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87aed4-c565-4a39-84f6-934a2e4a7292 None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:46.299367 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87aed4-c565-4a39-84f6-934a2e4a7292 None admin] RBAC: Adding query filter params (name=member) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:46.299671 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87aed4-c565-4a39-84f6-934a2e4a7292 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:46.301631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87aed4-c565-4a39-84f6-934a2e4a7292 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:46.309838 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 61/120] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 02:11:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:46.312297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87aed4-c565-4a39-84f6-934a2e4a7292 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:46.367418 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 60/121] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 02:11:46 2022] PUT /identity/v3/projects/40691146f4bd45d4b515421ef1deba9e/users/9ad2d7c743d4402eab69921c2e383e71/roles/a2f123a9ec8440cba593773aabc0f2fc => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:11:46.369334 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667ff30-86e8-4446-94fc-5da2438bef11 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:46.441927 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87aed4-c565-4a39-84f6-934a2e4a7292 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:46.481871 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:46.488216 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b33ea1-b1fa-4d6a-aee1-f5ab39713892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:46.489274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b33ea1-b1fa-4d6a-aee1-f5ab39713892 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:46.489741 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b33ea1-b1fa-4d6a-aee1-f5ab39713892 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:46.490196 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b33ea1-b1fa-4d6a-aee1-f5ab39713892 None admin] PATH_INFO: `/v3/projects/40691146f4bd45d4b515421ef1deba9e` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:46.491875 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b33ea1-b1fa-4d6a-aee1-f5ab39713892 None admin] RBAC: Authorizing `identity:get_project(project_id=40691146f4bd45d4b515421ef1deba9e)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:46.504643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b33ea1-b1fa-4d6a-aee1-f5ab39713892 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:46.504643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 62/122] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:11:46 2022] GET /identity/v3/projects/40691146f4bd45d4b515421ef1deba9e => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:46.504643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b33ea1-b1fa-4d6a-aee1-f5ab39713892 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:46.511383 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667ff30-86e8-4446-94fc-5da2438bef11 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:46.541404 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:46.552854 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71478c-c038-470a-b84a-d4b06811e852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:46.554311 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71478c-c038-470a-b84a-d4b06811e852 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:46.554311 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71478c-c038-470a-b84a-d4b06811e852 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:46.554311 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71478c-c038-470a-b84a-d4b06811e852 None admin] PATH_INFO: `/v3/projects/40691146f4bd45d4b515421ef1deba9e` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:46.556380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71478c-c038-470a-b84a-d4b06811e852 None admin] RBAC: Authorizing `identity:get_project(project_id=40691146f4bd45d4b515421ef1deba9e)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:46.557859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71478c-c038-470a-b84a-d4b06811e852 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:46.560029 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 61/123] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:11:46 2022] GET /identity/v3/projects/40691146f4bd45d4b515421ef1deba9e => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:46.560928 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71478c-c038-470a-b84a-d4b06811e852 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:46.614458 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b33ea1-b1fa-4d6a-aee1-f5ab39713892 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:46.659146 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9689f3-370a-43a6-8fc9-a21f6181b5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:46.660097 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9689f3-370a-43a6-8fc9-a21f6181b5d1 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:46.660455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9689f3-370a-43a6-8fc9-a21f6181b5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:46.660901 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9689f3-370a-43a6-8fc9-a21f6181b5d1 None admin] PATH_INFO: `/v3/users/947420b556064f1388b8623a98f5073e` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:46.662416 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9689f3-370a-43a6-8fc9-a21f6181b5d1 None admin] RBAC: Authorizing `identity:get_user(user_id=947420b556064f1388b8623a98f5073e)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:46.663991 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9689f3-370a-43a6-8fc9-a21f6181b5d1 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:46.670497 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 63/124] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:11:46 2022] GET /identity/v3/users/947420b556064f1388b8623a98f5073e => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:46.670497 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9689f3-370a-43a6-8fc9-a21f6181b5d1 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:46.682646 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71478c-c038-470a-b84a-d4b06811e852 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:46.718423 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30a6bd-5ac4-4f97-ae2b-6310cf34eaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:46.719434 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30a6bd-5ac4-4f97-ae2b-6310cf34eaa6 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:46.719937 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30a6bd-5ac4-4f97-ae2b-6310cf34eaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:46.720401 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30a6bd-5ac4-4f97-ae2b-6310cf34eaa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:46.721392 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30a6bd-5ac4-4f97-ae2b-6310cf34eaa6 None admin] RBAC: Adding query filter params (role.id=e2e7c80d19c141bc9f9bfc13c2ec2a12, scope.project.id=40691146f4bd45d4b515421ef1deba9e, user.id=517e3692b01845c4bdf9eea0a2aadadc) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:46.721922 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30a6bd-5ac4-4f97-ae2b-6310cf34eaa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:46.723997 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30a6bd-5ac4-4f97-ae2b-6310cf34eaa6 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:46.730405 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 62/125] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 02:11:46 2022] GET /identity/v3/role_assignments?user.id=517e3692b01845c4bdf9eea0a2aadadc&scope.project.id=40691146f4bd45d4b515421ef1deba9e&role.id=e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:46.731756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30a6bd-5ac4-4f97-ae2b-6310cf34eaa6 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:46.788410 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:46.812797 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:46.860185 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30a6bd-5ac4-4f97-ae2b-6310cf34eaa6 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:46.889517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9689f3-370a-43a6-8fc9-a21f6181b5d1 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:46.903229 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271daff-7150-4a22-a60d-86a40e626d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:46.904046 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271daff-7150-4a22-a60d-86a40e626d98 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:46.904395 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271daff-7150-4a22-a60d-86a40e626d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:46.904739 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271daff-7150-4a22-a60d-86a40e626d98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:46.956152 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041295ed-84c5-4511-a95c-fe6fd5a37d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:46.956979 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041295ed-84c5-4511-a95c-fe6fd5a37d15 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:46.957341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041295ed-84c5-4511-a95c-fe6fd5a37d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:46.957627 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041295ed-84c5-4511-a95c-fe6fd5a37d15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:46.958372 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041295ed-84c5-4511-a95c-fe6fd5a37d15 None admin] RBAC: Adding query filter params (role.id=619c0bef418849679ac636aa63923dc9, scope.project.id=40691146f4bd45d4b515421ef1deba9e, user.id=947420b556064f1388b8623a98f5073e) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:46.958686 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041295ed-84c5-4511-a95c-fe6fd5a37d15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:46.960187 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041295ed-84c5-4511-a95c-fe6fd5a37d15 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:46.966722 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 64/126] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 02:11:46 2022] GET /identity/v3/role_assignments?user.id=947420b556064f1388b8623a98f5073e&scope.project.id=40691146f4bd45d4b515421ef1deba9e&role.id=619c0bef418849679ac636aa63923dc9 => generated 608 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:47.009573 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271daff-7150-4a22-a60d-86a40e626d98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:47.011138 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271daff-7150-4a22-a60d-86a40e626d98 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:47.077875 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:47.138613 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 63/127] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:11:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:47.144568 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041295ed-84c5-4511-a95c-fe6fd5a37d15 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:47.269309 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041295ed-84c5-4511-a95c-fe6fd5a37d15 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:47.301908 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:47.307308 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19800a0d-f5cc-4980-b4e6-7403632e998f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:47.308207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19800a0d-f5cc-4980-b4e6-7403632e998f None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:47.308701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19800a0d-f5cc-4980-b4e6-7403632e998f None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:47.309176 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19800a0d-f5cc-4980-b4e6-7403632e998f None admin] PATH_INFO: `/v3/projects/8c912040a53d4205a0a40e015bb00e76` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:47.310915 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19800a0d-f5cc-4980-b4e6-7403632e998f None admin] RBAC: Authorizing `identity:get_project(project_id=8c912040a53d4205a0a40e015bb00e76)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:47.314974 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19800a0d-f5cc-4980-b4e6-7403632e998f None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:47.314974 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 65/128] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:11:47 2022] GET /identity/v3/projects/8c912040a53d4205a0a40e015bb00e76 => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:47.320370 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271daff-7150-4a22-a60d-86a40e626d98 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:47.427228 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271daff-7150-4a22-a60d-86a40e626d98 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:47.461838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f5186-f6c6-4082-a5a3-62fe90753d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:47.462448 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f5186-f6c6-4082-a5a3-62fe90753d2b None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:47.462733 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f5186-f6c6-4082-a5a3-62fe90753d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:47.463049 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f5186-f6c6-4082-a5a3-62fe90753d2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:47.463788 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f5186-f6c6-4082-a5a3-62fe90753d2b None admin] RBAC: Adding query filter params (role.id=bacc420f29704ec89e015525d8143d62, scope.project.id=8c912040a53d4205a0a40e015bb00e76, user.id=947420b556064f1388b8623a98f5073e) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:47.464098 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f5186-f6c6-4082-a5a3-62fe90753d2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:47.465692 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f5186-f6c6-4082-a5a3-62fe90753d2b None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:47.471595 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 64/129] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 02:11:47 2022] GET /identity/v3/role_assignments?user.id=947420b556064f1388b8623a98f5073e&scope.project.id=8c912040a53d4205a0a40e015bb00e76&role.id=bacc420f29704ec89e015525d8143d62 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:11:47.732624 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ade8a-9fef-4d59-9166-0ec514e30d77 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:47.732875 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ade8a-9fef-4d59-9166-0ec514e30d77 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:47.733106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ade8a-9fef-4d59-9166-0ec514e30d77 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:47.734465 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 66/130] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:47.740332 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc4d75-85c0-4efc-8b4f-eee0329cc3ff None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:47.740626 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc4d75-85c0-4efc-8b4f-eee0329cc3ff None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:47.740905 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc4d75-85c0-4efc-8b4f-eee0329cc3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:47.759581 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-cacc4d75-85c0-4efc-8b4f-eee0329cc3ff None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:47.761105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-cacc4d75-85c0-4efc-8b4f-eee0329cc3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:47.777361 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:47.828464 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 65/131] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:11:48.097976 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ade8a-9fef-4d59-9166-0ec514e30d77 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:48.200456 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ade8a-9fef-4d59-9166-0ec514e30d77 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:48.235920 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bf958-9afd-47e7-ac20-601eb9ce6d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:48.236843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bf958-9afd-47e7-ac20-601eb9ce6d7d None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:48.237129 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bf958-9afd-47e7-ac20-601eb9ce6d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:48.237405 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bf958-9afd-47e7-ac20-601eb9ce6d7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:48.238623 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5bf958-9afd-47e7-ac20-601eb9ce6d7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:48.240111 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5bf958-9afd-47e7-ac20-601eb9ce6d7d None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:48.241683 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 67/132] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:11:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:48.247209 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc4d75-85c0-4efc-8b4f-eee0329cc3ff None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:48.345794 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc4d75-85c0-4efc-8b4f-eee0329cc3ff None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:48.380112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be27be8-a0d7-4edf-9900-f01a310d6042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:48.380723 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be27be8-a0d7-4edf-9900-f01a310d6042 None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:48.381003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be27be8-a0d7-4edf-9900-f01a310d6042 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:48.381277 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be27be8-a0d7-4edf-9900-f01a310d6042 None admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:48.381940 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be27be8-a0d7-4edf-9900-f01a310d6042 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:48.383444 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be27be8-a0d7-4edf-9900-f01a310d6042 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:48.482843 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 66/133] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 02:11:48 2022] POST /identity/v3/users => generated 283 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:11:48.655636 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544f267-a96b-402a-8e85-9bbd937ce5e8 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:48.655844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544f267-a96b-402a-8e85-9bbd937ce5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:48.656122 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544f267-a96b-402a-8e85-9bbd937ce5e8 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:48.657642 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 68/134] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:48.663684 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d53f8-9d1b-49d8-8195-eeaa7beb2f12 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:48.663979 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d53f8-9d1b-49d8-8195-eeaa7beb2f12 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:48.664267 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d53f8-9d1b-49d8-8195-eeaa7beb2f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:48.684400 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-cc6d53f8-9d1b-49d8-8195-eeaa7beb2f12 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:48.685921 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-cc6d53f8-9d1b-49d8-8195-eeaa7beb2f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:48.688000 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:48.773065 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 67/135] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:11:49.059920 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544f267-a96b-402a-8e85-9bbd937ce5e8 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:49.133112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:49.169872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544f267-a96b-402a-8e85-9bbd937ce5e8 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:49.205905 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818a352-ad42-4bab-9f66-26ccb060a420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:49.206595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818a352-ad42-4bab-9f66-26ccb060a420 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:49.207556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818a352-ad42-4bab-9f66-26ccb060a420 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:49.207841 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818a352-ad42-4bab-9f66-26ccb060a420 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:49.219777 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818a352-ad42-4bab-9f66-26ccb060a420 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:11:49.226427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-f818a352-ad42-4bab-9f66-26ccb060a420 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 02:11:49.226427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:11:49.226427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:11:49.226427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:11:49.226427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:11:49.226427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:11:49.226427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:11:49.226427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:11:49.226427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:11:49.226427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:11:49.226427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:11:49.226427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:11:49.226427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:11:49.226427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:11:49.226427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:11:49.226427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:11:49.227297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:11:49.227297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:11:49.227297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:11:49.227297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:11:49.227297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:11:49.227297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:11:49.227297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:11:49.227297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:11:49.227297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:11:49.227297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:11:49.227297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:11:49.227297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:11:49.227297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:11:49.227297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:11:49.227297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:11:49.227297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:11:49.228051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:11:49.228051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:11:49.228051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:11:49.228051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:11:49.228051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:11:49.228051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:11:49.228051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:11:49.228051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:11:49.228051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:11:49.228051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:11:49.228051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 02:11:49.228051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:11:49.229413 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 69/136] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:11:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:11:49.235099 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d53f8-9d1b-49d8-8195-eeaa7beb2f12 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:49.344416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d53f8-9d1b-49d8-8195-eeaa7beb2f12 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:49.380930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458657e-1b02-4084-831a-df4ca39e883c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:49.381558 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458657e-1b02-4084-831a-df4ca39e883c None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:49.381842 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458657e-1b02-4084-831a-df4ca39e883c None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:49.382126 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458657e-1b02-4084-831a-df4ca39e883c None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:49.382800 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458657e-1b02-4084-831a-df4ca39e883c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:49.383131 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458657e-1b02-4084-831a-df4ca39e883c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:49.384526 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458657e-1b02-4084-831a-df4ca39e883c None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:49.389923 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:49.393746 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 68/137] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 02:11:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:49.399567 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818a352-ad42-4bab-9f66-26ccb060a420 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:49.505136 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818a352-ad42-4bab-9f66-26ccb060a420 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:49.535873 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:49.544026 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097775e1-e354-4430-8f52-a0bd2489eefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:49.544725 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097775e1-e354-4430-8f52-a0bd2489eefa None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:49.545011 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097775e1-e354-4430-8f52-a0bd2489eefa None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:49.545335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097775e1-e354-4430-8f52-a0bd2489eefa None admin] PATH_INFO: `/v3/users/9ad2d7c743d4402eab69921c2e383e71` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:49.546481 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097775e1-e354-4430-8f52-a0bd2489eefa None admin] RBAC: Authorizing `identity:get_user(user_id=9ad2d7c743d4402eab69921c2e383e71)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:49.548015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097775e1-e354-4430-8f52-a0bd2489eefa None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:49.549900 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 70/138] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:11:49 2022] GET /identity/v3/users/9ad2d7c743d4402eab69921c2e383e71 => generated 289 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:49.556532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458657e-1b02-4084-831a-df4ca39e883c None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:49.663075 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458657e-1b02-4084-831a-df4ca39e883c None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:49.698875 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f0730-1bb4-492c-bc75-1c269a93d75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:49.699498 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f0730-1bb4-492c-bc75-1c269a93d75d None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:49.699792 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f0730-1bb4-492c-bc75-1c269a93d75d None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:49.700061 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f0730-1bb4-492c-bc75-1c269a93d75d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:49.771120 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:49.773540 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f0730-1bb4-492c-bc75-1c269a93d75d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:49.775179 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f0730-1bb4-492c-bc75-1c269a93d75d None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:49.881185 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 69/139] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:11:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:49.888590 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097775e1-e354-4430-8f52-a0bd2489eefa None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:49.991632 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097775e1-e354-4430-8f52-a0bd2489eefa None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:50.026514 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a458b3-99af-4fc1-9470-f0cc307a620f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:50.027190 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a458b3-99af-4fc1-9470-f0cc307a620f None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:50.027472 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a458b3-99af-4fc1-9470-f0cc307a620f None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:50.027745 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a458b3-99af-4fc1-9470-f0cc307a620f None admin] PATH_INFO: `/v3/projects/40691146f4bd45d4b515421ef1deba9e` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:50.028878 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a458b3-99af-4fc1-9470-f0cc307a620f None admin] RBAC: Authorizing `identity:get_project(project_id=40691146f4bd45d4b515421ef1deba9e)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:50.030381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a458b3-99af-4fc1-9470-f0cc307a620f None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:50.032481 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 71/140] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:11:49 2022] GET /identity/v3/projects/40691146f4bd45d4b515421ef1deba9e => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:50.038873 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f0730-1bb4-492c-bc75-1c269a93d75d None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:50.139687 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:50.143377 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f0730-1bb4-492c-bc75-1c269a93d75d None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:50.179980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83303d87-19aa-4a37-878a-e15465a96ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:50.180659 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83303d87-19aa-4a37-878a-e15465a96ebb None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:50.180949 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83303d87-19aa-4a37-878a-e15465a96ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:50.181226 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83303d87-19aa-4a37-878a-e15465a96ebb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:50.182006 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83303d87-19aa-4a37-878a-e15465a96ebb None admin] RBAC: Adding query filter params (role.id=a2f123a9ec8440cba593773aabc0f2fc, scope.project.id=40691146f4bd45d4b515421ef1deba9e, user.id=9ad2d7c743d4402eab69921c2e383e71) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:50.182541 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83303d87-19aa-4a37-878a-e15465a96ebb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:50.184312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83303d87-19aa-4a37-878a-e15465a96ebb None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:50.191340 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 70/141] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 02:11:50 2022] GET /identity/v3/role_assignments?user.id=9ad2d7c743d4402eab69921c2e383e71&scope.project.id=40691146f4bd45d4b515421ef1deba9e&role.id=a2f123a9ec8440cba593773aabc0f2fc => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:50.832049 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93937755-8a18-4247-81a7-9df3a937c8dd None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:50.832572 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93937755-8a18-4247-81a7-9df3a937c8dd None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:50.832572 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93937755-8a18-4247-81a7-9df3a937c8dd None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:50.834099 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 72/142] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:50.839294 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c35627-9a4b-462b-abf9-0375351d0509 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:50.839688 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c35627-9a4b-462b-abf9-0375351d0509 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:50.839845 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c35627-9a4b-462b-abf9-0375351d0509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:50.858326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-a5c35627-9a4b-462b-abf9-0375351d0509 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:50.859539 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-a5c35627-9a4b-462b-abf9-0375351d0509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:50.926292 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 71/143] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:11:51.092868 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9c865-4894-4733-8901-65916d37c67e None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:51.093073 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9c865-4894-4733-8901-65916d37c67e None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:51.093196 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd55cf-f2c4-44f6-b64d-e700febf1278 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:51.093438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd55cf-f2c4-44f6-b64d-e700febf1278 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:51.093620 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9c865-4894-4733-8901-65916d37c67e None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:51.093732 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd55cf-f2c4-44f6-b64d-e700febf1278 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:51.095296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 73/144] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 02:11:51.095398 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 72/145] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:51.099902 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e840b05-fd4e-4328-bc36-1ff3862d9eba None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:51.100107 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3a7ee-1bdc-4b0e-a145-df59e1e17b97 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:51.100216 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e840b05-fd4e-4328-bc36-1ff3862d9eba None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:51.100358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3a7ee-1bdc-4b0e-a145-df59e1e17b97 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:51.100444 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e840b05-fd4e-4328-bc36-1ff3862d9eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:51.100601 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3a7ee-1bdc-4b0e-a145-df59e1e17b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:51.119374 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-5e840b05-fd4e-4328-bc36-1ff3862d9eba None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:51.120053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-51b3a7ee-1bdc-4b0e-a145-df59e1e17b97 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:51.120570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-5e840b05-fd4e-4328-bc36-1ff3862d9eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:51.121213 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-51b3a7ee-1bdc-4b0e-a145-df59e1e17b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:51.180230 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:51.191429 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 74/146] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:11:51.194301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 73/147] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 02:11:51.202847 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e840b05-fd4e-4328-bc36-1ff3862d9eba None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:51.299323 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e840b05-fd4e-4328-bc36-1ff3862d9eba None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:51.333962 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c319f49-fdc2-4de9-aac6-0cd4cb451c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:51.334594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c319f49-fdc2-4de9-aac6-0cd4cb451c77 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:51.334957 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c319f49-fdc2-4de9-aac6-0cd4cb451c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:51.335226 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c319f49-fdc2-4de9-aac6-0cd4cb451c77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:51.345115 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c319f49-fdc2-4de9-aac6-0cd4cb451c77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:11:51.349940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-9c319f49-fdc2-4de9-aac6-0cd4cb451c77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:11:51.349940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:11:51.349940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:11:51.349940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:11:51.349940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:11:51.349940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:11:51.349940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:11:51.349940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:11:51.349940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:11:51.349940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:11:51.349940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:11:51.349940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:11:51.349940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:11:51.349940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:11:51.349940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:11:51.349940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:11:51.351406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:11:51.351406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:11:51.351406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:11:51.351406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:11:51.351406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:11:51.351406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:11:51.351406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:11:51.351406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:11:51.351406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:11:51.351406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:11:51.351406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:11:51.351406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:11:51.351406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:11:51.351406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:11:51.351406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:11:51.351406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:11:51.352178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:11:51.352178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:11:51.352178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:11:51.352178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:11:51.352178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:11:51.352178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:11:51.352178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:11:51.352178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:11:51.352178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:11:51.352178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:11:51.352178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:11:51.352178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:11:51.352178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 75/148] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 02:11:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:11:51.357011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3a7ee-1bdc-4b0e-a145-df59e1e17b97 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:51.383063 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:51.460293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3a7ee-1bdc-4b0e-a145-df59e1e17b97 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:51.466087 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c319f49-fdc2-4de9-aac6-0cd4cb451c77 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:51.497335 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d31349-21cf-4e07-b8f7-a1c4c8a484c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:51.497947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d31349-21cf-4e07-b8f7-a1c4c8a484c3 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:51.498227 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d31349-21cf-4e07-b8f7-a1c4c8a484c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:51.498497 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d31349-21cf-4e07-b8f7-a1c4c8a484c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:51.499197 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d31349-21cf-4e07-b8f7-a1c4c8a484c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:51.499500 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d31349-21cf-4e07-b8f7-a1c4c8a484c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:51.500876 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d31349-21cf-4e07-b8f7-a1c4c8a484c3 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:51.509705 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 74/149] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:11:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:51.510500 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d31349-21cf-4e07-b8f7-a1c4c8a484c3 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:51.526312 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:51.570761 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c319f49-fdc2-4de9-aac6-0cd4cb451c77 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:51.601316 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:51.605443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ec716-87da-4ea3-8784-a7be6fa5c075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:51.606067 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ec716-87da-4ea3-8784-a7be6fa5c075 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:51.606338 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ec716-87da-4ea3-8784-a7be6fa5c075 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:51.606610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ec716-87da-4ea3-8784-a7be6fa5c075 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:51.607741 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ec716-87da-4ea3-8784-a7be6fa5c075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:51.609191 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ec716-87da-4ea3-8784-a7be6fa5c075 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:51.610748 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 76/150] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:11:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:11:51.615049 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ec716-87da-4ea3-8784-a7be6fa5c075 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:51.616887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d31349-21cf-4e07-b8f7-a1c4c8a484c3 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:51.650179 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c22ce-8c20-4bec-a149-c3cccce2494c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:51.650932 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c22ce-8c20-4bec-a149-c3cccce2494c None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:51.651213 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c22ce-8c20-4bec-a149-c3cccce2494c None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:51.651482 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c22ce-8c20-4bec-a149-c3cccce2494c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:51.661870 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c22ce-8c20-4bec-a149-c3cccce2494c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:11:51.667085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-799c22ce-8c20-4bec-a149-c3cccce2494c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 02:11:51.667085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:11:51.667085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:11:51.667085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:11:51.667085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:11:51.667085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:11:51.667085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:11:51.667085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:11:51.667085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:11:51.667085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:11:51.667085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:11:51.667085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:11:51.667085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:11:51.667085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:11:51.667085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:11:51.667085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:11:51.668017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:11:51.668017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:11:51.668017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:11:51.668017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:11:51.668017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:11:51.668017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:11:51.668017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:11:51.668017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:11:51.668017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:11:51.668017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:11:51.668017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:11:51.668017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:11:51.668017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:11:51.668017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:11:51.668017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:11:51.668017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:11:51.668831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:11:51.668831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:11:51.668831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:11:51.668831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:11:51.668831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:11:51.668831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:11:51.668831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:11:51.668831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:11:51.668831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:11:51.668831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:11:51.668831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 02:11:51.668831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:11:51.668831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 75/151] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 02:11:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:11:51.669465 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c22ce-8c20-4bec-a149-c3cccce2494c None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:51.717431 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ec716-87da-4ea3-8784-a7be6fa5c075 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:51.740467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:51.751783 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c913d-039f-495c-984f-452b31bae42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:51.752410 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c913d-039f-495c-984f-452b31bae42b None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:51.752688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c913d-039f-495c-984f-452b31bae42b None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:51.753733 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c913d-039f-495c-984f-452b31bae42b None admin] PATH_INFO: `/v3/users/fc62714d00c54e099b0fa08e0780e91d` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:51.766711 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c913d-039f-495c-984f-452b31bae42b None admin] RBAC: Authorizing `identity:get_user(user_id=fc62714d00c54e099b0fa08e0780e91d)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:51.768224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c913d-039f-495c-984f-452b31bae42b None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:51.771168 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 77/152] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:11:51 2022] GET /identity/v3/users/fc62714d00c54e099b0fa08e0780e91d => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:51.771352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c22ce-8c20-4bec-a149-c3cccce2494c None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:51.771846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c913d-039f-495c-984f-452b31bae42b None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:51.805221 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf82fb-77c7-4ab3-9a0e-27aece9ca889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:51.805820 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf82fb-77c7-4ab3-9a0e-27aece9ca889 None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:51.806099 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf82fb-77c7-4ab3-9a0e-27aece9ca889 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:51.806369 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf82fb-77c7-4ab3-9a0e-27aece9ca889 None admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:51.807042 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf82fb-77c7-4ab3-9a0e-27aece9ca889 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:51.808485 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf82fb-77c7-4ab3-9a0e-27aece9ca889 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:51.870241 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c913d-039f-495c-984f-452b31bae42b None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:51.903079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e98f43-f54b-487a-824b-ccfcba1ed94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:51.903679 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e98f43-f54b-487a-824b-ccfcba1ed94f None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:51.903962 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e98f43-f54b-487a-824b-ccfcba1ed94f None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:51.904236 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e98f43-f54b-487a-824b-ccfcba1ed94f None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:51.904894 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e98f43-f54b-487a-824b-ccfcba1ed94f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:51.905197 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e98f43-f54b-487a-824b-ccfcba1ed94f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:51.906675 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e98f43-f54b-487a-824b-ccfcba1ed94f None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:51.912811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 76/153] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 02:11:51 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:11:51.913551 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf82fb-77c7-4ab3-9a0e-27aece9ca889 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:51.916346 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:51.920938 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 78/154] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:11:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:51.927967 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e98f43-f54b-487a-824b-ccfcba1ed94f None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:51.976278 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:52.033107 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf82fb-77c7-4ab3-9a0e-27aece9ca889 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:52.045304 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e98f43-f54b-487a-824b-ccfcba1ed94f None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:52.072873 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbea51-5a37-4b9d-aeea-074f54296b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:52.073630 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbea51-5a37-4b9d-aeea-074f54296b2c None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:52.074009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbea51-5a37-4b9d-aeea-074f54296b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:52.074289 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbea51-5a37-4b9d-aeea-074f54296b2c None admin] PATH_INFO: `/v3/projects/c277629bc0e74ec98f23ed36d4f266d6` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:52.075483 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cbea51-5a37-4b9d-aeea-074f54296b2c None admin] RBAC: Authorizing `identity:get_project(project_id=c277629bc0e74ec98f23ed36d4f266d6)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:52.077055 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cbea51-5a37-4b9d-aeea-074f54296b2c None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:52.079046 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 77/155] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:11:51 2022] GET /identity/v3/projects/c277629bc0e74ec98f23ed36d4f266d6 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:52.085222 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbea51-5a37-4b9d-aeea-074f54296b2c None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:52.086315 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b15441-cc58-44bd-92cc-8ce37a7a759d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:52.087007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b15441-cc58-44bd-92cc-8ce37a7a759d None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:52.087283 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b15441-cc58-44bd-92cc-8ce37a7a759d None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:52.087551 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b15441-cc58-44bd-92cc-8ce37a7a759d None admin] PATH_INFO: `/v3/users/fc62714d00c54e099b0fa08e0780e91d` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:52.089946 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b15441-cc58-44bd-92cc-8ce37a7a759d None admin] RBAC: Authorizing `identity:get_user(user_id=fc62714d00c54e099b0fa08e0780e91d)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:52.091455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b15441-cc58-44bd-92cc-8ce37a7a759d None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:52.093050 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 79/156] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:11:51 2022] GET /identity/v3/users/fc62714d00c54e099b0fa08e0780e91d => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:52.099925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b15441-cc58-44bd-92cc-8ce37a7a759d None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:52.163398 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:52.205419 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbea51-5a37-4b9d-aeea-074f54296b2c None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:52.230612 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b15441-cc58-44bd-92cc-8ce37a7a759d None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:52.242651 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:52.255067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfeba7-f082-4290-b477-63bebd02cdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:52.255739 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfeba7-f082-4290-b477-63bebd02cdfa None admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:52.260606 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfeba7-f082-4290-b477-63bebd02cdfa None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:52.260606 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfeba7-f082-4290-b477-63bebd02cdfa None admin] PATH_INFO: `/v3/projects/c277629bc0e74ec98f23ed36d4f266d6/users/fc62714d00c54e099b0fa08e0780e91d/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:52.260606 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfeba7-f082-4290-b477-63bebd02cdfa None admin] RBAC: Authorizing `identity:create_grant(project_id=c277629bc0e74ec98f23ed36d4f266d6, user_id=fc62714d00c54e099b0fa08e0780e91d, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:52.260606 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfeba7-f082-4290-b477-63bebd02cdfa None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:52.269497 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ac019-0c5b-438c-a4d6-b28b50f6f212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:52.270565 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ac019-0c5b-438c-a4d6-b28b50f6f212 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:52.270866 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ac019-0c5b-438c-a4d6-b28b50f6f212 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:52.271143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ac019-0c5b-438c-a4d6-b28b50f6f212 None admin] PATH_INFO: `/v3/projects/c277629bc0e74ec98f23ed36d4f266d6` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:52.272294 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ac019-0c5b-438c-a4d6-b28b50f6f212 None admin] RBAC: Authorizing `identity:get_project(project_id=c277629bc0e74ec98f23ed36d4f266d6)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:52.273743 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ac019-0c5b-438c-a4d6-b28b50f6f212 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:52.275527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 80/157] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:11:52 2022] GET /identity/v3/projects/c277629bc0e74ec98f23ed36d4f266d6 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:52.281671 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ac019-0c5b-438c-a4d6-b28b50f6f212 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:52.343876 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 78/158] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 02:11:52 2022] PUT /identity/v3/projects/c277629bc0e74ec98f23ed36d4f266d6/users/fc62714d00c54e099b0fa08e0780e91d/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:11:52.400700 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ac019-0c5b-438c-a4d6-b28b50f6f212 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:52.439789 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c87db9-c83f-4887-b8db-dde044a47421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:52.440688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c87db9-c83f-4887-b8db-dde044a47421 None admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:52.442048 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c87db9-c83f-4887-b8db-dde044a47421 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:52.442475 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c87db9-c83f-4887-b8db-dde044a47421 None admin] PATH_INFO: `/v3/projects/c277629bc0e74ec98f23ed36d4f266d6/users/fc62714d00c54e099b0fa08e0780e91d/roles/619c0bef418849679ac636aa63923dc9` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:52.444948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c87db9-c83f-4887-b8db-dde044a47421 None admin] RBAC: Authorizing `identity:create_grant(project_id=c277629bc0e74ec98f23ed36d4f266d6, user_id=fc62714d00c54e099b0fa08e0780e91d, role_id=619c0bef418849679ac636aa63923dc9)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:52.446627 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c87db9-c83f-4887-b8db-dde044a47421 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:52.526645 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 81/159] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 02:11:52 2022] PUT /identity/v3/projects/c277629bc0e74ec98f23ed36d4f266d6/users/fc62714d00c54e099b0fa08e0780e91d/roles/619c0bef418849679ac636aa63923dc9 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:11:54.214011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a1f96-c67b-41a8-8c8e-8dfdabcdc790 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:54.214369 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a1f96-c67b-41a8-8c8e-8dfdabcdc790 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:54.214369 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a1f96-c67b-41a8-8c8e-8dfdabcdc790 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:54.215853 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 79/160] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:54.221302 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6854f-e20a-4b00-902e-9e74e5f55c34 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:54.222193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6854f-e20a-4b00-902e-9e74e5f55c34 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:54.222670 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6854f-e20a-4b00-902e-9e74e5f55c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:54.246152 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-8dc6854f-e20a-4b00-902e-9e74e5f55c34 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:54.247650 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-8dc6854f-e20a-4b00-902e-9e74e5f55c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:54.279728 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:54.290867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ace94-421b-4891-bcbf-f61d175ce085 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:54.291528 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ace94-421b-4891-bcbf-f61d175ce085 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:54.292004 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ace94-421b-4891-bcbf-f61d175ce085 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:54.293568 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 80/161] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:54.298893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326fe83-7bdc-4b35-a67e-b98e78713e37 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:54.299177 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326fe83-7bdc-4b35-a67e-b98e78713e37 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:54.304082 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326fe83-7bdc-4b35-a67e-b98e78713e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:54.321302 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 82/162] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:11:54.398408 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-3326fe83-7bdc-4b35-a67e-b98e78713e37 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:54.399667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-3326fe83-7bdc-4b35-a67e-b98e78713e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:54.470290 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 81/163] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:11:54.594069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6854f-e20a-4b00-902e-9e74e5f55c34 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:54.634632 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe9d7f-8a17-492a-bb9f-dd76d7e62e30 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:54.634998 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe9d7f-8a17-492a-bb9f-dd76d7e62e30 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:54.635273 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe9d7f-8a17-492a-bb9f-dd76d7e62e30 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:54.636606 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 82/164] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 02:11:54.641910 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ce8bb-40b3-4396-9ec2-6b4636885878 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:54.642311 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ce8bb-40b3-4396-9ec2-6b4636885878 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:54.642586 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ce8bb-40b3-4396-9ec2-6b4636885878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:54.663448 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-455ce8bb-40b3-4396-9ec2-6b4636885878 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:54.664846 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-455ce8bb-40b3-4396-9ec2-6b4636885878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:54.703785 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6854f-e20a-4b00-902e-9e74e5f55c34 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:54.731029 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:54.741300 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306674b9-17a4-46f5-9897-b357734207f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:54.741926 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306674b9-17a4-46f5-9897-b357734207f4 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:54.742200 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306674b9-17a4-46f5-9897-b357734207f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:54.746995 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306674b9-17a4-46f5-9897-b357734207f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:54.747094 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 83/165] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 02:11:54.747094 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451179bb-32ef-4ebd-85a8-1b60a83b8040 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:54.747094 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451179bb-32ef-4ebd-85a8-1b60a83b8040 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:54.747094 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451179bb-32ef-4ebd-85a8-1b60a83b8040 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:54.747094 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 84/166] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:54.754856 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e346e7f-b724-48ae-9fa5-057e4e1b3099 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:54.754856 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e346e7f-b724-48ae-9fa5-057e4e1b3099 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:54.754856 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e346e7f-b724-48ae-9fa5-057e4e1b3099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:54.771855 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306674b9-17a4-46f5-9897-b357734207f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:11:54.777223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-306674b9-17a4-46f5-9897-b357734207f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:11:54.777223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:11:54.777223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:11:54.777223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:11:54.777223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:11:54.777223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:11:54.777223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:11:54.777223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:11:54.777223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:11:54.777223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:11:54.777223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:11:54.777223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:11:54.777223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:11:54.777223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:11:54.777223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:11:54.777223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:11:54.778296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:11:54.778296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:11:54.778296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:11:54.778296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:11:54.778296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:11:54.778296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:11:54.778296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:11:54.778296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:11:54.778296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:11:54.778296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:11:54.778296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:11:54.778296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:11:54.778296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:11:54.778296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:11:54.778296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:11:54.778296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:11:54.779395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:11:54.779395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:11:54.779395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:11:54.779395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:11:54.779395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:11:54.779395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:11:54.779395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:11:54.779395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:11:54.779395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:11:54.779395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:11:54.779395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:11:54.779395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:11:54.780149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-4e346e7f-b724-48ae-9fa5-057e4e1b3099 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:54.780149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-4e346e7f-b724-48ae-9fa5-057e4e1b3099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:54.781522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 83/167] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:11:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:11:54.782380 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306674b9-17a4-46f5-9897-b357734207f4 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:54.812479 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:54.852143 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 85/168] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 02:11:54.855841 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e346e7f-b724-48ae-9fa5-057e4e1b3099 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:54.887439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306674b9-17a4-46f5-9897-b357734207f4 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:54.932754 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b28d46-6784-447d-9659-f9eb95490ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:54.933381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b28d46-6784-447d-9659-f9eb95490ddd None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:54.933655 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b28d46-6784-447d-9659-f9eb95490ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:54.933924 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b28d46-6784-447d-9659-f9eb95490ddd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:54.935053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b28d46-6784-447d-9659-f9eb95490ddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:54.937014 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b28d46-6784-447d-9659-f9eb95490ddd None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:54.944919 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 84/169] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:11:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:54.946627 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b28d46-6784-447d-9659-f9eb95490ddd None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:54.976714 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e346e7f-b724-48ae-9fa5-057e4e1b3099 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:54.998504 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:55.012967 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41e86b-fc4b-4be3-af1b-b6273e449f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:55.014388 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41e86b-fc4b-4be3-af1b-b6273e449f64 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:55.014388 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41e86b-fc4b-4be3-af1b-b6273e449f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:55.014747 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41e86b-fc4b-4be3-af1b-b6273e449f64 None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:55.015711 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41e86b-fc4b-4be3-af1b-b6273e449f64 None admin] RBAC: Adding query filter params (name=member) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:55.016207 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41e86b-fc4b-4be3-af1b-b6273e449f64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:55.017881 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41e86b-fc4b-4be3-af1b-b6273e449f64 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:55.027568 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 86/170] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 02:11:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:55.028724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41e86b-fc4b-4be3-af1b-b6273e449f64 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:55.062732 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:55.071472 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b28d46-6784-447d-9659-f9eb95490ddd None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:55.106962 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db81e3-4357-4e48-b5c2-d99b22eb66a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:55.107565 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db81e3-4357-4e48-b5c2-d99b22eb66a5 None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:55.107837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db81e3-4357-4e48-b5c2-d99b22eb66a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:55.108168 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db81e3-4357-4e48-b5c2-d99b22eb66a5 None admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:55.108818 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db81e3-4357-4e48-b5c2-d99b22eb66a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:55.110357 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db81e3-4357-4e48-b5c2-d99b22eb66a5 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:55.136812 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41e86b-fc4b-4be3-af1b-b6273e449f64 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:55.169872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5110bc7-ebb8-4fb1-9ada-092cd745f699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:55.170488 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5110bc7-ebb8-4fb1-9ada-092cd745f699 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:55.170763 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5110bc7-ebb8-4fb1-9ada-092cd745f699 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:55.171057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5110bc7-ebb8-4fb1-9ada-092cd745f699 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:55.181770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5110bc7-ebb8-4fb1-9ada-092cd745f699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:11:55.187284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-e5110bc7-ebb8-4fb1-9ada-092cd745f699 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:11:55.187284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:11:55.187284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:11:55.187284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:11:55.187284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:11:55.187284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:11:55.187284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:11:55.187284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:11:55.187284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:11:55.187284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:11:55.187284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:11:55.187284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:11:55.187284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:11:55.187284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:11:55.187284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:11:55.187284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:11:55.188315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:11:55.188315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:11:55.188315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:11:55.188315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:11:55.188315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:11:55.188315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:11:55.188315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:11:55.188315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:11:55.188315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:11:55.188315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:11:55.188315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:11:55.188315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:11:55.188315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:11:55.188315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:11:55.188315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:11:55.188315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:11:55.189556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:11:55.189556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:11:55.189556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:11:55.189556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:11:55.189556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:11:55.189556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:11:55.189556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:11:55.189556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:11:55.189556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:11:55.189556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:11:55.189556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:11:55.189556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:11:55.189556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 87/171] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 02:11:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:11:55.189556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5110bc7-ebb8-4fb1-9ada-092cd745f699 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:55.232633 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 85/172] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 02:11:54 2022] POST /identity/v3/users => generated 297 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:11:55.233589 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:55.235931 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db81e3-4357-4e48-b5c2-d99b22eb66a5 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:55.307439 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5110bc7-ebb8-4fb1-9ada-092cd745f699 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:55.346659 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec088b-f1b5-4abc-9b0d-e485562ad93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:55.348236 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec088b-f1b5-4abc-9b0d-e485562ad93d None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:55.348611 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec088b-f1b5-4abc-9b0d-e485562ad93d None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:55.348803 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec088b-f1b5-4abc-9b0d-e485562ad93d None admin] PATH_INFO: `/v3/users/0130c15fccfd4695ab47e0f8354b0b84` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:55.353889 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db81e3-4357-4e48-b5c2-d99b22eb66a5 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:55.363816 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec088b-f1b5-4abc-9b0d-e485562ad93d None admin] RBAC: Authorizing `identity:get_user(user_id=0130c15fccfd4695ab47e0f8354b0b84)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:55.365324 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec088b-f1b5-4abc-9b0d-e485562ad93d None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:55.371580 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 88/173] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:11:55 2022] GET /identity/v3/users/0130c15fccfd4695ab47e0f8354b0b84 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:55.371580 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec088b-f1b5-4abc-9b0d-e485562ad93d None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:55.399509 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f4580-01a6-4f61-8252-d3ba08df7df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:55.400474 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f4580-01a6-4f61-8252-d3ba08df7df6 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:55.400958 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f4580-01a6-4f61-8252-d3ba08df7df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:55.401410 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f4580-01a6-4f61-8252-d3ba08df7df6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:55.415405 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f4580-01a6-4f61-8252-d3ba08df7df6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:11:55.420752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-ea7f4580-01a6-4f61-8252-d3ba08df7df6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 02:11:55.420752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:11:55.420752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:11:55.420752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:11:55.420752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:11:55.420752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:11:55.420752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:11:55.420752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:11:55.420752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:11:55.420752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:11:55.420752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:11:55.420752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:11:55.420752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:11:55.420752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:11:55.420752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:11:55.420752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:11:55.421602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:11:55.421602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:11:55.421602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:11:55.421602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:11:55.421602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:11:55.421602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:11:55.421602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:11:55.421602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:11:55.421602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:11:55.421602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:11:55.421602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:11:55.421602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:11:55.421602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:11:55.421602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:11:55.421602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:11:55.421602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:11:55.422381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:11:55.422381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:11:55.422381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:11:55.422381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:11:55.422381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:11:55.422381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:11:55.422381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:11:55.422381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:11:55.422381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:11:55.422381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:11:55.422381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 02:11:55.422381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:11:55.422381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 86/174] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 02:11:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:11:55.423654 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f4580-01a6-4f61-8252-d3ba08df7df6 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:55.442886 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:55.499014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:55.503761 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec088b-f1b5-4abc-9b0d-e485562ad93d None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:55.539583 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f4580-01a6-4f61-8252-d3ba08df7df6 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:55.559486 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492c12d-98b2-4bc1-8f69-17a84f7c1fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:55.559486 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492c12d-98b2-4bc1-8f69-17a84f7c1fea None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:55.559723 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492c12d-98b2-4bc1-8f69-17a84f7c1fea None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:55.559999 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492c12d-98b2-4bc1-8f69-17a84f7c1fea None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:55.560935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492c12d-98b2-4bc1-8f69-17a84f7c1fea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:55.561237 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492c12d-98b2-4bc1-8f69-17a84f7c1fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:55.562633 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492c12d-98b2-4bc1-8f69-17a84f7c1fea None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:55.573063 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 89/175] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:11:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:55.573988 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492c12d-98b2-4bc1-8f69-17a84f7c1fea None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:55.589929 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba27bc3-f200-493c-bff5-e23d8aefdab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:55.591117 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba27bc3-f200-493c-bff5-e23d8aefdab8 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:55.591903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba27bc3-f200-493c-bff5-e23d8aefdab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:55.592608 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba27bc3-f200-493c-bff5-e23d8aefdab8 None admin] PATH_INFO: `/v3/projects/c277629bc0e74ec98f23ed36d4f266d6` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:55.594065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba27bc3-f200-493c-bff5-e23d8aefdab8 None admin] RBAC: Authorizing `identity:get_project(project_id=c277629bc0e74ec98f23ed36d4f266d6)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:55.596024 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba27bc3-f200-493c-bff5-e23d8aefdab8 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:55.599603 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 87/176] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:11:55 2022] GET /identity/v3/projects/c277629bc0e74ec98f23ed36d4f266d6 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:55.600913 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba27bc3-f200-493c-bff5-e23d8aefdab8 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:55.699809 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492c12d-98b2-4bc1-8f69-17a84f7c1fea None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:55.710762 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:55.738007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba27bc3-f200-493c-bff5-e23d8aefdab8 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:55.757218 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1353099-3568-405c-a083-69f9f3a6c11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:55.757833 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1353099-3568-405c-a083-69f9f3a6c11e None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:55.758108 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1353099-3568-405c-a083-69f9f3a6c11e None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:55.758373 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1353099-3568-405c-a083-69f9f3a6c11e None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:55.759326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1353099-3568-405c-a083-69f9f3a6c11e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:55.759624 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1353099-3568-405c-a083-69f9f3a6c11e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:55.761394 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1353099-3568-405c-a083-69f9f3a6c11e None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:55.774151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 90/177] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:11:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:55.775351 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1353099-3568-405c-a083-69f9f3a6c11e None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:55.779678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86f790-4c83-4a6a-828c-b18ed7f8c34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:55.780596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86f790-4c83-4a6a-828c-b18ed7f8c34c None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:55.781068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86f790-4c83-4a6a-828c-b18ed7f8c34c None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:55.781598 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86f790-4c83-4a6a-828c-b18ed7f8c34c None admin] PATH_INFO: `/v3/users/fc62714d00c54e099b0fa08e0780e91d` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:55.783103 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df86f790-4c83-4a6a-828c-b18ed7f8c34c None admin] RBAC: Authorizing `identity:get_user(user_id=fc62714d00c54e099b0fa08e0780e91d)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:55.784938 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df86f790-4c83-4a6a-828c-b18ed7f8c34c None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:55.787270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 88/178] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:11:55 2022] GET /identity/v3/users/fc62714d00c54e099b0fa08e0780e91d => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:55.788412 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86f790-4c83-4a6a-828c-b18ed7f8c34c None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:55.808231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:55.906470 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1353099-3568-405c-a083-69f9f3a6c11e None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:55.912289 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86f790-4c83-4a6a-828c-b18ed7f8c34c None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:55.955695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9cf05-b008-425d-ba83-daf8b4db83c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:55.956544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9cf05-b008-425d-ba83-daf8b4db83c2 None admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:55.956852 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9cf05-b008-425d-ba83-daf8b4db83c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:55.957128 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9cf05-b008-425d-ba83-daf8b4db83c2 None admin] PATH_INFO: `/v3/projects/c277629bc0e74ec98f23ed36d4f266d6/users/0130c15fccfd4695ab47e0f8354b0b84/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:55.958120 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76c8fe-4a0f-42a8-a189-312e61d33792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:55.958878 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76c8fe-4a0f-42a8-a189-312e61d33792 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:55.959114 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9cf05-b008-425d-ba83-daf8b4db83c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c277629bc0e74ec98f23ed36d4f266d6, user_id=0130c15fccfd4695ab47e0f8354b0b84, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:55.959213 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76c8fe-4a0f-42a8-a189-312e61d33792 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:55.959420 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76c8fe-4a0f-42a8-a189-312e61d33792 None admin] PATH_INFO: `/v3/users/fc62714d00c54e099b0fa08e0780e91d` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:55.960535 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76c8fe-4a0f-42a8-a189-312e61d33792 None admin] RBAC: Authorizing `identity:get_user(user_id=fc62714d00c54e099b0fa08e0780e91d)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:55.960665 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9cf05-b008-425d-ba83-daf8b4db83c2 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:55.961961 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76c8fe-4a0f-42a8-a189-312e61d33792 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:55.964532 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 89/179] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:11:55 2022] GET /identity/v3/users/fc62714d00c54e099b0fa08e0780e91d => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:55.965347 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76c8fe-4a0f-42a8-a189-312e61d33792 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:55.984749 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:56.013497 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 91/180] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 02:11:55 2022] PUT /identity/v3/projects/c277629bc0e74ec98f23ed36d4f266d6/users/0130c15fccfd4695ab47e0f8354b0b84/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:11:56.015671 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9cf05-b008-425d-ba83-daf8b4db83c2 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:56.141160 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76c8fe-4a0f-42a8-a189-312e61d33792 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:56.151202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:56.181347 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9cf05-b008-425d-ba83-daf8b4db83c2 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:56.224911 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758819f-9fd8-4e48-921a-5d199bccb7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:56.227630 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758819f-9fd8-4e48-921a-5d199bccb7ea None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:56.227630 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758819f-9fd8-4e48-921a-5d199bccb7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:56.227630 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758819f-9fd8-4e48-921a-5d199bccb7ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:56.255510 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9881f-c5b8-4eb6-ac3f-0c2287883cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:56.256814 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9881f-c5b8-4eb6-ac3f-0c2287883cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:56.257272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9881f-c5b8-4eb6-ac3f-0c2287883cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:56.257744 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9881f-c5b8-4eb6-ac3f-0c2287883cf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:56.345288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9881f-c5b8-4eb6-ac3f-0c2287883cf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:56.347659 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9881f-c5b8-4eb6-ac3f-0c2287883cf9 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:56.351670 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1758819f-9fd8-4e48-921a-5d199bccb7ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:56.353157 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1758819f-9fd8-4e48-921a-5d199bccb7ea None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:56.388020 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:56.502051 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:56.532002 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 92/181] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:11:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:56.539763 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9881f-c5b8-4eb6-ac3f-0c2287883cf9 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:56.545742 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 90/182] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:11:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:56.552318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758819f-9fd8-4e48-921a-5d199bccb7ea None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:56.720280 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758819f-9fd8-4e48-921a-5d199bccb7ea None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:56.729614 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9881f-c5b8-4eb6-ac3f-0c2287883cf9 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:56.771288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:56.798639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea13532-ced1-456f-94a6-57787ea1561b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:56.799308 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea13532-ced1-456f-94a6-57787ea1561b None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:56.799590 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea13532-ced1-456f-94a6-57787ea1561b None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:56.799871 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea13532-ced1-456f-94a6-57787ea1561b None admin] PATH_INFO: `/v3/projects/c277629bc0e74ec98f23ed36d4f266d6` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:56.802913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea13532-ced1-456f-94a6-57787ea1561b None admin] RBAC: Authorizing `identity:get_project(project_id=c277629bc0e74ec98f23ed36d4f266d6)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:56.804370 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea13532-ced1-456f-94a6-57787ea1561b None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:56.806020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 93/183] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:11:56 2022] GET /identity/v3/projects/c277629bc0e74ec98f23ed36d4f266d6 => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:11:56.811324 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63af0f-3476-4594-a7fa-cdd458c3936e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:56.811980 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63af0f-3476-4594-a7fa-cdd458c3936e None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:56.812260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63af0f-3476-4594-a7fa-cdd458c3936e None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:56.812534 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63af0f-3476-4594-a7fa-cdd458c3936e None admin] PATH_INFO: `/v3/projects/c277629bc0e74ec98f23ed36d4f266d6` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:56.813699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63af0f-3476-4594-a7fa-cdd458c3936e None admin] RBAC: Authorizing `identity:get_project(project_id=c277629bc0e74ec98f23ed36d4f266d6)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:56.815176 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63af0f-3476-4594-a7fa-cdd458c3936e None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:56.817009 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 91/184] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:11:56 2022] GET /identity/v3/projects/c277629bc0e74ec98f23ed36d4f266d6 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:11:56.819022 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea13532-ced1-456f-94a6-57787ea1561b None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:56.822591 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63af0f-3476-4594-a7fa-cdd458c3936e None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:56.947185 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:56.984914 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63af0f-3476-4594-a7fa-cdd458c3936e None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:56.998347 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea13532-ced1-456f-94a6-57787ea1561b None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:57.053986 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fed201-f350-43a7-813b-95936945817f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:57.054518 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fed201-f350-43a7-813b-95936945817f None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:57.054797 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fed201-f350-43a7-813b-95936945817f None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:57.055088 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fed201-f350-43a7-813b-95936945817f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:57.055812 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fed201-f350-43a7-813b-95936945817f None admin] RBAC: Adding query filter params (role.id=619c0bef418849679ac636aa63923dc9, scope.project.id=c277629bc0e74ec98f23ed36d4f266d6, user.id=fc62714d00c54e099b0fa08e0780e91d) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:57.056121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fed201-f350-43a7-813b-95936945817f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:57.057566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fed201-f350-43a7-813b-95936945817f None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:57.061590 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df43f61-1bb8-4f46-b243-d303aaf4f717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:57.062202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df43f61-1bb8-4f46-b243-d303aaf4f717 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:57.062481 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df43f61-1bb8-4f46-b243-d303aaf4f717 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:57.062751 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df43f61-1bb8-4f46-b243-d303aaf4f717 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:57.063679 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df43f61-1bb8-4f46-b243-d303aaf4f717 None admin] RBAC: Adding query filter params (role.id=e2e7c80d19c141bc9f9bfc13c2ec2a12, scope.project.id=c277629bc0e74ec98f23ed36d4f266d6, user.id=fc62714d00c54e099b0fa08e0780e91d) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:57.063995 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df43f61-1bb8-4f46-b243-d303aaf4f717 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:57.065428 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df43f61-1bb8-4f46-b243-d303aaf4f717 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:57.072720 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 94/185] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 02:11:56 2022] GET /identity/v3/role_assignments?user.id=fc62714d00c54e099b0fa08e0780e91d&scope.project.id=c277629bc0e74ec98f23ed36d4f266d6&role.id=619c0bef418849679ac636aa63923dc9 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:11:57.086670 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 92/186] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 02:11:56 2022] GET /identity/v3/role_assignments?user.id=fc62714d00c54e099b0fa08e0780e91d&scope.project.id=c277629bc0e74ec98f23ed36d4f266d6&role.id=e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:57.738388 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e80757-0a3c-4395-b47d-f432a9ccb03d None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:57.739133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e80757-0a3c-4395-b47d-f432a9ccb03d None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:57.739133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e80757-0a3c-4395-b47d-f432a9ccb03d None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:57.740384 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 95/187] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:57.745444 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e36cb2-e668-4204-9f7c-2feffc467ea6 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:57.745861 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e36cb2-e668-4204-9f7c-2feffc467ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:57.746060 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e36cb2-e668-4204-9f7c-2feffc467ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:57.760819 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e119a0b-bb28-45cd-ac05-81abfb28f2ed None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:57.761108 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e119a0b-bb28-45cd-ac05-81abfb28f2ed None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:57.761365 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e119a0b-bb28-45cd-ac05-81abfb28f2ed None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:57.762845 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 96/188] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 02:11:57.765833 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-42e36cb2-e668-4204-9f7c-2feffc467ea6 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:57.767304 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-42e36cb2-e668-4204-9f7c-2feffc467ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:57.767469 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635d436-7554-47b0-a99a-08deaffb2110 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:57.767752 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635d436-7554-47b0-a99a-08deaffb2110 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:57.768028 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635d436-7554-47b0-a99a-08deaffb2110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:57.787179 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-7635d436-7554-47b0-a99a-08deaffb2110 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:57.788356 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-7635d436-7554-47b0-a99a-08deaffb2110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:57.814447 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:57.842957 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 93/189] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 02:11:57.865517 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 97/190] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 02:11:58.108160 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e36cb2-e668-4204-9f7c-2feffc467ea6 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:58.134533 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635d436-7554-47b0-a99a-08deaffb2110 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:58.184319 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:58.219615 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e36cb2-e668-4204-9f7c-2feffc467ea6 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:58.245885 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635d436-7554-47b0-a99a-08deaffb2110 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:58.256060 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c8b96-31b5-445a-8a8e-b107718b7b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:58.256684 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c8b96-31b5-445a-8a8e-b107718b7b38 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:58.256964 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c8b96-31b5-445a-8a8e-b107718b7b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:58.257234 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c8b96-31b5-445a-8a8e-b107718b7b38 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:58.267868 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c8b96-31b5-445a-8a8e-b107718b7b38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:11:58.272646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-b05c8b96-31b5-445a-8a8e-b107718b7b38 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 02:11:58.272646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:11:58.272646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:11:58.272646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:11:58.272646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:11:58.272646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:11:58.272646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:11:58.272646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:11:58.272646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:11:58.272646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:11:58.272646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:11:58.272646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:11:58.272646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:11:58.272646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:11:58.272646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:11:58.272646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:11:58.273522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:11:58.273522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:11:58.273522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:11:58.273522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:11:58.273522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:11:58.273522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:11:58.273522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:11:58.273522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:11:58.273522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:11:58.273522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:11:58.273522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:11:58.273522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:11:58.273522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:11:58.273522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:11:58.273522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:11:58.273522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:11:58.274320 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:11:58.274320 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:11:58.274320 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:11:58.274320 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:11:58.274320 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:11:58.274320 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:11:58.274320 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:11:58.274320 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:11:58.274320 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:11:58.274320 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:11:58.274320 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 02:11:58.274320 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:11:58.274320 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 94/191] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:11:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:11:58.279438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c8b96-31b5-445a-8a8e-b107718b7b38 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:58.288014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd6ee1-e20b-4247-ba10-dfffe7775890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:58.288649 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd6ee1-e20b-4247-ba10-dfffe7775890 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:58.288921 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd6ee1-e20b-4247-ba10-dfffe7775890 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:58.289190 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd6ee1-e20b-4247-ba10-dfffe7775890 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:58.290364 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd6ee1-e20b-4247-ba10-dfffe7775890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:58.291845 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd6ee1-e20b-4247-ba10-dfffe7775890 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:58.293570 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 98/192] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:11:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:11:58.298699 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd6ee1-e20b-4247-ba10-dfffe7775890 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:58.325765 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:58.391115 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c8b96-31b5-445a-8a8e-b107718b7b38 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:58.409138 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd6ee1-e20b-4247-ba10-dfffe7775890 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:58.424554 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:58.426920 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072101b3-4a77-48b1-8f69-e225ca25ec98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:58.427530 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072101b3-4a77-48b1-8f69-e225ca25ec98 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:58.427803 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072101b3-4a77-48b1-8f69-e225ca25ec98 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:58.428072 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072101b3-4a77-48b1-8f69-e225ca25ec98 None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:58.428730 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072101b3-4a77-48b1-8f69-e225ca25ec98 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:58.429028 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072101b3-4a77-48b1-8f69-e225ca25ec98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:58.430392 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072101b3-4a77-48b1-8f69-e225ca25ec98 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:58.438844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 95/193] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 02:11:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:11:58.440155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359eecb-ce27-40e6-86fb-cd24f0f0df59 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:58.440437 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359eecb-ce27-40e6-86fb-cd24f0f0df59 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:58.440742 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359eecb-ce27-40e6-86fb-cd24f0f0df59 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:58.442138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 96/194] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:11:58.444306 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359eecb-ce27-40e6-86fb-cd24f0f0df59 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:58.448134 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22f8a1-ee43-4aa9-96f2-2ac2f3967d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:58.448740 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22f8a1-ee43-4aa9-96f2-2ac2f3967d92 None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:58.449016 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22f8a1-ee43-4aa9-96f2-2ac2f3967d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:58.449318 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22f8a1-ee43-4aa9-96f2-2ac2f3967d92 None admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:58.450003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22f8a1-ee43-4aa9-96f2-2ac2f3967d92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:58.451458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22f8a1-ee43-4aa9-96f2-2ac2f3967d92 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:58.537248 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 99/195] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 02:11:58 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:11:58.537248 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16517ab6-b122-4de9-bdb7-eba51b587a8c None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:58.537248 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16517ab6-b122-4de9-bdb7-eba51b587a8c None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:58.537248 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16517ab6-b122-4de9-bdb7-eba51b587a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:58.552305 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:58.558391 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-16517ab6-b122-4de9-bdb7-eba51b587a8c None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:11:58.559729 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-16517ab6-b122-4de9-bdb7-eba51b587a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:11:58.563548 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359eecb-ce27-40e6-86fb-cd24f0f0df59 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:58.601119 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b14fb4-c980-4c9e-9d0a-67e568cf1f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:58.603076 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b14fb4-c980-4c9e-9d0a-67e568cf1f0b None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:58.603355 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b14fb4-c980-4c9e-9d0a-67e568cf1f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:58.603622 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b14fb4-c980-4c9e-9d0a-67e568cf1f0b None admin] PATH_INFO: `/v3/users/dd6df7ca0cbb457ab7705f8173ce7f16` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:58.618792 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b14fb4-c980-4c9e-9d0a-67e568cf1f0b None admin] RBAC: Authorizing `identity:get_user(user_id=dd6df7ca0cbb457ab7705f8173ce7f16)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:58.620441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b14fb4-c980-4c9e-9d0a-67e568cf1f0b None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:58.626995 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 97/196] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:11:58 2022] GET /identity/v3/users/dd6df7ca0cbb457ab7705f8173ce7f16 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:11:58.628268 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b14fb4-c980-4c9e-9d0a-67e568cf1f0b None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:58.644888 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 100/197] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:11:58.736841 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b14fb4-c980-4c9e-9d0a-67e568cf1f0b None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:58.772954 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d8d3f-1480-4c64-98ce-6b07b676d567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:58.773581 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d8d3f-1480-4c64-98ce-6b07b676d567 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:58.773847 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d8d3f-1480-4c64-98ce-6b07b676d567 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:58.774111 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d8d3f-1480-4c64-98ce-6b07b676d567 None admin] PATH_INFO: `/v3/projects/c277629bc0e74ec98f23ed36d4f266d6` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:58.775292 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d8d3f-1480-4c64-98ce-6b07b676d567 None admin] RBAC: Authorizing `identity:get_project(project_id=c277629bc0e74ec98f23ed36d4f266d6)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:58.776735 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d8d3f-1480-4c64-98ce-6b07b676d567 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:58.778379 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 98/198] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:11:58 2022] GET /identity/v3/projects/c277629bc0e74ec98f23ed36d4f266d6 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:11:58.784137 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16517ab6-b122-4de9-bdb7-eba51b587a8c None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:58.889791 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:58.892793 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16517ab6-b122-4de9-bdb7-eba51b587a8c None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:58.915343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d8d3f-1480-4c64-98ce-6b07b676d567 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:58.931118 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a946f-adac-4418-aaf0-8b1c8a7cc666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:58.931795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a946f-adac-4418-aaf0-8b1c8a7cc666 None admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:58.932073 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a946f-adac-4418-aaf0-8b1c8a7cc666 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:58.932347 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a946f-adac-4418-aaf0-8b1c8a7cc666 None admin] PATH_INFO: `/v3/projects/c277629bc0e74ec98f23ed36d4f266d6/users/dd6df7ca0cbb457ab7705f8173ce7f16/roles/a2f123a9ec8440cba593773aabc0f2fc` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:58.934687 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a946f-adac-4418-aaf0-8b1c8a7cc666 None admin] RBAC: Authorizing `identity:create_grant(project_id=c277629bc0e74ec98f23ed36d4f266d6, user_id=dd6df7ca0cbb457ab7705f8173ce7f16, role_id=a2f123a9ec8440cba593773aabc0f2fc)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:58.936480 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a946f-adac-4418-aaf0-8b1c8a7cc666 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:58.946883 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:59.017605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d8d3f-1480-4c64-98ce-6b07b676d567 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:59.030436 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 101/199] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 02:11:58 2022] PUT /identity/v3/projects/c277629bc0e74ec98f23ed36d4f266d6/users/dd6df7ca0cbb457ab7705f8173ce7f16/roles/a2f123a9ec8440cba593773aabc0f2fc => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:11:59.065366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da78c0-7ab3-4ed3-914b-75642b17ceef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:59.066956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da78c0-7ab3-4ed3-914b-75642b17ceef None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:59.067430 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da78c0-7ab3-4ed3-914b-75642b17ceef None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:59.067866 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da78c0-7ab3-4ed3-914b-75642b17ceef None admin] PATH_INFO: `/v3/roles/member` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:59.081037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da78c0-7ab3-4ed3-914b-75642b17ceef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:11:59.087464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-76da78c0-7ab3-4ed3-914b-75642b17ceef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:11:59.087464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:11:59.087464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:11:59.087464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:11:59.087464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:11:59.087464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:11:59.087464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:11:59.087464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:11:59.087464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:11:59.087464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:11:59.087464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:11:59.087464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:11:59.087464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:11:59.087464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:11:59.087464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:11:59.087464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:11:59.088443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:11:59.088443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:11:59.088443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:11:59.088443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:11:59.088443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:11:59.088443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:11:59.088443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:11:59.088443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:11:59.088443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:11:59.088443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:11:59.088443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:11:59.088443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:11:59.088443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:11:59.088443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:11:59.088443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:11:59.088443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:11:59.089245 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:11:59.089245 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:11:59.089245 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:11:59.089245 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:11:59.089245 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:11:59.089245 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:11:59.089245 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:11:59.089245 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:11:59.089245 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:11:59.089245 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:11:59.089245 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:11:59.089245 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:11:59.093398 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 99/200] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:11:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:11:59.100074 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a946f-adac-4418-aaf0-8b1c8a7cc666 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:59.223418 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a946f-adac-4418-aaf0-8b1c8a7cc666 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:59.261730 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47bd02-dbce-44a6-8791-209932bd9741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:59.262347 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47bd02-dbce-44a6-8791-209932bd9741 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:59.262625 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47bd02-dbce-44a6-8791-209932bd9741 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:59.262927 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47bd02-dbce-44a6-8791-209932bd9741 None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:59.263657 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47bd02-dbce-44a6-8791-209932bd9741 None admin] RBAC: Adding query filter params (name=member) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:11:59.263965 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47bd02-dbce-44a6-8791-209932bd9741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:59.265436 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47bd02-dbce-44a6-8791-209932bd9741 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:59.275076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 102/201] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 02:11:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:59.280786 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da78c0-7ab3-4ed3-914b-75642b17ceef None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:59.379554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:59.395370 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da78c0-7ab3-4ed3-914b-75642b17ceef None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:59.432541 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801efe3-fe72-4b4f-a7b0-c422d15a7b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:59.433525 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801efe3-fe72-4b4f-a7b0-c422d15a7b45 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:59.433978 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801efe3-fe72-4b4f-a7b0-c422d15a7b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:59.434473 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801efe3-fe72-4b4f-a7b0-c422d15a7b45 None admin] PATH_INFO: `/v3/users/0130c15fccfd4695ab47e0f8354b0b84` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:59.436125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801efe3-fe72-4b4f-a7b0-c422d15a7b45 None admin] RBAC: Authorizing `identity:get_user(user_id=0130c15fccfd4695ab47e0f8354b0b84)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:59.437756 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801efe3-fe72-4b4f-a7b0-c422d15a7b45 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:59.439553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 100/202] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:11:59 2022] GET /identity/v3/users/0130c15fccfd4695ab47e0f8354b0b84 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:59.447832 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47bd02-dbce-44a6-8791-209932bd9741 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:59.472898 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:59.555315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47bd02-dbce-44a6-8791-209932bd9741 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:59.591272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f6564-8f34-4ffa-a426-de7b40ffc1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:59.592157 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f6564-8f34-4ffa-a426-de7b40ffc1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:59.592581 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f6564-8f34-4ffa-a426-de7b40ffc1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:59.592994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f6564-8f34-4ffa-a426-de7b40ffc1f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:59.665334 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f6564-8f34-4ffa-a426-de7b40ffc1f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:59.667090 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f6564-8f34-4ffa-a426-de7b40ffc1f9 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:59.691363 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:59.771862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 103/203] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:11:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:59.777239 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801efe3-fe72-4b4f-a7b0-c422d15a7b45 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:11:59.883653 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801efe3-fe72-4b4f-a7b0-c422d15a7b45 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:11:59.919670 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66757a69-56e7-4d94-800f-b52daf28f072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:11:59.920305 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66757a69-56e7-4d94-800f-b52daf28f072 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:11:59.920581 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66757a69-56e7-4d94-800f-b52daf28f072 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:11:59.920854 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66757a69-56e7-4d94-800f-b52daf28f072 None admin] PATH_INFO: `/v3/projects/c277629bc0e74ec98f23ed36d4f266d6` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:11:59.922033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66757a69-56e7-4d94-800f-b52daf28f072 None admin] RBAC: Authorizing `identity:get_project(project_id=c277629bc0e74ec98f23ed36d4f266d6)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:11:59.923526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66757a69-56e7-4d94-800f-b52daf28f072 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:11:59.925656 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 101/204] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:11:59 2022] GET /identity/v3/projects/c277629bc0e74ec98f23ed36d4f266d6 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:11:59.931332 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f6564-8f34-4ffa-a426-de7b40ffc1f9 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:00.035900 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f6564-8f34-4ffa-a426-de7b40ffc1f9 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:00.059166 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:00.070986 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481e716-7280-44b7-aedb-4a961a3f0f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:00.079709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481e716-7280-44b7-aedb-4a961a3f0f74 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:00.079709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481e716-7280-44b7-aedb-4a961a3f0f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:00.079709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481e716-7280-44b7-aedb-4a961a3f0f74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:00.079709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481e716-7280-44b7-aedb-4a961a3f0f74 None admin] RBAC: Adding query filter params (role.id=bacc420f29704ec89e015525d8143d62, scope.project.id=c277629bc0e74ec98f23ed36d4f266d6, user.id=0130c15fccfd4695ab47e0f8354b0b84) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:00.079709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481e716-7280-44b7-aedb-4a961a3f0f74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:00.079709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481e716-7280-44b7-aedb-4a961a3f0f74 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:00.080694 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 104/205] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 02:11:59 2022] GET /identity/v3/role_assignments?user.id=0130c15fccfd4695ab47e0f8354b0b84&scope.project.id=c277629bc0e74ec98f23ed36d4f266d6&role.id=bacc420f29704ec89e015525d8143d62 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:00.873507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969abfb-6e17-47cc-931b-39b3f8a2da90 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:00.874027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969abfb-6e17-47cc-931b-39b3f8a2da90 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:00.874027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969abfb-6e17-47cc-931b-39b3f8a2da90 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:00.875556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 102/206] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:00.881004 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cc828-4b4d-46cc-9bfb-ed105490a560 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:00.881294 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cc828-4b4d-46cc-9bfb-ed105490a560 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:00.881566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cc828-4b4d-46cc-9bfb-ed105490a560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:00.900377 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-c16cc828-4b4d-46cc-9bfb-ed105490a560 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:00.901564 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-c16cc828-4b4d-46cc-9bfb-ed105490a560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:00.975391 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 105/207] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:01.035799 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5be2d-2182-4517-b691-0fd02d592eaa None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:01.036093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5be2d-2182-4517-b691-0fd02d592eaa None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:01.036349 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5be2d-2182-4517-b691-0fd02d592eaa None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:01.037840 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 103/208] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:01.042842 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d302c40-6c6b-4166-aa82-a0325adb9b08 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:01.043151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d302c40-6c6b-4166-aa82-a0325adb9b08 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:01.043423 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d302c40-6c6b-4166-aa82-a0325adb9b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:01.064919 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-1d302c40-6c6b-4166-aa82-a0325adb9b08 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:01.067090 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-1d302c40-6c6b-4166-aa82-a0325adb9b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:01.135320 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 106/209] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:01.243205 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5be2d-2182-4517-b691-0fd02d592eaa None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:01.261215 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330b525-72f3-4052-b4d0-34c3c83a3958 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:01.261591 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330b525-72f3-4052-b4d0-34c3c83a3958 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:01.261768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330b525-72f3-4052-b4d0-34c3c83a3958 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:01.263274 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 107/210] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:01.267912 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956956dd-c0d0-453c-9438-0de9837808f9 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:01.268200 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956956dd-c0d0-453c-9438-0de9837808f9 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:01.274290 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956956dd-c0d0-453c-9438-0de9837808f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:01.274394 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:01.287556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-956956dd-c0d0-453c-9438-0de9837808f9 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:01.288744 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-956956dd-c0d0-453c-9438-0de9837808f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:01.334874 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:01.351130 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5be2d-2182-4517-b691-0fd02d592eaa None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:01.363167 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 108/211] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 02:12:01.386284 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c8d3d-57f9-4799-9b9a-b0c01eb61750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:01.386869 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c8d3d-57f9-4799-9b9a-b0c01eb61750 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:01.387152 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c8d3d-57f9-4799-9b9a-b0c01eb61750 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:01.387424 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c8d3d-57f9-4799-9b9a-b0c01eb61750 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:01.397542 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c8d3d-57f9-4799-9b9a-b0c01eb61750 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:01.402313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-757c8d3d-57f9-4799-9b9a-b0c01eb61750 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:12:01.402313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:01.402313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:01.402313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:01.402313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:01.402313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:01.402313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:01.402313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:01.402313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:01.402313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:01.402313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:01.402313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:01.402313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:01.402313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:01.402313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:01.402313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:01.403222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:01.403222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:01.403222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:01.403222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:01.403222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:01.403222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:01.403222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:01.403222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:01.403222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:01.403222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:01.403222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:01.403222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:01.403222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:01.403222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:01.403222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:01.403222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:01.404010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:01.404010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:01.404010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:01.404010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:01.404010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:01.404010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:01.404010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:01.404010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:01.404010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:01.404010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:01.404010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:12:01.404010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:01.404010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 104/212] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:12:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:01.408104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956956dd-c0d0-453c-9438-0de9837808f9 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:01.410784 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c8d3d-57f9-4799-9b9a-b0c01eb61750 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:01.492819 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:01.511275 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c8d3d-57f9-4799-9b9a-b0c01eb61750 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:01.519314 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956956dd-c0d0-453c-9438-0de9837808f9 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:01.548277 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede7ba0-5176-4f6c-9069-dd7c48b54d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:01.548879 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede7ba0-5176-4f6c-9069-dd7c48b54d98 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:01.549157 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede7ba0-5176-4f6c-9069-dd7c48b54d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:01.549424 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede7ba0-5176-4f6c-9069-dd7c48b54d98 None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:01.550114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede7ba0-5176-4f6c-9069-dd7c48b54d98 None admin] RBAC: Adding query filter params (name=member) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:01.550402 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede7ba0-5176-4f6c-9069-dd7c48b54d98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:01.551809 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede7ba0-5176-4f6c-9069-dd7c48b54d98 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:01.560973 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 105/213] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 02:12:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:01.561552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e9a59-817b-47a5-a4c9-ad6b5d8fbfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:01.562214 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e9a59-817b-47a5-a4c9-ad6b5d8fbfd7 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:01.562494 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e9a59-817b-47a5-a4c9-ad6b5d8fbfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:01.562768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e9a59-817b-47a5-a4c9-ad6b5d8fbfd7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:01.566333 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e9a59-817b-47a5-a4c9-ad6b5d8fbfd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:01.567061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede7ba0-5176-4f6c-9069-dd7c48b54d98 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:01.567807 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e9a59-817b-47a5-a4c9-ad6b5d8fbfd7 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:01.569511 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 109/214] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:01.574581 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e9a59-817b-47a5-a4c9-ad6b5d8fbfd7 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:01.623895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:01.671837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede7ba0-5176-4f6c-9069-dd7c48b54d98 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:01.680555 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e9a59-817b-47a5-a4c9-ad6b5d8fbfd7 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:01.703942 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7df7a7-8c87-4fb6-9306-79b480b4ed05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:01.704565 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7df7a7-8c87-4fb6-9306-79b480b4ed05 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:01.704871 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7df7a7-8c87-4fb6-9306-79b480b4ed05 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:01.705144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7df7a7-8c87-4fb6-9306-79b480b4ed05 None admin] PATH_INFO: `/v3/users/deb00057363f4d078350c0db2481be40` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:01.714925 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f49e9b-b3e4-45aa-a91b-2666934ed216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:01.715526 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f49e9b-b3e4-45aa-a91b-2666934ed216 None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:01.715800 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f49e9b-b3e4-45aa-a91b-2666934ed216 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:01.716069 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f49e9b-b3e4-45aa-a91b-2666934ed216 None admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:01.716708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f49e9b-b3e4-45aa-a91b-2666934ed216 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:01.718174 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f49e9b-b3e4-45aa-a91b-2666934ed216 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:01.718928 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7df7a7-8c87-4fb6-9306-79b480b4ed05 None admin] RBAC: Authorizing `identity:get_user(user_id=deb00057363f4d078350c0db2481be40)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:01.720379 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7df7a7-8c87-4fb6-9306-79b480b4ed05 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:01.722981 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 106/215] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:12:01 2022] GET /identity/v3/users/deb00057363f4d078350c0db2481be40 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:01.723576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7df7a7-8c87-4fb6-9306-79b480b4ed05 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:01.726052 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:01.821479 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7df7a7-8c87-4fb6-9306-79b480b4ed05 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:01.855177 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4406504-562e-478b-9f87-faa91580a35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:01.855793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4406504-562e-478b-9f87-faa91580a35c None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:01.856067 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4406504-562e-478b-9f87-faa91580a35c None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:01.856332 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4406504-562e-478b-9f87-faa91580a35c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:01.866754 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4406504-562e-478b-9f87-faa91580a35c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:01.872096 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-a4406504-562e-478b-9f87-faa91580a35c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 02:12:01.872096 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:01.872096 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:01.872096 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:01.872096 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:01.872096 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:01.872096 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:01.872096 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:01.872096 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:01.872096 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:01.872096 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:01.872096 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:01.872096 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:01.872096 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:01.872096 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:01.872096 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:01.873258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:01.873258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:01.873258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:01.873258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:01.873258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:01.873258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:01.873258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:01.873258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:01.873258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:01.873258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:01.873258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:01.873258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:01.873258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:01.873258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:01.873258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:01.873258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:01.874669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:01.874669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:01.874669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:01.874669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:01.874669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:01.874669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:01.874669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:01.874669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:01.874669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:01.874669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:01.874669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 02:12:01.874669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:01.880134 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 110/216] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 02:12:01 2022] POST /identity/v3/users => generated 293 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:12:01.880211 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 107/217] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:12:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:01.880277 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f49e9b-b3e4-45aa-a91b-2666934ed216 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:01.880341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4406504-562e-478b-9f87-faa91580a35c None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:01.953538 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:01.996677 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:01.998694 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4406504-562e-478b-9f87-faa91580a35c None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:01.999728 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f49e9b-b3e4-45aa-a91b-2666934ed216 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:02.038043 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf76b7-e2ec-4c99-a3d6-ad583f1ad4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:02.038752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf76b7-e2ec-4c99-a3d6-ad583f1ad4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:02.039068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf76b7-e2ec-4c99-a3d6-ad583f1ad4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:02.039343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf76b7-e2ec-4c99-a3d6-ad583f1ad4e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:02.040118 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf76b7-e2ec-4c99-a3d6-ad583f1ad4e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:02.040354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd52fbc-22e6-49f6-b55e-f1fc2ed1e65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:02.040474 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf76b7-e2ec-4c99-a3d6-ad583f1ad4e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:02.040966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd52fbc-22e6-49f6-b55e-f1fc2ed1e65c None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:02.041241 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd52fbc-22e6-49f6-b55e-f1fc2ed1e65c None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:02.041511 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd52fbc-22e6-49f6-b55e-f1fc2ed1e65c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:02.041792 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf76b7-e2ec-4c99-a3d6-ad583f1ad4e5 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:02.042636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd52fbc-22e6-49f6-b55e-f1fc2ed1e65c None admin] RBAC: Adding query filter params (role.id=bacc420f29704ec89e015525d8143d62, user.id=deb00057363f4d078350c0db2481be40, scope.system=all) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:02.042636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd52fbc-22e6-49f6-b55e-f1fc2ed1e65c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:02.044861 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd52fbc-22e6-49f6-b55e-f1fc2ed1e65c None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:02.051515 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 108/218] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 02:12:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:02.051820 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 111/219] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Oct 19 02:12:01 2022] GET /identity/v3/role_assignments?user.id=deb00057363f4d078350c0db2481be40&scope.system=all&role.id=bacc420f29704ec89e015525d8143d62 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:02.060466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf76b7-e2ec-4c99-a3d6-ad583f1ad4e5 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:02.178746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf76b7-e2ec-4c99-a3d6-ad583f1ad4e5 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:02.207380 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:02.227162 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad5bdb-03a6-42e7-b309-5b65972e6645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:02.227817 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad5bdb-03a6-42e7-b309-5b65972e6645 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:02.229221 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad5bdb-03a6-42e7-b309-5b65972e6645 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:02.229221 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad5bdb-03a6-42e7-b309-5b65972e6645 None admin] PATH_INFO: `/v3/users/dd6df7ca0cbb457ab7705f8173ce7f16` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:02.229511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad5bdb-03a6-42e7-b309-5b65972e6645 None admin] RBAC: Authorizing `identity:get_user(user_id=dd6df7ca0cbb457ab7705f8173ce7f16)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:02.231063 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad5bdb-03a6-42e7-b309-5b65972e6645 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:02.232971 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 109/220] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:12:02 2022] GET /identity/v3/users/dd6df7ca0cbb457ab7705f8173ce7f16 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:02.238699 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd52fbc-22e6-49f6-b55e-f1fc2ed1e65c None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:02.347061 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd52fbc-22e6-49f6-b55e-f1fc2ed1e65c None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:02.383713 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ac5f2-897f-4239-b4b0-51d895508820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:02.384674 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ac5f2-897f-4239-b4b0-51d895508820 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:02.385146 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ac5f2-897f-4239-b4b0-51d895508820 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:02.385636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ac5f2-897f-4239-b4b0-51d895508820 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:02.418657 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:02.459966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ac5f2-897f-4239-b4b0-51d895508820 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:02.461339 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ac5f2-897f-4239-b4b0-51d895508820 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:02.564449 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 112/221] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:12:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:02.570594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad5bdb-03a6-42e7-b309-5b65972e6645 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:02.683227 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad5bdb-03a6-42e7-b309-5b65972e6645 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:02.721190 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de964a2-7190-4620-b9df-37cd80324a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:02.722512 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de964a2-7190-4620-b9df-37cd80324a34 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:02.722793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de964a2-7190-4620-b9df-37cd80324a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:02.723090 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de964a2-7190-4620-b9df-37cd80324a34 None admin] PATH_INFO: `/v3/projects/c277629bc0e74ec98f23ed36d4f266d6` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:02.724266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de964a2-7190-4620-b9df-37cd80324a34 None admin] RBAC: Authorizing `identity:get_project(project_id=c277629bc0e74ec98f23ed36d4f266d6)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:02.725713 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de964a2-7190-4620-b9df-37cd80324a34 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:02.727697 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 110/222] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:12:02 2022] GET /identity/v3/projects/c277629bc0e74ec98f23ed36d4f266d6 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:02.733527 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ac5f2-897f-4239-b4b0-51d895508820 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:02.803050 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:02.845881 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ac5f2-897f-4239-b4b0-51d895508820 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:02.884375 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75239f14-0d86-421e-be50-da68e7ca1d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:02.885332 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75239f14-0d86-421e-be50-da68e7ca1d07 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:02.885820 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75239f14-0d86-421e-be50-da68e7ca1d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:02.886316 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75239f14-0d86-421e-be50-da68e7ca1d07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:02.887331 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75239f14-0d86-421e-be50-da68e7ca1d07 None admin] RBAC: Adding query filter params (role.id=a2f123a9ec8440cba593773aabc0f2fc, scope.project.id=c277629bc0e74ec98f23ed36d4f266d6, user.id=dd6df7ca0cbb457ab7705f8173ce7f16) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:02.887831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75239f14-0d86-421e-be50-da68e7ca1d07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:02.889483 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75239f14-0d86-421e-be50-da68e7ca1d07 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:02.896528 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 113/223] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 02:12:02 2022] GET /identity/v3/role_assignments?user.id=dd6df7ca0cbb457ab7705f8173ce7f16&scope.project.id=c277629bc0e74ec98f23ed36d4f266d6&role.id=a2f123a9ec8440cba593773aabc0f2fc => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:04.248370 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b98060-bf42-4ee4-88c8-363f075aeb4b None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:04.248875 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b98060-bf42-4ee4-88c8-363f075aeb4b None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:04.248972 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b98060-bf42-4ee4-88c8-363f075aeb4b None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:04.250301 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 111/224] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:04.255525 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081eff8-804c-445b-bfb7-b87c95c29b03 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:04.255926 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081eff8-804c-445b-bfb7-b87c95c29b03 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:04.256088 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081eff8-804c-445b-bfb7-b87c95c29b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:04.274415 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-d081eff8-804c-445b-bfb7-b87c95c29b03 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:04.275698 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-d081eff8-804c-445b-bfb7-b87c95c29b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:04.277431 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c8541-d1b6-49ef-aaeb-4d1a4ba29433 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:04.277715 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c8541-d1b6-49ef-aaeb-4d1a4ba29433 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:04.278309 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c8541-d1b6-49ef-aaeb-4d1a4ba29433 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:04.280570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 112/225] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 02:12:04.286484 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d62a3-68ad-4e79-9428-ac8f18cbb2e5 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:04.286763 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d62a3-68ad-4e79-9428-ac8f18cbb2e5 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:04.287483 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d62a3-68ad-4e79-9428-ac8f18cbb2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:04.307094 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-271d62a3-68ad-4e79-9428-ac8f18cbb2e5 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:04.308376 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-271d62a3-68ad-4e79-9428-ac8f18cbb2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:04.347562 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 114/226] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:04.349988 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53305b9e-cdef-4881-801d-955d5aefdca2 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:04.350275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53305b9e-cdef-4881-801d-955d5aefdca2 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:04.350546 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53305b9e-cdef-4881-801d-955d5aefdca2 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:04.351990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 115/227] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:04.357024 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169647a-5c18-4a4b-8544-f8df673e83b9 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:04.357301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169647a-5c18-4a4b-8544-f8df673e83b9 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:04.357570 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169647a-5c18-4a4b-8544-f8df673e83b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:04.366924 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:04.375399 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-7169647a-5c18-4a4b-8544-f8df673e83b9 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:04.376626 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-7169647a-5c18-4a4b-8544-f8df673e83b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:04.378355 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 113/228] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 02:12:04.435721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:04.449450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 116/229] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 02:12:04.616789 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d62a3-68ad-4e79-9428-ac8f18cbb2e5 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:04.644797 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169647a-5c18-4a4b-8544-f8df673e83b9 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:04.720777 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d62a3-68ad-4e79-9428-ac8f18cbb2e5 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:04.750249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169647a-5c18-4a4b-8544-f8df673e83b9 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:04.756006 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa99b5-3a38-4d96-9955-bd7108fafceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:04.756636 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa99b5-3a38-4d96-9955-bd7108fafceb None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:04.756916 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa99b5-3a38-4d96-9955-bd7108fafceb None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:04.757187 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa99b5-3a38-4d96-9955-bd7108fafceb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:04.767418 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa99b5-3a38-4d96-9955-bd7108fafceb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:04.772448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-d5aa99b5-3a38-4d96-9955-bd7108fafceb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:12:04.772448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:04.772448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:04.772448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:04.772448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:04.772448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:04.772448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:04.772448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:04.772448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:04.772448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:04.772448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:04.772448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:04.772448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:04.772448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:04.772448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:04.772448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:04.773325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:04.773325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:04.773325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:04.773325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:04.773325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:04.773325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:04.773325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:04.773325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:04.773325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:04.773325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:04.773325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:04.773325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:04.773325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:04.773325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:04.773325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:04.773325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:04.774127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:04.774127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:04.774127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:04.774127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:04.774127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:04.774127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:04.774127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:04.774127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:04.774127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:04.774127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:04.774127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:12:04.774127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:04.774127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 114/230] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:12:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:04.774779 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa99b5-3a38-4d96-9955-bd7108fafceb None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:04.786709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e59cbf-f478-4c4e-8626-c6d5fc33e715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:04.787433 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e59cbf-f478-4c4e-8626-c6d5fc33e715 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:04.787714 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e59cbf-f478-4c4e-8626-c6d5fc33e715 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:04.787981 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e59cbf-f478-4c4e-8626-c6d5fc33e715 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:04.797810 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e59cbf-f478-4c4e-8626-c6d5fc33e715 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:04.803316 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-d1e59cbf-f478-4c4e-8626-c6d5fc33e715 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 02:12:04.803316 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:04.803316 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:04.803316 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:04.803316 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:04.803316 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:04.803316 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:04.803316 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:04.803316 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:04.803316 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:04.803316 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:04.803316 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:04.803316 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:04.803316 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:04.803316 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:04.803316 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:04.804270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:04.804270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:04.804270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:04.804270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:04.804270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:04.804270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:04.804270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:04.804270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:04.804270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:04.804270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:04.804270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:04.804270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:04.804270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:04.804270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:04.804270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:04.804270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:04.809973 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:04.809973 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:04.809973 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:04.809973 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:04.809973 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:04.809973 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:04.809973 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:04.809973 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:04.809973 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:04.809973 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:04.809973 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 02:12:04.809973 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:04.809973 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 117/231] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:12:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:12:04.809973 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e59cbf-f478-4c4e-8626-c6d5fc33e715 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:04.824241 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:04.856858 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:04.874277 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa99b5-3a38-4d96-9955-bd7108fafceb None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:04.907034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e59cbf-f478-4c4e-8626-c6d5fc33e715 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:04.907935 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cce179-7ee9-4f0e-adc8-ff0bbc04447e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:04.908564 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cce179-7ee9-4f0e-adc8-ff0bbc04447e None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:04.908864 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cce179-7ee9-4f0e-adc8-ff0bbc04447e None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:04.909670 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cce179-7ee9-4f0e-adc8-ff0bbc04447e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:04.910805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cce179-7ee9-4f0e-adc8-ff0bbc04447e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:04.912282 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cce179-7ee9-4f0e-adc8-ff0bbc04447e None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:04.913881 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 115/232] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:04.914639 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cce179-7ee9-4f0e-adc8-ff0bbc04447e None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:04.942573 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b4721-624d-4f13-ae14-8fd1997454bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:04.943204 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b4721-624d-4f13-ae14-8fd1997454bf None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:04.943481 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b4721-624d-4f13-ae14-8fd1997454bf None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:04.943748 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b4721-624d-4f13-ae14-8fd1997454bf None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:04.944410 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b4721-624d-4f13-ae14-8fd1997454bf None admin] RBAC: Adding query filter params (name=member) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:04.944708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b4721-624d-4f13-ae14-8fd1997454bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:04.946072 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b4721-624d-4f13-ae14-8fd1997454bf None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:04.953923 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 118/233] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 02:12:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:04.953923 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b4721-624d-4f13-ae14-8fd1997454bf None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:05.013462 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cce179-7ee9-4f0e-adc8-ff0bbc04447e None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:05.030479 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:05.047017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870fd22a-d7b3-4dfa-8d60-b9a967f04b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:05.047614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fd22a-d7b3-4dfa-8d60-b9a967f04b32 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:05.047889 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fd22a-d7b3-4dfa-8d60-b9a967f04b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:05.048156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fd22a-d7b3-4dfa-8d60-b9a967f04b32 None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:05.048817 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870fd22a-d7b3-4dfa-8d60-b9a967f04b32 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:05.049115 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870fd22a-d7b3-4dfa-8d60-b9a967f04b32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:05.050524 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870fd22a-d7b3-4dfa-8d60-b9a967f04b32 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:05.055999 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b4721-624d-4f13-ae14-8fd1997454bf None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:05.058868 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 116/234] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 02:12:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:05.059749 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870fd22a-d7b3-4dfa-8d60-b9a967f04b32 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:05.068240 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:05.091359 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a72c96-f3f3-4de7-b6a6-0543f5f3e85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:05.091966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a72c96-f3f3-4de7-b6a6-0543f5f3e85f None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:05.092242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a72c96-f3f3-4de7-b6a6-0543f5f3e85f None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:05.092511 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a72c96-f3f3-4de7-b6a6-0543f5f3e85f None admin] PATH_INFO: `/v3/groups` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:05.093136 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a72c96-f3f3-4de7-b6a6-0543f5f3e85f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:05.094659 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a72c96-f3f3-4de7-b6a6-0543f5f3e85f None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:05.158495 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870fd22a-d7b3-4dfa-8d60-b9a967f04b32 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:05.170157 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 119/235] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Oct 19 02:12:04 2022] POST /identity/v3/groups => generated 229 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:12:05.171021 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a72c96-f3f3-4de7-b6a6-0543f5f3e85f None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:05.198238 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01860341-f939-4f4a-944a-32bc2f7822c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:05.198987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01860341-f939-4f4a-944a-32bc2f7822c8 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:05.199265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01860341-f939-4f4a-944a-32bc2f7822c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:05.199532 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01860341-f939-4f4a-944a-32bc2f7822c8 None admin] PATH_INFO: `/v3/users/deb00057363f4d078350c0db2481be40` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:05.200887 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01860341-f939-4f4a-944a-32bc2f7822c8 None admin] RBAC: Authorizing `identity:get_user(user_id=deb00057363f4d078350c0db2481be40)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:05.202410 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01860341-f939-4f4a-944a-32bc2f7822c8 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:05.204407 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 117/236] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:12:05 2022] GET /identity/v3/users/deb00057363f4d078350c0db2481be40 => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:05.211435 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01860341-f939-4f4a-944a-32bc2f7822c8 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:05.267306 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:05.313170 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a72c96-f3f3-4de7-b6a6-0543f5f3e85f None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:05.331128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01860341-f939-4f4a-944a-32bc2f7822c8 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:05.353697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed39478-6825-416b-b2ce-73202130bf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:05.353697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed39478-6825-416b-b2ce-73202130bf63 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:05.353984 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed39478-6825-416b-b2ce-73202130bf63 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:05.354066 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed39478-6825-416b-b2ce-73202130bf63 None admin] PATH_INFO: `/v3/users/2542597145aa47f8b695c022fe3f0bed` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:05.368960 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed39478-6825-416b-b2ce-73202130bf63 None admin] RBAC: Authorizing `identity:get_user(user_id=2542597145aa47f8b695c022fe3f0bed)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:05.370483 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed39478-6825-416b-b2ce-73202130bf63 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:05.372360 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 120/237] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:12:05 2022] GET /identity/v3/users/2542597145aa47f8b695c022fe3f0bed => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:05.376532 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0495be7-5b04-4f81-87af-bf3730731fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:05.377285 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0495be7-5b04-4f81-87af-bf3730731fa1 None admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:05.377566 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0495be7-5b04-4f81-87af-bf3730731fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:05.378434 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0495be7-5b04-4f81-87af-bf3730731fa1 None admin] PATH_INFO: `/v3/system/users/deb00057363f4d078350c0db2481be40/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:05.378534 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed39478-6825-416b-b2ce-73202130bf63 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:05.380751 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0495be7-5b04-4f81-87af-bf3730731fa1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=deb00057363f4d078350c0db2481be40, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:05.382171 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0495be7-5b04-4f81-87af-bf3730731fa1 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:05.414886 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:05.462750 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 118/238] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Oct 19 02:12:05 2022] PUT /identity/v3/system/users/deb00057363f4d078350c0db2481be40/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:12:05.493812 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed39478-6825-416b-b2ce-73202130bf63 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:05.534933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348b498-fe95-4541-b1b9-f88ca7a5330e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:05.535672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348b498-fe95-4541-b1b9-f88ca7a5330e None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:05.535952 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348b498-fe95-4541-b1b9-f88ca7a5330e None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:05.536222 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348b498-fe95-4541-b1b9-f88ca7a5330e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:05.537057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348b498-fe95-4541-b1b9-f88ca7a5330e None admin] RBAC: Adding query filter params (role.id=a2f123a9ec8440cba593773aabc0f2fc, user.id=2542597145aa47f8b695c022fe3f0bed, scope.system=all) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:05.537398 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348b498-fe95-4541-b1b9-f88ca7a5330e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:05.538977 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348b498-fe95-4541-b1b9-f88ca7a5330e None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:05.550849 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 121/239] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Oct 19 02:12:05 2022] GET /identity/v3/role_assignments?user.id=2542597145aa47f8b695c022fe3f0bed&scope.system=all&role.id=a2f123a9ec8440cba593773aabc0f2fc => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:07.375849 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d93a3e-30e1-40da-a849-7246a7ba447a None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:07.376366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d93a3e-30e1-40da-a849-7246a7ba447a None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:07.376366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d93a3e-30e1-40da-a849-7246a7ba447a None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:07.378846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 119/240] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:07.383980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47aa11-7292-4a52-bdae-fb900835d460 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:07.384399 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47aa11-7292-4a52-bdae-fb900835d460 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:07.384561 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47aa11-7292-4a52-bdae-fb900835d460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:07.403043 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-4d47aa11-7292-4a52-bdae-fb900835d460 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:07.404234 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-4d47aa11-7292-4a52-bdae-fb900835d460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:07.475382 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 122/241] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:07.657548 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1d69b-cefd-4e77-8563-a8ea118067ec None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:07.657903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1d69b-cefd-4e77-8563-a8ea118067ec None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:07.658102 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1d69b-cefd-4e77-8563-a8ea118067ec None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:07.660878 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 120/242] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:07.665896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d72914-1f2b-4e0a-b16a-8564ced2edea None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:07.666185 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d72914-1f2b-4e0a-b16a-8564ced2edea None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:07.666457 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d72914-1f2b-4e0a-b16a-8564ced2edea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:07.685083 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-55d72914-1f2b-4e0a-b16a-8564ced2edea None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:07.686511 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-55d72914-1f2b-4e0a-b16a-8564ced2edea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:07.703769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:07.714260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b0995-5f62-4587-8df4-946217f5ed3e None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:07.714623 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b0995-5f62-4587-8df4-946217f5ed3e None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:07.714933 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b0995-5f62-4587-8df4-946217f5ed3e None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:07.717631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 121/243] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 02:12:07.721214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53788182-3735-41ea-b04e-6a252951a8c0 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:07.722101 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53788182-3735-41ea-b04e-6a252951a8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:07.722546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53788182-3735-41ea-b04e-6a252951a8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:07.741723 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-53788182-3735-41ea-b04e-6a252951a8c0 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:07.742879 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-53788182-3735-41ea-b04e-6a252951a8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:07.760152 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 123/244] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:07.761150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d72914-1f2b-4e0a-b16a-8564ced2edea None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:07.814740 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 122/245] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 02:12:07.875141 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d72914-1f2b-4e0a-b16a-8564ced2edea None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:07.911057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1a277-1ec2-4ae1-82c7-0ab9aa82c92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:07.911685 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1a277-1ec2-4ae1-82c7-0ab9aa82c92a None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:07.911962 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1a277-1ec2-4ae1-82c7-0ab9aa82c92a None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:07.912231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1a277-1ec2-4ae1-82c7-0ab9aa82c92a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:07.913321 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1a277-1ec2-4ae1-82c7-0ab9aa82c92a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:07.914751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1a277-1ec2-4ae1-82c7-0ab9aa82c92a None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:07.916493 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 124/246] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:07.921859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53788182-3735-41ea-b04e-6a252951a8c0 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:07.965926 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:08.023432 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53788182-3735-41ea-b04e-6a252951a8c0 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:08.028284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1a277-1ec2-4ae1-82c7-0ab9aa82c92a None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:08.053557 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:08.063435 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3866f2-b1a8-40a5-bc53-51ba893be873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:08.064042 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3866f2-b1a8-40a5-bc53-51ba893be873 None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:08.064316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3866f2-b1a8-40a5-bc53-51ba893be873 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:08.064583 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3866f2-b1a8-40a5-bc53-51ba893be873 None admin] PATH_INFO: `/v3/groups` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:08.068324 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3866f2-b1a8-40a5-bc53-51ba893be873 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:08.068324 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3866f2-b1a8-40a5-bc53-51ba893be873 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:08.135639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1a277-1ec2-4ae1-82c7-0ab9aa82c92a None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:08.168623 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 123/247] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Oct 19 02:12:07 2022] POST /identity/v3/groups => generated 226 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:12:08.170186 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787ea97-7895-4833-8546-0e272085dd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:08.170843 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787ea97-7895-4833-8546-0e272085dd08 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:08.171138 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787ea97-7895-4833-8546-0e272085dd08 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:08.171403 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787ea97-7895-4833-8546-0e272085dd08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:08.176262 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3866f2-b1a8-40a5-bc53-51ba893be873 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:08.183717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787ea97-7895-4833-8546-0e272085dd08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:08.189194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-c787ea97-7895-4833-8546-0e272085dd08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:12:08.189194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:08.189194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:08.189194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:08.189194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:08.189194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:08.189194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:08.189194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:08.189194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:08.189194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:08.189194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:08.189194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:08.189194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:08.189194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:08.189194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:08.189194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:08.190187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:08.190187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:08.190187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:08.190187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:08.190187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:08.190187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:08.190187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:08.190187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:08.190187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:08.190187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:08.190187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:08.190187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:08.190187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:08.190187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:08.190187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:08.190187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:08.195651 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:08.195651 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:08.195651 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:08.195651 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:08.195651 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:08.195651 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:08.195651 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:08.195651 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:08.195651 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:08.195651 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:08.195651 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:12:08.195651 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:08.195651 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 125/248] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:12:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:12:08.196904 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787ea97-7895-4833-8546-0e272085dd08 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:08.301559 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:08.303804 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3866f2-b1a8-40a5-bc53-51ba893be873 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:08.305599 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:08.324720 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787ea97-7895-4833-8546-0e272085dd08 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:08.340727 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a00789-95d0-4eda-af64-481d6e18ee3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:08.341368 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a00789-95d0-4eda-af64-481d6e18ee3b None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:08.341645 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a00789-95d0-4eda-af64-481d6e18ee3b None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:08.341916 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a00789-95d0-4eda-af64-481d6e18ee3b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:08.353467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a00789-95d0-4eda-af64-481d6e18ee3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:08.358340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-55a00789-95d0-4eda-af64-481d6e18ee3b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 02:12:08.358340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:08.358340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:08.358340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:08.358340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:08.358340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:08.358340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:08.358340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:08.358340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:08.358340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:08.358340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:08.358340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:08.358340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:08.358340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:08.358340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:08.358340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:08.363940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:08.363940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:08.363940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:08.363940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:08.363940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:08.363940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:08.363940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:08.363940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:08.363940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:08.363940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:08.363940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:08.363940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:08.363940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:08.363940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:08.363940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:08.363940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:08.364712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:08.364712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:08.364712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:08.364712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:08.364712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:08.364712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:08.364712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:08.364712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:08.364712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:08.364712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:08.364712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 02:12:08.364712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:08.364712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 124/249] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:12:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:08.366680 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a00789-95d0-4eda-af64-481d6e18ee3b None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:08.373406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76616f76-4789-40e6-80e9-0299fc86cc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:08.374013 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76616f76-4789-40e6-80e9-0299fc86cc77 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:08.374333 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76616f76-4789-40e6-80e9-0299fc86cc77 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:08.374645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76616f76-4789-40e6-80e9-0299fc86cc77 None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:08.375462 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76616f76-4789-40e6-80e9-0299fc86cc77 None admin] RBAC: Adding query filter params (name=member) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:08.375762 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76616f76-4789-40e6-80e9-0299fc86cc77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:08.377147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76616f76-4789-40e6-80e9-0299fc86cc77 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:08.386508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 126/250] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 02:12:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:08.392180 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76616f76-4789-40e6-80e9-0299fc86cc77 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:08.514414 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76616f76-4789-40e6-80e9-0299fc86cc77 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:08.557299 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a00789-95d0-4eda-af64-481d6e18ee3b None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:08.559462 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d3216-a1f5-46ed-b899-aab9acd15407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:08.560116 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d3216-a1f5-46ed-b899-aab9acd15407 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:08.560648 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d3216-a1f5-46ed-b899-aab9acd15407 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:08.560920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d3216-a1f5-46ed-b899-aab9acd15407 None admin] PATH_INFO: `/v3/users/deb00057363f4d078350c0db2481be40` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:08.562925 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d3216-a1f5-46ed-b899-aab9acd15407 None admin] RBAC: Authorizing `identity:get_user(user_id=deb00057363f4d078350c0db2481be40)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:08.564394 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d3216-a1f5-46ed-b899-aab9acd15407 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:08.566377 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 127/251] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:12:08 2022] GET /identity/v3/users/deb00057363f4d078350c0db2481be40 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:08.573123 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d3216-a1f5-46ed-b899-aab9acd15407 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:08.591278 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:08.602308 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef46f50-b5a8-49d5-8a56-47da568252f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:08.603254 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef46f50-b5a8-49d5-8a56-47da568252f2 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:08.603848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef46f50-b5a8-49d5-8a56-47da568252f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:08.604276 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef46f50-b5a8-49d5-8a56-47da568252f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:08.605093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef46f50-b5a8-49d5-8a56-47da568252f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:08.605551 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef46f50-b5a8-49d5-8a56-47da568252f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:08.607338 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef46f50-b5a8-49d5-8a56-47da568252f2 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:08.617903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 125/252] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 02:12:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:08.625766 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef46f50-b5a8-49d5-8a56-47da568252f2 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:08.658255 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:08.701490 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d3216-a1f5-46ed-b899-aab9acd15407 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:08.748997 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b366e6-2a74-4fd3-817e-1bc98a0e2f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:08.749719 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b366e6-2a74-4fd3-817e-1bc98a0e2f73 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:08.750459 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b366e6-2a74-4fd3-817e-1bc98a0e2f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:08.750459 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b366e6-2a74-4fd3-817e-1bc98a0e2f73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:08.751140 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b366e6-2a74-4fd3-817e-1bc98a0e2f73 None admin] RBAC: Adding query filter params (role.id=bacc420f29704ec89e015525d8143d62, user.id=deb00057363f4d078350c0db2481be40, scope.system=all) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:08.751465 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b366e6-2a74-4fd3-817e-1bc98a0e2f73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:08.754315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b366e6-2a74-4fd3-817e-1bc98a0e2f73 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:08.758887 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef46f50-b5a8-49d5-8a56-47da568252f2 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:08.769096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 128/253] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Oct 19 02:12:08 2022] GET /identity/v3/role_assignments?user.id=deb00057363f4d078350c0db2481be40&scope.system=all&role.id=bacc420f29704ec89e015525d8143d62 => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:08.804318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c8b6c-0107-48b2-9e9b-0885b645ed66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:08.805293 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c8b6c-0107-48b2-9e9b-0885b645ed66 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:08.805777 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c8b6c-0107-48b2-9e9b-0885b645ed66 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:08.806222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c8b6c-0107-48b2-9e9b-0885b645ed66 None admin] PATH_INFO: `/v3/users/2542597145aa47f8b695c022fe3f0bed` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:08.807832 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c8b6c-0107-48b2-9e9b-0885b645ed66 None admin] RBAC: Authorizing `identity:get_user(user_id=2542597145aa47f8b695c022fe3f0bed)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:08.809595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c8b6c-0107-48b2-9e9b-0885b645ed66 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:08.812196 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 126/254] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:12:08 2022] GET /identity/v3/users/2542597145aa47f8b695c022fe3f0bed => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:08.818337 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b366e6-2a74-4fd3-817e-1bc98a0e2f73 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:08.905490 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:08.946493 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b366e6-2a74-4fd3-817e-1bc98a0e2f73 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:08.985328 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073689ed-ea30-4c24-aa9b-c55ecd47ee4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:08.985995 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073689ed-ea30-4c24-aa9b-c55ecd47ee4a None admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:08.986270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073689ed-ea30-4c24-aa9b-c55ecd47ee4a None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:08.986540 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073689ed-ea30-4c24-aa9b-c55ecd47ee4a None admin] PATH_INFO: `/v3/system/users/2542597145aa47f8b695c022fe3f0bed/roles/a2f123a9ec8440cba593773aabc0f2fc` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:08.988448 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073689ed-ea30-4c24-aa9b-c55ecd47ee4a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2542597145aa47f8b695c022fe3f0bed, role_id=a2f123a9ec8440cba593773aabc0f2fc)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:08.989841 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073689ed-ea30-4c24-aa9b-c55ecd47ee4a None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:09.078478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 129/255] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Oct 19 02:12:08 2022] PUT /identity/v3/system/users/2542597145aa47f8b695c022fe3f0bed/roles/a2f123a9ec8440cba593773aabc0f2fc => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:12:10.611735 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412e54d-c508-4d08-bf84-03c86d92bfa2 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:10.613432 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412e54d-c508-4d08-bf84-03c86d92bfa2 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:10.613917 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412e54d-c508-4d08-bf84-03c86d92bfa2 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:10.615801 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 127/256] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:10.621009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a4f36-3417-4b12-98c2-9ba3e734fe05 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:10.621441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a4f36-3417-4b12-98c2-9ba3e734fe05 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:10.621635 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a4f36-3417-4b12-98c2-9ba3e734fe05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:10.651226 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-d60a4f36-3417-4b12-98c2-9ba3e734fe05 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:10.652445 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-d60a4f36-3417-4b12-98c2-9ba3e734fe05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:10.732530 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 130/257] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 02:12:11.272392 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412e54d-c508-4d08-bf84-03c86d92bfa2 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:11.289287 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412e54d-c508-4d08-bf84-03c86d92bfa2 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:11.294530 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8711cc2-64e0-466e-91c4-e51f00add4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:11.295188 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8711cc2-64e0-466e-91c4-e51f00add4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:11.295460 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8711cc2-64e0-466e-91c4-e51f00add4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:11.295730 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8711cc2-64e0-466e-91c4-e51f00add4c4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:11.316566 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8711cc2-64e0-466e-91c4-e51f00add4c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:11.321477 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-a8711cc2-64e0-466e-91c4-e51f00add4c4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:12:11.321477 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:11.321477 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:11.321477 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:11.321477 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:11.321477 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:11.321477 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:11.321477 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:11.321477 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:11.321477 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:11.321477 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:11.321477 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:11.321477 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:11.321477 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:11.321477 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:11.321477 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:11.322369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:11.322369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:11.322369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:11.322369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:11.322369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:11.322369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:11.322369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:11.322369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:11.322369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:11.322369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:11.322369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:11.322369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:11.322369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:11.322369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:11.322369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:11.322369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:11.323208 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:11.323208 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:11.323208 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:11.323208 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:11.323208 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:11.323208 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:11.323208 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:11.323208 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:11.323208 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:11.323208 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:11.323208 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:12:11.323208 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:11.324307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 128/258] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 19 02:12:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:11.328795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a4f36-3417-4b12-98c2-9ba3e734fe05 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:11.339270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a4f36-3417-4b12-98c2-9ba3e734fe05 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:11.347133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795913e3-d46e-41e5-8137-ccd4b3b70d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:11.347757 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795913e3-d46e-41e5-8137-ccd4b3b70d99 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:11.348038 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795913e3-d46e-41e5-8137-ccd4b3b70d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:11.348311 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795913e3-d46e-41e5-8137-ccd4b3b70d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:11.348990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795913e3-d46e-41e5-8137-ccd4b3b70d99 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:11.349291 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795913e3-d46e-41e5-8137-ccd4b3b70d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:11.351101 dv-cinder-861491-4-smb devstack@keystone.service[81670]: WARNING py.warnings [None req-795913e3-d46e-41e5-8137-ccd4b3b70d99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 02:12:11.351101 dv-cinder-861491-4-smb devstack@keystone.service[81670]: warnings.warn(msg) Oct 19 02:12:11.351101 dv-cinder-861491-4-smb devstack@keystone.service[81670]: Oct 19 02:12:11.352267 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795913e3-d46e-41e5-8137-ccd4b3b70d99 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:11.362318 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 131/259] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 19 02:12:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:11.367941 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8711cc2-64e0-466e-91c4-e51f00add4c4 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:11.379286 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8711cc2-64e0-466e-91c4-e51f00add4c4 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:11.386880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d4b43-30bc-4405-8017-98464a15d151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:11.387569 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d4b43-30bc-4405-8017-98464a15d151 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:11.387845 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d4b43-30bc-4405-8017-98464a15d151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:11.388116 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d4b43-30bc-4405-8017-98464a15d151 admin admin] PATH_INFO: `/v3/groups/6cfb6526f2984b1aa28060d61089a1df` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:11.397391 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d4b43-30bc-4405-8017-98464a15d151 admin admin] RBAC: Authorizing `identity:get_group(group_id=6cfb6526f2984b1aa28060d61089a1df)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:11.399785 dv-cinder-861491-4-smb devstack@keystone.service[81671]: WARNING py.warnings [None req-7b8d4b43-30bc-4405-8017-98464a15d151 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 02:12:11.399785 dv-cinder-861491-4-smb devstack@keystone.service[81671]: warnings.warn(msg) Oct 19 02:12:11.399785 dv-cinder-861491-4-smb devstack@keystone.service[81671]: Oct 19 02:12:11.401097 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d4b43-30bc-4405-8017-98464a15d151 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:11.402809 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 129/260] 10.222.0.16 () {56 vars in 1201 bytes} [Wed Oct 19 02:12:11 2022] GET /identity/v3/groups/6cfb6526f2984b1aa28060d61089a1df => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:11.408639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795913e3-d46e-41e5-8137-ccd4b3b70d99 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:11.424076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795913e3-d46e-41e5-8137-ccd4b3b70d99 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:11.433941 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767cb64-aced-43ae-a996-fba425f0bacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:11.434856 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767cb64-aced-43ae-a996-fba425f0bacd admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:11.435627 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767cb64-aced-43ae-a996-fba425f0bacd admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:11.436100 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767cb64-aced-43ae-a996-fba425f0bacd admin admin] PATH_INFO: `/v3/projects/40691146f4bd45d4b515421ef1deba9e` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:11.443575 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767cb64-aced-43ae-a996-fba425f0bacd admin admin] RBAC: Authorizing `identity:get_project(project_id=40691146f4bd45d4b515421ef1deba9e)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:11.446024 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767cb64-aced-43ae-a996-fba425f0bacd admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:11.448265 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 132/261] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Oct 19 02:12:11 2022] GET /identity/v3/projects/40691146f4bd45d4b515421ef1deba9e => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:11.454013 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d4b43-30bc-4405-8017-98464a15d151 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:11.464480 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d4b43-30bc-4405-8017-98464a15d151 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:11.474412 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e134af6-36f6-43a4-9184-4c9c05c33256 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:11.475048 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e134af6-36f6-43a4-9184-4c9c05c33256 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:11.475529 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e134af6-36f6-43a4-9184-4c9c05c33256 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:11.477284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 133/262] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 02:12:11.478969 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2e369-98f2-46dd-b4db-5e078f6dced1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:11.478969 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2e369-98f2-46dd-b4db-5e078f6dced1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:11.479158 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2e369-98f2-46dd-b4db-5e078f6dced1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:11.479300 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2e369-98f2-46dd-b4db-5e078f6dced1 admin admin] PATH_INFO: `/v3/projects/40691146f4bd45d4b515421ef1deba9e/groups/6cfb6526f2984b1aa28060d61089a1df/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:11.484134 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2e369-98f2-46dd-b4db-5e078f6dced1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40691146f4bd45d4b515421ef1deba9e, group_id=6cfb6526f2984b1aa28060d61089a1df, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:11.484134 dv-cinder-861491-4-smb devstack@keystone.service[81671]: WARNING py.warnings [None req-cdb2e369-98f2-46dd-b4db-5e078f6dced1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 02:12:11.484134 dv-cinder-861491-4-smb devstack@keystone.service[81671]: warnings.warn(msg) Oct 19 02:12:11.484134 dv-cinder-861491-4-smb devstack@keystone.service[81671]: Oct 19 02:12:11.486380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeffde-587a-4530-a098-5b9909f46de1 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:11.486547 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2e369-98f2-46dd-b4db-5e078f6dced1 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:11.486686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeffde-587a-4530-a098-5b9909f46de1 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:11.487499 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeffde-587a-4530-a098-5b9909f46de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:11.528045 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-8aaeffde-587a-4530-a098-5b9909f46de1 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:11.529356 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-8aaeffde-587a-4530-a098-5b9909f46de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:11.543931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 134/263] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Oct 19 02:12:11.569917 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 130/264] 10.222.0.16 () {58 vars in 1463 bytes} [Wed Oct 19 02:12:11 2022] PUT /identity/v3/projects/40691146f4bd45d4b515421ef1deba9e/groups/6cfb6526f2984b1aa28060d61089a1df/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:12:11.709330 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64ff12-3afc-4d45-8651-1ab8d94daa2d None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:11.709866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64ff12-3afc-4d45-8651-1ab8d94daa2d None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:11.709866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64ff12-3afc-4d45-8651-1ab8d94daa2d None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:11.711333 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 135/265] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:11.717472 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fab71-1e18-423b-ac13-fcc13a9708b0 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:11.717980 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fab71-1e18-423b-ac13-fcc13a9708b0 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:11.717980 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fab71-1e18-423b-ac13-fcc13a9708b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:11.744616 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-b41fab71-1e18-423b-ac13-fcc13a9708b0 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:11.745852 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-b41fab71-1e18-423b-ac13-fcc13a9708b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:11.827931 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 131/266] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 02:12:11.837858 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6f81c-3258-4515-9f67-45a15e5ef5cb None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:11.838182 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6f81c-3258-4515-9f67-45a15e5ef5cb None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:11.838410 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6f81c-3258-4515-9f67-45a15e5ef5cb None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:11.839792 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 136/267] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:11.845297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af614e3-325c-48b7-9636-9a8d3feb5460 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:11.845565 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af614e3-325c-48b7-9636-9a8d3feb5460 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:11.845842 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af614e3-325c-48b7-9636-9a8d3feb5460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:11.859796 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:11.866673 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-6af614e3-325c-48b7-9636-9a8d3feb5460 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:11.867938 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-6af614e3-325c-48b7-9636-9a8d3feb5460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:11.950204 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 132/268] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:12.008856 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6f81c-3258-4515-9f67-45a15e5ef5cb None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:12.026078 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6f81c-3258-4515-9f67-45a15e5ef5cb None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:12.032857 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868e560-4424-485e-90af-5612dbfa1d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:12.033583 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868e560-4424-485e-90af-5612dbfa1d09 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:12.033950 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868e560-4424-485e-90af-5612dbfa1d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:12.034225 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868e560-4424-485e-90af-5612dbfa1d09 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:12.050064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868e560-4424-485e-90af-5612dbfa1d09 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:12.055233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-e868e560-4424-485e-90af-5612dbfa1d09 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 02:12:12.055233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:12.055233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:12.055233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:12.055233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:12.055233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:12.055233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:12.055233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:12.055233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:12.055233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:12.055233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:12.055233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:12.055233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:12.055233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:12.055233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:12.055233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:12.056183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:12.056183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:12.056183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:12.056183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:12.056183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:12.056183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:12.056183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:12.056183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:12.056183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:12.056183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:12.056183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:12.056183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:12.056183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:12.056183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:12.056183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:12.056183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:12.057522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:12.057522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:12.057522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:12.057522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:12.057522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:12.057522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:12.057522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:12.057522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:12.057522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:12.057522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:12.057522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 02:12:12.057522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:12.057522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 137/269] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Oct 19 02:12:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:12.062320 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af614e3-325c-48b7-9636-9a8d3feb5460 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:12.075899 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af614e3-325c-48b7-9636-9a8d3feb5460 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:12.085860 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bc25b-f9ee-4e7c-94f9-cd0bb12795b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:12.086463 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bc25b-f9ee-4e7c-94f9-cd0bb12795b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:12.086736 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bc25b-f9ee-4e7c-94f9-cd0bb12795b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:12.087035 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bc25b-f9ee-4e7c-94f9-cd0bb12795b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:12.087700 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bc25b-f9ee-4e7c-94f9-cd0bb12795b0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:12.087996 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bc25b-f9ee-4e7c-94f9-cd0bb12795b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:12.089006 dv-cinder-861491-4-smb devstack@keystone.service[81671]: WARNING py.warnings [None req-261bc25b-f9ee-4e7c-94f9-cd0bb12795b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 02:12:12.089006 dv-cinder-861491-4-smb devstack@keystone.service[81671]: warnings.warn(msg) Oct 19 02:12:12.089006 dv-cinder-861491-4-smb devstack@keystone.service[81671]: Oct 19 02:12:12.089897 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bc25b-f9ee-4e7c-94f9-cd0bb12795b0 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:12.105340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 133/270] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Oct 19 02:12:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:12.111453 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868e560-4424-485e-90af-5612dbfa1d09 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:12.130638 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868e560-4424-485e-90af-5612dbfa1d09 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:12.137915 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9e64e-755f-4c45-8816-3a7d61579eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:12.138603 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9e64e-755f-4c45-8816-3a7d61579eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:12.138909 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9e64e-755f-4c45-8816-3a7d61579eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:12.139193 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9e64e-755f-4c45-8816-3a7d61579eeb admin admin] PATH_INFO: `/v3/groups/6cfb6526f2984b1aa28060d61089a1df` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:12.141190 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9e64e-755f-4c45-8816-3a7d61579eeb admin admin] RBAC: Authorizing `identity:get_group(group_id=6cfb6526f2984b1aa28060d61089a1df)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:12.142318 dv-cinder-861491-4-smb devstack@keystone.service[81670]: WARNING py.warnings [None req-9dc9e64e-755f-4c45-8816-3a7d61579eeb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 02:12:12.142318 dv-cinder-861491-4-smb devstack@keystone.service[81670]: warnings.warn(msg) Oct 19 02:12:12.142318 dv-cinder-861491-4-smb devstack@keystone.service[81670]: Oct 19 02:12:12.144229 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9e64e-755f-4c45-8816-3a7d61579eeb admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:12.146146 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 138/271] 10.222.0.16 () {56 vars in 1201 bytes} [Wed Oct 19 02:12:12 2022] GET /identity/v3/groups/6cfb6526f2984b1aa28060d61089a1df => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:12.151442 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bc25b-f9ee-4e7c-94f9-cd0bb12795b0 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:12.164999 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bc25b-f9ee-4e7c-94f9-cd0bb12795b0 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:12.173721 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2d064-d5c1-42ee-b1b9-4d56364e5054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:12.174385 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2d064-d5c1-42ee-b1b9-4d56364e5054 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:12.174636 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2d064-d5c1-42ee-b1b9-4d56364e5054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:12.174954 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2d064-d5c1-42ee-b1b9-4d56364e5054 admin admin] PATH_INFO: `/v3/projects/40691146f4bd45d4b515421ef1deba9e` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:12.179510 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2d064-d5c1-42ee-b1b9-4d56364e5054 admin admin] RBAC: Authorizing `identity:get_project(project_id=40691146f4bd45d4b515421ef1deba9e)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:12.181597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2d064-d5c1-42ee-b1b9-4d56364e5054 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:12.183562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 134/272] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Oct 19 02:12:12 2022] GET /identity/v3/projects/40691146f4bd45d4b515421ef1deba9e => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:12.189700 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9e64e-755f-4c45-8816-3a7d61579eeb admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:12.205287 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9e64e-755f-4c45-8816-3a7d61579eeb admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:12.226012 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2d064-d5c1-42ee-b1b9-4d56364e5054 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:12.228960 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94555a1a-2b33-4ac2-8e00-507c58219d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:12.229735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94555a1a-2b33-4ac2-8e00-507c58219d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:12.230004 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94555a1a-2b33-4ac2-8e00-507c58219d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:12.230355 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94555a1a-2b33-4ac2-8e00-507c58219d45 admin admin] PATH_INFO: `/v3/projects/40691146f4bd45d4b515421ef1deba9e/groups/6cfb6526f2984b1aa28060d61089a1df/roles/619c0bef418849679ac636aa63923dc9` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:12.236132 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94555a1a-2b33-4ac2-8e00-507c58219d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40691146f4bd45d4b515421ef1deba9e, group_id=6cfb6526f2984b1aa28060d61089a1df, role_id=619c0bef418849679ac636aa63923dc9)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:12.237420 dv-cinder-861491-4-smb devstack@keystone.service[81670]: WARNING py.warnings [None req-94555a1a-2b33-4ac2-8e00-507c58219d45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 02:12:12.237420 dv-cinder-861491-4-smb devstack@keystone.service[81670]: warnings.warn(msg) Oct 19 02:12:12.237420 dv-cinder-861491-4-smb devstack@keystone.service[81670]: Oct 19 02:12:12.239582 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94555a1a-2b33-4ac2-8e00-507c58219d45 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:12.245268 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2d064-d5c1-42ee-b1b9-4d56364e5054 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:12.257593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7e1fa-5329-49ab-b3a1-a4173afc9c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:12.258279 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7e1fa-5329-49ab-b3a1-a4173afc9c56 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:12.258555 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7e1fa-5329-49ab-b3a1-a4173afc9c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:12.258832 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7e1fa-5329-49ab-b3a1-a4173afc9c56 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:12.275798 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7e1fa-5329-49ab-b3a1-a4173afc9c56 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:12.281274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-0da7e1fa-5329-49ab-b3a1-a4173afc9c56 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:12:12.281274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:12.281274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:12.281274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:12.281274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:12.281274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:12.281274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:12.281274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:12.281274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:12.281274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:12.281274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:12.281274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:12.281274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:12.281274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:12.281274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:12.281274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:12.283511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:12.283511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:12.283511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:12.283511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:12.283511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:12.283511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:12.283511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:12.283511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:12.283511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:12.283511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:12.283511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:12.283511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:12.283511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:12.283511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:12.283511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:12.283511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:12.286091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:12.286091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:12.286091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:12.286091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:12.286091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:12.286091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:12.286091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:12.286091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:12.286091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:12.286091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:12.286091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:12:12.286091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:12.286091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 135/273] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 19 02:12:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:12.293857 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7e1fa-5329-49ab-b3a1-a4173afc9c56 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:12.304703 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7e1fa-5329-49ab-b3a1-a4173afc9c56 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:12.316954 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ba9f8-df1c-49ff-8bfa-8790f16b74cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:12.317577 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ba9f8-df1c-49ff-8bfa-8790f16b74cc admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:12.317853 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ba9f8-df1c-49ff-8bfa-8790f16b74cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:12.318306 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ba9f8-df1c-49ff-8bfa-8790f16b74cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:12.318848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ba9f8-df1c-49ff-8bfa-8790f16b74cc admin admin] RBAC: Adding query filter params (name=member) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:12.319137 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ba9f8-df1c-49ff-8bfa-8790f16b74cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:12.320759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ba9f8-df1c-49ff-8bfa-8790f16b74cc admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:12.330074 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 139/274] 10.222.0.16 () {58 vars in 1463 bytes} [Wed Oct 19 02:12:12 2022] PUT /identity/v3/projects/40691146f4bd45d4b515421ef1deba9e/groups/6cfb6526f2984b1aa28060d61089a1df/roles/619c0bef418849679ac636aa63923dc9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:12:12.333603 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 136/275] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 19 02:12:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:12.340036 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94555a1a-2b33-4ac2-8e00-507c58219d45 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:12.398051 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:12.436191 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94555a1a-2b33-4ac2-8e00-507c58219d45 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:12.443619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de104ad-f270-4f01-9bbb-ec95de5d00e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:12.444270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de104ad-f270-4f01-9bbb-ec95de5d00e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:12.444549 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de104ad-f270-4f01-9bbb-ec95de5d00e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:12.444866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de104ad-f270-4f01-9bbb-ec95de5d00e7 admin admin] PATH_INFO: `/v3/groups/6cfb6526f2984b1aa28060d61089a1df` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:12.446002 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de104ad-f270-4f01-9bbb-ec95de5d00e7 admin admin] RBAC: Authorizing `identity:get_group(group_id=6cfb6526f2984b1aa28060d61089a1df)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:12.448033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de104ad-f270-4f01-9bbb-ec95de5d00e7 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:12.449730 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 140/276] 10.222.0.16 () {56 vars in 1201 bytes} [Wed Oct 19 02:12:12 2022] GET /identity/v3/groups/6cfb6526f2984b1aa28060d61089a1df => generated 226 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:12.456422 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ba9f8-df1c-49ff-8bfa-8790f16b74cc admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:12.470140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ba9f8-df1c-49ff-8bfa-8790f16b74cc admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:12.482590 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c609f-d0c8-4051-a792-3a5a368e6f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:12.483263 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c609f-d0c8-4051-a792-3a5a368e6f86 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:12.483537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c609f-d0c8-4051-a792-3a5a368e6f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:12.483798 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c609f-d0c8-4051-a792-3a5a368e6f86 admin admin] PATH_INFO: `/v3/projects/c277629bc0e74ec98f23ed36d4f266d6` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:12.487713 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c609f-d0c8-4051-a792-3a5a368e6f86 admin admin] RBAC: Authorizing `identity:get_project(project_id=c277629bc0e74ec98f23ed36d4f266d6)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:12.490027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c609f-d0c8-4051-a792-3a5a368e6f86 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:12.492452 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 137/277] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Oct 19 02:12:12 2022] GET /identity/v3/projects/c277629bc0e74ec98f23ed36d4f266d6 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:12.492797 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de104ad-f270-4f01-9bbb-ec95de5d00e7 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:12.498247 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c609f-d0c8-4051-a792-3a5a368e6f86 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:12.518853 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c609f-d0c8-4051-a792-3a5a368e6f86 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:12.531477 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fec4b-778d-43e1-ac63-4656e5d4d5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:12.533373 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fec4b-778d-43e1-ac63-4656e5d4d5f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:12.535400 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fec4b-778d-43e1-ac63-4656e5d4d5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:12.536063 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fec4b-778d-43e1-ac63-4656e5d4d5f1 admin admin] PATH_INFO: `/v3/projects/c277629bc0e74ec98f23ed36d4f266d6/groups/6cfb6526f2984b1aa28060d61089a1df/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:12.540156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3fec4b-778d-43e1-ac63-4656e5d4d5f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c277629bc0e74ec98f23ed36d4f266d6, group_id=6cfb6526f2984b1aa28060d61089a1df, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:12.544916 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3fec4b-778d-43e1-ac63-4656e5d4d5f1 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:12.631130 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 138/278] 10.222.0.16 () {58 vars in 1463 bytes} [Wed Oct 19 02:12:12 2022] PUT /identity/v3/projects/c277629bc0e74ec98f23ed36d4f266d6/groups/6cfb6526f2984b1aa28060d61089a1df/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:12:12.637219 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de104ad-f270-4f01-9bbb-ec95de5d00e7 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:12.685527 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22975e7c-7db4-4d0f-b751-dafec6d33907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:12.686168 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22975e7c-7db4-4d0f-b751-dafec6d33907 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:12.686444 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22975e7c-7db4-4d0f-b751-dafec6d33907 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:12.686713 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22975e7c-7db4-4d0f-b751-dafec6d33907 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:12.701066 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22975e7c-7db4-4d0f-b751-dafec6d33907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:12.706014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-22975e7c-7db4-4d0f-b751-dafec6d33907 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 02:12:12.706014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:12.706014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:12.706014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:12.706014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:12.706014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:12.706014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:12.706014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:12.706014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:12.706014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:12.706014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:12.706014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:12.706014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:12.706014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:12.706014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:12.706014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:12.706935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:12.706935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:12.706935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:12.706935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:12.706935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:12.706935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:12.706935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:12.706935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:12.706935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:12.706935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:12.706935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:12.706935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:12.706935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:12.706935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:12.706935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:12.706935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:12.707723 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:12.707723 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:12.707723 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:12.707723 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:12.707723 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:12.707723 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:12.707723 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:12.707723 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:12.707723 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:12.707723 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:12.707723 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 02:12:12.707723 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:12.710920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 141/279] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:12:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:12:12.713494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fec4b-778d-43e1-ac63-4656e5d4d5f1 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:12.834517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:12.852505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fec4b-778d-43e1-ac63-4656e5d4d5f1 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:12.893786 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0047b-f80c-41ec-9976-878031369e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:12.894681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0047b-f80c-41ec-9976-878031369e99 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:12.895079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0047b-f80c-41ec-9976-878031369e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:12.895421 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0047b-f80c-41ec-9976-878031369e99 None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:12.896202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0047b-f80c-41ec-9976-878031369e99 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:12.896577 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0047b-f80c-41ec-9976-878031369e99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:12.898197 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0047b-f80c-41ec-9976-878031369e99 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:12.910413 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 139/280] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 02:12:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:12.915849 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22975e7c-7db4-4d0f-b751-dafec6d33907 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:12.974729 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:13.029829 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26f634-9afe-44e5-9b4e-6698330b6ddb None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:13.030399 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26f634-9afe-44e5-9b4e-6698330b6ddb None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:13.030929 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26f634-9afe-44e5-9b4e-6698330b6ddb None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:13.032970 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 140/281] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:13.038874 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98731129-9575-48e0-95b7-2aa574d1a865 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:13.039416 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98731129-9575-48e0-95b7-2aa574d1a865 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:13.039940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98731129-9575-48e0-95b7-2aa574d1a865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:13.052833 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22975e7c-7db4-4d0f-b751-dafec6d33907 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:13.068864 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-98731129-9575-48e0-95b7-2aa574d1a865 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:13.070448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-98731129-9575-48e0-95b7-2aa574d1a865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:13.113817 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d329a4-557b-4a94-b713-740bb8ebbe34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:13.114695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d329a4-557b-4a94-b713-740bb8ebbe34 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:13.115230 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d329a4-557b-4a94-b713-740bb8ebbe34 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:13.115638 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d329a4-557b-4a94-b713-740bb8ebbe34 None admin] PATH_INFO: `/v3/users/2542597145aa47f8b695c022fe3f0bed` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:13.119597 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d329a4-557b-4a94-b713-740bb8ebbe34 None admin] RBAC: Authorizing `identity:get_user(user_id=2542597145aa47f8b695c022fe3f0bed)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:13.121185 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d329a4-557b-4a94-b713-740bb8ebbe34 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:13.123250 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 142/282] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:12:12 2022] GET /identity/v3/users/2542597145aa47f8b695c022fe3f0bed => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:13.130400 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d329a4-557b-4a94-b713-740bb8ebbe34 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:13.173319 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 141/283] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 02:12:13.303553 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d329a4-557b-4a94-b713-740bb8ebbe34 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:13.318016 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:13.349520 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1eb23-31db-4be8-aa0b-c9bf01a71433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:13.350129 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1eb23-31db-4be8-aa0b-c9bf01a71433 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:13.350403 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1eb23-31db-4be8-aa0b-c9bf01a71433 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:13.350672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1eb23-31db-4be8-aa0b-c9bf01a71433 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:13.351421 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1eb23-31db-4be8-aa0b-c9bf01a71433 None admin] RBAC: Adding query filter params (role.id=a2f123a9ec8440cba593773aabc0f2fc, user.id=2542597145aa47f8b695c022fe3f0bed, scope.system=all) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:13.351725 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1eb23-31db-4be8-aa0b-c9bf01a71433 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:13.353286 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1eb23-31db-4be8-aa0b-c9bf01a71433 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:13.372723 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 143/284] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Oct 19 02:12:13 2022] GET /identity/v3/role_assignments?user.id=2542597145aa47f8b695c022fe3f0bed&scope.system=all&role.id=a2f123a9ec8440cba593773aabc0f2fc => generated 510 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:13.589153 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98731129-9575-48e0-95b7-2aa574d1a865 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:13.601383 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98731129-9575-48e0-95b7-2aa574d1a865 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:13.606362 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e997ad0-fcde-440a-9fbc-4b075a9108c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:13.607293 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e997ad0-fcde-440a-9fbc-4b075a9108c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:13.607772 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e997ad0-fcde-440a-9fbc-4b075a9108c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:13.608242 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e997ad0-fcde-440a-9fbc-4b075a9108c7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:13.616838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775a7d6-db44-4225-ac1a-81c3d1bc2ab1 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:13.617169 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775a7d6-db44-4225-ac1a-81c3d1bc2ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:13.617453 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775a7d6-db44-4225-ac1a-81c3d1bc2ab1 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:13.619464 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 144/285] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:13.626550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e997ad0-fcde-440a-9fbc-4b075a9108c7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:13.627455 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c86062-ec5f-4024-9c7b-fd202eee2106 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:13.628358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c86062-ec5f-4024-9c7b-fd202eee2106 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:13.628638 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c86062-ec5f-4024-9c7b-fd202eee2106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:13.633353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-2e997ad0-fcde-440a-9fbc-4b075a9108c7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 02:12:13.633353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:13.633353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:13.633353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:13.633353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:13.633353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:13.633353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:13.633353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:13.633353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:13.633353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:13.633353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:13.633353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:13.633353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:13.633353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:13.633353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:13.633353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:13.634270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:13.634270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:13.634270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:13.634270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:13.634270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:13.634270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:13.634270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:13.634270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:13.634270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:13.634270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:13.634270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:13.634270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:13.634270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:13.634270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:13.634270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:13.634270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:13.635140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:13.635140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:13.635140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:13.635140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:13.635140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:13.635140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:13.635140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:13.635140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:13.635140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:13.635140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:13.635140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 02:12:13.635140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:13.637676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 142/286] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Oct 19 02:12:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:13.647083 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e997ad0-fcde-440a-9fbc-4b075a9108c7 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:13.662961 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e997ad0-fcde-440a-9fbc-4b075a9108c7 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:13.668097 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c301e-fa5c-4449-89ec-e74c0b772917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:13.669116 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c301e-fa5c-4449-89ec-e74c0b772917 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:13.669616 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c301e-fa5c-4449-89ec-e74c0b772917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:13.670085 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c301e-fa5c-4449-89ec-e74c0b772917 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:13.671055 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c301e-fa5c-4449-89ec-e74c0b772917 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:13.671560 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c301e-fa5c-4449-89ec-e74c0b772917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:13.673490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c301e-fa5c-4449-89ec-e74c0b772917 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:13.678521 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-a7c86062-ec5f-4024-9c7b-fd202eee2106 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:13.678521 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-a7c86062-ec5f-4024-9c7b-fd202eee2106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:13.689739 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 143/287] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Oct 19 02:12:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:13.697166 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 145/288] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Oct 19 02:12:13.700540 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c301e-fa5c-4449-89ec-e74c0b772917 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:13.714327 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c301e-fa5c-4449-89ec-e74c0b772917 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:13.719346 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3c8c8-9ea3-4b28-a515-698832e12ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:13.720237 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3c8c8-9ea3-4b28-a515-698832e12ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:13.720766 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3c8c8-9ea3-4b28-a515-698832e12ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:13.721336 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3c8c8-9ea3-4b28-a515-698832e12ad0 admin admin] PATH_INFO: `/v3/groups/6cfb6526f2984b1aa28060d61089a1df` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:13.722942 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3c8c8-9ea3-4b28-a515-698832e12ad0 admin admin] RBAC: Authorizing `identity:get_group(group_id=6cfb6526f2984b1aa28060d61089a1df)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:13.725266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3c8c8-9ea3-4b28-a515-698832e12ad0 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:13.731265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 144/289] 10.222.0.16 () {56 vars in 1201 bytes} [Wed Oct 19 02:12:13 2022] GET /identity/v3/groups/6cfb6526f2984b1aa28060d61089a1df => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:13.737365 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c86062-ec5f-4024-9c7b-fd202eee2106 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:13.751931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c86062-ec5f-4024-9c7b-fd202eee2106 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:13.758874 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9de3e-7c27-43c5-ae0e-be463e23ddc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:13.759524 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9de3e-7c27-43c5-ae0e-be463e23ddc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:13.759790 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9de3e-7c27-43c5-ae0e-be463e23ddc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:13.760056 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9de3e-7c27-43c5-ae0e-be463e23ddc5 admin admin] PATH_INFO: `/v3/projects/c277629bc0e74ec98f23ed36d4f266d6` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:13.763500 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9de3e-7c27-43c5-ae0e-be463e23ddc5 admin admin] RBAC: Authorizing `identity:get_project(project_id=c277629bc0e74ec98f23ed36d4f266d6)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:13.765584 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9de3e-7c27-43c5-ae0e-be463e23ddc5 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:13.767616 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 146/290] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Oct 19 02:12:13 2022] GET /identity/v3/projects/c277629bc0e74ec98f23ed36d4f266d6 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:13.773940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3c8c8-9ea3-4b28-a515-698832e12ad0 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:13.787693 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3c8c8-9ea3-4b28-a515-698832e12ad0 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:13.792840 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b0a76-1904-4bfa-99c7-a6ca438fb065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:13.793823 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b0a76-1904-4bfa-99c7-a6ca438fb065 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:13.794323 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b0a76-1904-4bfa-99c7-a6ca438fb065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:13.794863 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b0a76-1904-4bfa-99c7-a6ca438fb065 admin admin] PATH_INFO: `/v3/projects/c277629bc0e74ec98f23ed36d4f266d6/groups/6cfb6526f2984b1aa28060d61089a1df/roles/619c0bef418849679ac636aa63923dc9` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:13.797258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b0a76-1904-4bfa-99c7-a6ca438fb065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c277629bc0e74ec98f23ed36d4f266d6, group_id=6cfb6526f2984b1aa28060d61089a1df, role_id=619c0bef418849679ac636aa63923dc9)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:13.803132 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b0a76-1904-4bfa-99c7-a6ca438fb065 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:13.930931 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 145/291] 10.222.0.16 () {58 vars in 1463 bytes} [Wed Oct 19 02:12:13 2022] PUT /identity/v3/projects/c277629bc0e74ec98f23ed36d4f266d6/groups/6cfb6526f2984b1aa28060d61089a1df/roles/619c0bef418849679ac636aa63923dc9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:12:14.036945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9de3e-7c27-43c5-ae0e-be463e23ddc5 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:14.050724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9de3e-7c27-43c5-ae0e-be463e23ddc5 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:14.127947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18a61c-1e56-472b-8b4a-36d58c3ded50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:14.128496 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18a61c-1e56-472b-8b4a-36d58c3ded50 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:14.128770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18a61c-1e56-472b-8b4a-36d58c3ded50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:14.129038 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18a61c-1e56-472b-8b4a-36d58c3ded50 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:14.147628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18a61c-1e56-472b-8b4a-36d58c3ded50 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:14.152574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-7c18a61c-1e56-472b-8b4a-36d58c3ded50 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:12:14.152574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:14.152574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:14.152574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:14.152574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:14.152574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:14.152574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:14.152574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:14.152574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:14.152574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:14.152574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:14.152574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:14.152574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:14.152574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:14.152574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:14.152574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:14.153458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:14.153458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:14.153458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:14.153458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:14.153458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:14.153458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:14.153458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:14.153458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:14.153458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:14.153458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:14.153458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:14.153458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:14.153458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:14.153458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:14.153458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:14.153458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:14.154242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:14.154242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:14.154242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:14.154242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:14.154242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:14.154242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:14.154242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:14.154242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:14.154242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:14.154242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:14.154242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:12:14.154242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:14.154242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 147/292] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 19 02:12:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:14.160178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b0a76-1904-4bfa-99c7-a6ca438fb065 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:14.175979 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b0a76-1904-4bfa-99c7-a6ca438fb065 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:14.182838 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b5609-e38c-4184-ba64-69658d10e290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:14.183867 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b5609-e38c-4184-ba64-69658d10e290 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:14.184451 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b5609-e38c-4184-ba64-69658d10e290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:14.184954 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b5609-e38c-4184-ba64-69658d10e290 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:14.186193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b5609-e38c-4184-ba64-69658d10e290 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:14.186727 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b5609-e38c-4184-ba64-69658d10e290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:14.188713 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b5609-e38c-4184-ba64-69658d10e290 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:14.206752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 146/293] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 19 02:12:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:14.212123 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18a61c-1e56-472b-8b4a-36d58c3ded50 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:14.230651 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18a61c-1e56-472b-8b4a-36d58c3ded50 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:14.244065 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d711d-b697-47c7-9ab5-9da3b3cc66e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:14.244704 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d711d-b697-47c7-9ab5-9da3b3cc66e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:14.245037 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d711d-b697-47c7-9ab5-9da3b3cc66e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:14.245311 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d711d-b697-47c7-9ab5-9da3b3cc66e4 admin admin] PATH_INFO: `/v3/groups/5341f49e47de4d0ea3c3cae8b7e5b9fd` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:14.257680 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d711d-b697-47c7-9ab5-9da3b3cc66e4 admin admin] RBAC: Authorizing `identity:get_group(group_id=5341f49e47de4d0ea3c3cae8b7e5b9fd)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:14.259721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d711d-b697-47c7-9ab5-9da3b3cc66e4 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:14.261695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 148/294] 10.222.0.16 () {56 vars in 1201 bytes} [Wed Oct 19 02:12:14 2022] GET /identity/v3/groups/5341f49e47de4d0ea3c3cae8b7e5b9fd => generated 229 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:14.267158 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b5609-e38c-4184-ba64-69658d10e290 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:14.281243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b5609-e38c-4184-ba64-69658d10e290 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:14.289922 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108ac53-ea13-400a-b681-495e6436d48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:14.291079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108ac53-ea13-400a-b681-495e6436d48b admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:14.291621 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108ac53-ea13-400a-b681-495e6436d48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:14.292040 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108ac53-ea13-400a-b681-495e6436d48b admin admin] PATH_INFO: `/v3/projects/223a4736f80b47779a253b8ee6250bb6` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:14.293386 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108ac53-ea13-400a-b681-495e6436d48b admin admin] RBAC: Authorizing `identity:get_project(project_id=223a4736f80b47779a253b8ee6250bb6)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:14.295490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108ac53-ea13-400a-b681-495e6436d48b admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:14.297782 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 147/295] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Oct 19 02:12:14 2022] GET /identity/v3/projects/223a4736f80b47779a253b8ee6250bb6 => generated 344 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:14.303671 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d711d-b697-47c7-9ab5-9da3b3cc66e4 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:14.315838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d711d-b697-47c7-9ab5-9da3b3cc66e4 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:14.320518 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3004b3e-9777-44fe-b159-0c94eddbfa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:14.321265 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3004b3e-9777-44fe-b159-0c94eddbfa14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:14.321642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3004b3e-9777-44fe-b159-0c94eddbfa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:14.322009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3004b3e-9777-44fe-b159-0c94eddbfa14 admin admin] PATH_INFO: `/v3/projects/223a4736f80b47779a253b8ee6250bb6/groups/5341f49e47de4d0ea3c3cae8b7e5b9fd/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:14.324127 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3004b3e-9777-44fe-b159-0c94eddbfa14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=223a4736f80b47779a253b8ee6250bb6, group_id=5341f49e47de4d0ea3c3cae8b7e5b9fd, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:14.326932 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3004b3e-9777-44fe-b159-0c94eddbfa14 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:14.401161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 149/296] 10.222.0.16 () {58 vars in 1463 bytes} [Wed Oct 19 02:12:14 2022] PUT /identity/v3/projects/223a4736f80b47779a253b8ee6250bb6/groups/5341f49e47de4d0ea3c3cae8b7e5b9fd/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:12:15.098452 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8357530-ba0c-45c4-9412-4b344ca81ef5 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:15.099534 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8357530-ba0c-45c4-9412-4b344ca81ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:15.100018 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8357530-ba0c-45c4-9412-4b344ca81ef5 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:15.101845 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 148/297] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:15.106930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34a07c-7706-450c-ab2d-eec54c96bf24 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:15.107757 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34a07c-7706-450c-ab2d-eec54c96bf24 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:15.108249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34a07c-7706-450c-ab2d-eec54c96bf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:15.132201 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-8b34a07c-7706-450c-ab2d-eec54c96bf24 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:15.133766 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-8b34a07c-7706-450c-ab2d-eec54c96bf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:15.231566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 150/298] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 02:12:15.575603 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b1a49-27c2-48f5-a2dc-92506a6b20be None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:15.575975 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b1a49-27c2-48f5-a2dc-92506a6b20be None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:15.576151 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b1a49-27c2-48f5-a2dc-92506a6b20be None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:15.577741 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 149/299] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:15.583822 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff383aa3-065a-4bfa-8d5c-db2af992c620 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:15.584349 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff383aa3-065a-4bfa-8d5c-db2af992c620 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:15.584868 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff383aa3-065a-4bfa-8d5c-db2af992c620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:15.595874 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:15.608362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-ff383aa3-065a-4bfa-8d5c-db2af992c620 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:15.609823 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-ff383aa3-065a-4bfa-8d5c-db2af992c620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:15.701717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 151/300] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:15.754547 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b1a49-27c2-48f5-a2dc-92506a6b20be None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:15.813469 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:15.904280 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b1a49-27c2-48f5-a2dc-92506a6b20be None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:15.905366 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8782610-bf78-4f2f-858e-dda22d566371 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:15.905867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8782610-bf78-4f2f-858e-dda22d566371 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:15.906373 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8782610-bf78-4f2f-858e-dda22d566371 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:15.907963 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 152/301] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 02:12:15.920503 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf7f58-2e31-4533-84bf-7222b47e9591 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:15.921059 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf7f58-2e31-4533-84bf-7222b47e9591 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:15.921546 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf7f58-2e31-4533-84bf-7222b47e9591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:15.953620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-cabf7f58-2e31-4533-84bf-7222b47e9591 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:15.954807 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-cabf7f58-2e31-4533-84bf-7222b47e9591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:15.956278 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cbe81-e8b0-40ce-8e11-fea0fc430860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:15.956922 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cbe81-e8b0-40ce-8e11-fea0fc430860 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:15.957233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cbe81-e8b0-40ce-8e11-fea0fc430860 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:15.957505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cbe81-e8b0-40ce-8e11-fea0fc430860 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:15.975716 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22cbe81-e8b0-40ce-8e11-fea0fc430860 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:15.981507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-a22cbe81-e8b0-40ce-8e11-fea0fc430860 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:12:15.981507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:15.981507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:15.981507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:15.981507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:15.981507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:15.981507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:15.981507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:15.981507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:15.981507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:15.981507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:15.981507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:15.981507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:15.981507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:15.981507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:15.981507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:15.982459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:15.982459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:15.982459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:15.982459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:15.982459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:15.982459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:15.982459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:15.982459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:15.982459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:15.982459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:15.982459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:15.982459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:15.982459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:15.982459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:15.982459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:15.982459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:15.983366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:15.983366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:15.983366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:15.983366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:15.983366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:15.983366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:15.983366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:15.983366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:15.983366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:15.983366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:15.983366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:12:15.983366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:15.983366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 150/302] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:12:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:15.990644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cbe81-e8b0-40ce-8e11-fea0fc430860 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:16.050672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 153/303] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:16.065670 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf7f58-2e31-4533-84bf-7222b47e9591 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:16.169809 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:16.174535 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cbe81-e8b0-40ce-8e11-fea0fc430860 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:16.208510 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:16.224549 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e4f94-3499-4271-9e51-8edc24112c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:16.225284 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e4f94-3499-4271-9e51-8edc24112c53 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:16.225566 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e4f94-3499-4271-9e51-8edc24112c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:16.225833 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e4f94-3499-4271-9e51-8edc24112c53 None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:16.226503 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e4f94-3499-4271-9e51-8edc24112c53 None admin] RBAC: Adding query filter params (name=member) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:16.226803 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e4f94-3499-4271-9e51-8edc24112c53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:16.228505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e4f94-3499-4271-9e51-8edc24112c53 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:16.245883 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 151/304] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 02:12:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:16.268398 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e4f94-3499-4271-9e51-8edc24112c53 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:16.269591 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf7f58-2e31-4533-84bf-7222b47e9591 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:16.312978 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8f62a-4bc5-4ffc-9179-f46c48eb9171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:16.314005 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8f62a-4bc5-4ffc-9179-f46c48eb9171 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:16.314496 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8f62a-4bc5-4ffc-9179-f46c48eb9171 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:16.315545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8f62a-4bc5-4ffc-9179-f46c48eb9171 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:16.327918 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8f62a-4bc5-4ffc-9179-f46c48eb9171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:16.333551 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-47d8f62a-4bc5-4ffc-9179-f46c48eb9171 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 02:12:16.333551 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:16.333551 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:16.333551 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:16.333551 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:16.333551 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:16.333551 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:16.333551 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:16.333551 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:16.333551 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:16.333551 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:16.333551 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:16.333551 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:16.333551 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:16.333551 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:16.333551 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:16.334441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:16.334441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:16.334441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:16.334441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:16.334441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:16.334441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:16.334441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:16.334441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:16.334441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:16.334441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:16.334441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:16.334441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:16.334441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:16.334441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:16.334441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:16.334441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:16.335283 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:16.335283 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:16.335283 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:16.335283 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:16.335283 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:16.335283 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:16.335283 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:16.335283 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:16.335283 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:16.335283 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:16.335283 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 02:12:16.335283 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:16.337562 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 154/305] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 02:12:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:12:16.343627 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8f62a-4bc5-4ffc-9179-f46c48eb9171 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:16.422860 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e4f94-3499-4271-9e51-8edc24112c53 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:16.449929 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8f62a-4bc5-4ffc-9179-f46c48eb9171 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:16.461055 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43470e8f-74c0-4e1f-be44-25e06169f616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:16.461725 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43470e8f-74c0-4e1f-be44-25e06169f616 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:16.462004 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43470e8f-74c0-4e1f-be44-25e06169f616 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:16.462313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43470e8f-74c0-4e1f-be44-25e06169f616 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:16.477109 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:16.490203 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e1077-8d9b-4dac-96ea-fd8b63e0ca21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:16.491251 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e1077-8d9b-4dac-96ea-fd8b63e0ca21 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:16.491739 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e1077-8d9b-4dac-96ea-fd8b63e0ca21 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:16.492232 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e1077-8d9b-4dac-96ea-fd8b63e0ca21 None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:16.493135 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e1077-8d9b-4dac-96ea-fd8b63e0ca21 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:16.493649 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e1077-8d9b-4dac-96ea-fd8b63e0ca21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:16.495355 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e1077-8d9b-4dac-96ea-fd8b63e0ca21 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:16.499725 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:16.505807 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 155/306] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:12:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:16.506986 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e1077-8d9b-4dac-96ea-fd8b63e0ca21 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:16.549803 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43470e8f-74c0-4e1f-be44-25e06169f616 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:16.551476 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43470e8f-74c0-4e1f-be44-25e06169f616 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:16.617471 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e1077-8d9b-4dac-96ea-fd8b63e0ca21 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:16.655313 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3a512-675b-43d3-af0b-7dfdf95c0083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:16.656300 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3a512-675b-43d3-af0b-7dfdf95c0083 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:16.656868 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3a512-675b-43d3-af0b-7dfdf95c0083 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:16.657351 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3a512-675b-43d3-af0b-7dfdf95c0083 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:16.672510 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 152/307] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:12:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:16.672510 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43470e8f-74c0-4e1f-be44-25e06169f616 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:16.679542 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3a512-675b-43d3-af0b-7dfdf95c0083 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:16.684877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-f5d3a512-675b-43d3-af0b-7dfdf95c0083 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:12:16.684877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:16.684877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:16.684877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:16.684877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:16.684877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:16.684877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:16.684877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:16.684877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:16.684877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:16.684877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:16.684877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:16.684877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:16.684877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:16.684877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:16.684877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:16.686019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:16.686019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:16.686019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:16.686019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:16.686019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:16.686019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:16.686019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:16.686019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:16.686019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:16.686019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:16.686019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:16.686019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:16.686019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:16.686019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:16.686019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:16.686019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:16.686851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:16.686851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:16.686851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:16.686851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:16.686851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:16.686851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:16.686851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:16.686851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:16.686851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:16.686851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:16.686851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 02:12:16.686851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:16.686851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 156/308] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:12:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:16.695152 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3a512-675b-43d3-af0b-7dfdf95c0083 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:16.746075 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:16.758843 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:16.801553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43470e8f-74c0-4e1f-be44-25e06169f616 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:16.843668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3a512-675b-43d3-af0b-7dfdf95c0083 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:16.852918 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97de787-588a-4749-95ed-8aea8f50d6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:16.853537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97de787-588a-4749-95ed-8aea8f50d6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:16.853814 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97de787-588a-4749-95ed-8aea8f50d6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:16.854086 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97de787-588a-4749-95ed-8aea8f50d6e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:16.892708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4252a19-d5d1-4360-a7bd-dbf84572e68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:16.895598 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4252a19-d5d1-4360-a7bd-dbf84572e68e None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:16.896176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4252a19-d5d1-4360-a7bd-dbf84572e68e None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:16.896679 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4252a19-d5d1-4360-a7bd-dbf84572e68e None admin] PATH_INFO: `/v3/projects/40691146f4bd45d4b515421ef1deba9e` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:16.898567 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4252a19-d5d1-4360-a7bd-dbf84572e68e None admin] RBAC: Authorizing `identity:get_project(project_id=40691146f4bd45d4b515421ef1deba9e)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:16.901210 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4252a19-d5d1-4360-a7bd-dbf84572e68e None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:16.903898 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 157/309] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:12:16 2022] GET /identity/v3/projects/40691146f4bd45d4b515421ef1deba9e => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:16.909363 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4252a19-d5d1-4360-a7bd-dbf84572e68e None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:16.951906 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97de787-588a-4749-95ed-8aea8f50d6e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:16.953732 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97de787-588a-4749-95ed-8aea8f50d6e2 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:17.019762 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:17.037055 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4252a19-d5d1-4360-a7bd-dbf84572e68e None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:17.054323 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:17.063384 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 153/310] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:12:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:17.071733 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97de787-588a-4749-95ed-8aea8f50d6e2 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:17.086384 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8bbd0-78fe-4400-814e-3561a0e8fc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:17.087056 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8bbd0-78fe-4400-814e-3561a0e8fc78 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:17.087338 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8bbd0-78fe-4400-814e-3561a0e8fc78 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:17.087609 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8bbd0-78fe-4400-814e-3561a0e8fc78 None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:17.088281 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8bbd0-78fe-4400-814e-3561a0e8fc78 None admin] RBAC: Adding query filter params (name=member) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:17.089163 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8bbd0-78fe-4400-814e-3561a0e8fc78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:17.091645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8bbd0-78fe-4400-814e-3561a0e8fc78 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:17.103121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 158/311] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 02:12:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:17.104303 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a907f-4f1c-4369-90af-12926cf9124d None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:17.104673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a907f-4f1c-4369-90af-12926cf9124d None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:17.105046 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a907f-4f1c-4369-90af-12926cf9124d None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:17.106512 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 159/312] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:17.107725 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a907f-4f1c-4369-90af-12926cf9124d None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:17.207339 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97de787-588a-4749-95ed-8aea8f50d6e2 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:17.245380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a907f-4f1c-4369-90af-12926cf9124d None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:17.261222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8b4a4-8dea-491c-b2c4-781bdab818d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:17.262025 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8b4a4-8dea-491c-b2c4-781bdab818d1 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:17.262508 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8b4a4-8dea-491c-b2c4-781bdab818d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:17.262628 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8b4a4-8dea-491c-b2c4-781bdab818d1 None admin] PATH_INFO: `/v3/groups/6cfb6526f2984b1aa28060d61089a1df` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:17.264119 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8b4a4-8dea-491c-b2c4-781bdab818d1 None admin] RBAC: Authorizing `identity:get_group(group_id=6cfb6526f2984b1aa28060d61089a1df)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:17.267571 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8b4a4-8dea-491c-b2c4-781bdab818d1 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:17.272181 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 154/313] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 19 02:12:17 2022] GET /identity/v3/groups/6cfb6526f2984b1aa28060d61089a1df => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:17.272181 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8b4a4-8dea-491c-b2c4-781bdab818d1 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:17.290547 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27d4e5-857f-4156-af43-cae5aee52adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:17.291552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27d4e5-857f-4156-af43-cae5aee52adf None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:17.291839 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27d4e5-857f-4156-af43-cae5aee52adf None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:17.292262 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27d4e5-857f-4156-af43-cae5aee52adf None admin] PATH_INFO: `/v3/projects/40691146f4bd45d4b515421ef1deba9e` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:17.293521 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27d4e5-857f-4156-af43-cae5aee52adf None admin] RBAC: Authorizing `identity:get_project(project_id=40691146f4bd45d4b515421ef1deba9e)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:17.294995 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27d4e5-857f-4156-af43-cae5aee52adf None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:17.296725 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 160/314] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:12:17 2022] GET /identity/v3/projects/40691146f4bd45d4b515421ef1deba9e => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:17.297943 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbccf7d-330e-4abd-9df3-299549f5aa7b None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:17.298224 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbccf7d-330e-4abd-9df3-299549f5aa7b None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:17.298496 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbccf7d-330e-4abd-9df3-299549f5aa7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:17.312883 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:17.318742 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-fdbccf7d-330e-4abd-9df3-299549f5aa7b None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:17.320180 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-fdbccf7d-330e-4abd-9df3-299549f5aa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:17.366837 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:17.402293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 161/315] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:17.403168 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbccf7d-330e-4abd-9df3-299549f5aa7b None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:17.405759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8b4a4-8dea-491c-b2c4-781bdab818d1 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:17.452582 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86aec9-c5e3-4fe4-8b61-2b49cf6c4f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:17.453229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86aec9-c5e3-4fe4-8b61-2b49cf6c4f60 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:17.453507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86aec9-c5e3-4fe4-8b61-2b49cf6c4f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:17.453780 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86aec9-c5e3-4fe4-8b61-2b49cf6c4f60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:17.535364 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbccf7d-330e-4abd-9df3-299549f5aa7b None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:17.542582 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86aec9-c5e3-4fe4-8b61-2b49cf6c4f60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:17.544106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86aec9-c5e3-4fe4-8b61-2b49cf6c4f60 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:17.582164 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:17.582664 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19337478-0e34-45a5-9765-6ce0768dc627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:17.583341 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19337478-0e34-45a5-9765-6ce0768dc627 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:17.583614 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19337478-0e34-45a5-9765-6ce0768dc627 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:17.583882 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19337478-0e34-45a5-9765-6ce0768dc627 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:17.584769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19337478-0e34-45a5-9765-6ce0768dc627 None admin] RBAC: Adding query filter params (group.id=6cfb6526f2984b1aa28060d61089a1df, role.id=bacc420f29704ec89e015525d8143d62, scope.project.id=40691146f4bd45d4b515421ef1deba9e) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:17.586087 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19337478-0e34-45a5-9765-6ce0768dc627 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:17.587360 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19337478-0e34-45a5-9765-6ce0768dc627 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:17.593663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 162/316] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 19 02:12:17 2022] GET /identity/v3/role_assignments?group.id=6cfb6526f2984b1aa28060d61089a1df&scope.project.id=40691146f4bd45d4b515421ef1deba9e&role.id=bacc420f29704ec89e015525d8143d62 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:17.602456 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5daa4-65c9-4a0c-83b8-ad00e5b41e28 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:17.602456 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5daa4-65c9-4a0c-83b8-ad00e5b41e28 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:17.602456 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5daa4-65c9-4a0c-83b8-ad00e5b41e28 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:17.602456 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 163/317] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:17.602456 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5daa4-65c9-4a0c-83b8-ad00e5b41e28 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:17.653820 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:17.674523 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 155/318] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:12:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:17.677398 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb4dac-7d3e-4035-ae6b-fb1a3489e86a None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:17.677887 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb4dac-7d3e-4035-ae6b-fb1a3489e86a None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:17.678387 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb4dac-7d3e-4035-ae6b-fb1a3489e86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:17.700201 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-fdbb4dac-7d3e-4035-ae6b-fb1a3489e86a None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:17.701911 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-fdbb4dac-7d3e-4035-ae6b-fb1a3489e86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:17.728974 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5daa4-65c9-4a0c-83b8-ad00e5b41e28 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:17.771261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b657b0-e8d5-477d-b589-d864359566e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:17.772114 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b657b0-e8d5-477d-b589-d864359566e5 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:17.772391 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b657b0-e8d5-477d-b589-d864359566e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:17.772660 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b657b0-e8d5-477d-b589-d864359566e5 None admin] PATH_INFO: `/v3/groups/6cfb6526f2984b1aa28060d61089a1df` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:17.774267 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b657b0-e8d5-477d-b589-d864359566e5 None admin] RBAC: Authorizing `identity:get_group(group_id=6cfb6526f2984b1aa28060d61089a1df)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:17.776179 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b657b0-e8d5-477d-b589-d864359566e5 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:17.777750 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 164/319] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 19 02:12:17 2022] GET /identity/v3/groups/6cfb6526f2984b1aa28060d61089a1df => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:17.778544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b657b0-e8d5-477d-b589-d864359566e5 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:17.786321 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 156/320] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:17.791788 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb4dac-7d3e-4035-ae6b-fb1a3489e86a None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:17.870164 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:17.895515 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b657b0-e8d5-477d-b589-d864359566e5 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:17.904427 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:17.923630 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb4dac-7d3e-4035-ae6b-fb1a3489e86a None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:17.943159 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd117958-8616-4043-8747-8a18156b3094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:17.943918 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd117958-8616-4043-8747-8a18156b3094 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:17.944268 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd117958-8616-4043-8747-8a18156b3094 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:17.944613 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd117958-8616-4043-8747-8a18156b3094 None admin] PATH_INFO: `/v3/projects/c277629bc0e74ec98f23ed36d4f266d6` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:17.945908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd117958-8616-4043-8747-8a18156b3094 None admin] RBAC: Authorizing `identity:get_project(project_id=c277629bc0e74ec98f23ed36d4f266d6)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:17.947402 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd117958-8616-4043-8747-8a18156b3094 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:17.949258 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 165/321] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:12:17 2022] GET /identity/v3/projects/c277629bc0e74ec98f23ed36d4f266d6 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:17.949820 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd117958-8616-4043-8747-8a18156b3094 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:17.969575 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e7792-3f66-4912-9211-17fe4ee7d583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:17.970581 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e7792-3f66-4912-9211-17fe4ee7d583 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:17.971598 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e7792-3f66-4912-9211-17fe4ee7d583 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:17.972794 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e7792-3f66-4912-9211-17fe4ee7d583 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:17.988777 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e7792-3f66-4912-9211-17fe4ee7d583 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:17.994179 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-de1e7792-3f66-4912-9211-17fe4ee7d583 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 02:12:17.994179 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:17.994179 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:17.994179 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:17.994179 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:17.994179 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:17.994179 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:17.994179 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:17.994179 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:17.994179 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:17.994179 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:17.994179 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:17.994179 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:17.994179 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:17.994179 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:17.994179 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:17.995098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:17.995098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:17.995098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:17.995098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:17.995098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:17.995098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:17.995098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:17.995098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:17.995098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:17.995098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:17.995098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:17.995098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:17.995098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:17.995098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:17.995098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:17.995098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:17.995946 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:17.995946 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:17.995946 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:17.995946 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:17.995946 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:17.995946 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:17.995946 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:17.995946 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:17.995946 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:17.995946 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:17.995946 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 02:12:17.995946 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:17.995946 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 157/322] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 02:12:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:17.996604 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e7792-3f66-4912-9211-17fe4ee7d583 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:18.073887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd117958-8616-4043-8747-8a18156b3094 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:18.111224 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa6a26-4e02-4ac1-b785-bef3f0e78bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:18.112592 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa6a26-4e02-4ac1-b785-bef3f0e78bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:18.112866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa6a26-4e02-4ac1-b785-bef3f0e78bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:18.113135 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa6a26-4e02-4ac1-b785-bef3f0e78bc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:18.113857 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa6a26-4e02-4ac1-b785-bef3f0e78bc3 None admin] RBAC: Adding query filter params (group.id=6cfb6526f2984b1aa28060d61089a1df, role.id=619c0bef418849679ac636aa63923dc9, scope.project.id=40691146f4bd45d4b515421ef1deba9e) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:18.114158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa6a26-4e02-4ac1-b785-bef3f0e78bc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:18.115615 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa6a26-4e02-4ac1-b785-bef3f0e78bc3 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:18.121490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e7792-3f66-4912-9211-17fe4ee7d583 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:18.121692 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 166/323] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 19 02:12:17 2022] GET /identity/v3/role_assignments?group.id=6cfb6526f2984b1aa28060d61089a1df&scope.project.id=40691146f4bd45d4b515421ef1deba9e&role.id=619c0bef418849679ac636aa63923dc9 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:18.121692 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa6a26-4e02-4ac1-b785-bef3f0e78bc3 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:18.152882 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:18.175154 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baccd64-a523-4fb2-89a0-d2bb6c665969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:18.175810 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baccd64-a523-4fb2-89a0-d2bb6c665969 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:18.176091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baccd64-a523-4fb2-89a0-d2bb6c665969 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:18.181103 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baccd64-a523-4fb2-89a0-d2bb6c665969 None admin] PATH_INFO: `/v3/groups/6cfb6526f2984b1aa28060d61089a1df` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:18.181103 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baccd64-a523-4fb2-89a0-d2bb6c665969 None admin] RBAC: Authorizing `identity:get_group(group_id=6cfb6526f2984b1aa28060d61089a1df)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:18.181103 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baccd64-a523-4fb2-89a0-d2bb6c665969 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:18.181364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 158/324] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 19 02:12:17 2022] GET /identity/v3/groups/6cfb6526f2984b1aa28060d61089a1df => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:18.182204 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baccd64-a523-4fb2-89a0-d2bb6c665969 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:18.187243 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:18.281356 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa6a26-4e02-4ac1-b785-bef3f0e78bc3 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:18.330014 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baccd64-a523-4fb2-89a0-d2bb6c665969 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:18.336693 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcdb81-e6f9-4c5e-a4c3-924be26fd01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:18.337312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcdb81-e6f9-4c5e-a4c3-924be26fd01d None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:18.337597 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcdb81-e6f9-4c5e-a4c3-924be26fd01d None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:18.337867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcdb81-e6f9-4c5e-a4c3-924be26fd01d None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:18.338964 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdcdb81-e6f9-4c5e-a4c3-924be26fd01d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:18.338964 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdcdb81-e6f9-4c5e-a4c3-924be26fd01d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:18.340250 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdcdb81-e6f9-4c5e-a4c3-924be26fd01d None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:18.351543 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 167/325] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:12:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:18.352246 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcdb81-e6f9-4c5e-a4c3-924be26fd01d None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:18.379143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbad80f-7902-419e-9559-a6a3f4543827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:18.380489 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbad80f-7902-419e-9559-a6a3f4543827 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:18.380489 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbad80f-7902-419e-9559-a6a3f4543827 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:18.380489 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbad80f-7902-419e-9559-a6a3f4543827 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:18.393070 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbad80f-7902-419e-9559-a6a3f4543827 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:18.400125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-ebbad80f-7902-419e-9559-a6a3f4543827 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:12:18.400125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:18.400125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:18.400125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:18.400125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:18.400125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:18.400125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:18.400125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:18.400125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:18.400125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:18.400125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:18.400125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:18.400125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:18.400125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:18.400125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:18.400125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:18.401233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:18.401233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:18.401233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:18.401233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:18.401233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:18.401233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:18.401233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:18.401233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:18.401233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:18.401233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:18.401233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:18.401233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:18.401233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:18.401233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:18.401233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:18.401233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:18.402225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:18.402225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:18.402225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:18.402225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:18.402225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:18.402225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:18.402225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:18.402225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:18.402225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:18.402225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:18.402225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:12:18.402225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:18.403915 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 159/326] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 02:12:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:18.404524 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbad80f-7902-419e-9559-a6a3f4543827 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:18.467436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:18.479353 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:18.482365 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcdb81-e6f9-4c5e-a4c3-924be26fd01d None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:18.522383 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb5b09-da93-4a65-83e3-222e21bd4a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:18.523075 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb5b09-da93-4a65-83e3-222e21bd4a0f None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:18.523356 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb5b09-da93-4a65-83e3-222e21bd4a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:18.523628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb5b09-da93-4a65-83e3-222e21bd4a0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:18.524359 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb5b09-da93-4a65-83e3-222e21bd4a0f None admin] RBAC: Adding query filter params (group.id=6cfb6526f2984b1aa28060d61089a1df, role.id=bacc420f29704ec89e015525d8143d62, scope.project.id=c277629bc0e74ec98f23ed36d4f266d6) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:18.524671 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb5b09-da93-4a65-83e3-222e21bd4a0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:18.526127 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb5b09-da93-4a65-83e3-222e21bd4a0f None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:18.532950 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 168/327] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 19 02:12:18 2022] GET /identity/v3/role_assignments?group.id=6cfb6526f2984b1aa28060d61089a1df&scope.project.id=c277629bc0e74ec98f23ed36d4f266d6&role.id=bacc420f29704ec89e015525d8143d62 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:18.534405 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb5b09-da93-4a65-83e3-222e21bd4a0f None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:18.536593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbad80f-7902-419e-9559-a6a3f4543827 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:18.593354 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f99bb3-3ad6-4751-81d9-016d9d1b12b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:18.593354 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f99bb3-3ad6-4751-81d9-016d9d1b12b7 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:18.593354 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f99bb3-3ad6-4751-81d9-016d9d1b12b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:18.593354 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f99bb3-3ad6-4751-81d9-016d9d1b12b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:18.675329 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb5b09-da93-4a65-83e3-222e21bd4a0f None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:18.689154 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f99bb3-3ad6-4751-81d9-016d9d1b12b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:18.692421 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f99bb3-3ad6-4751-81d9-016d9d1b12b7 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:18.715785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11636469-404d-4a78-8a58-a22ba3efe17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:18.716408 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11636469-404d-4a78-8a58-a22ba3efe17c None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:18.716683 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11636469-404d-4a78-8a58-a22ba3efe17c None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:18.717019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11636469-404d-4a78-8a58-a22ba3efe17c None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:18.718142 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11636469-404d-4a78-8a58-a22ba3efe17c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:18.718459 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11636469-404d-4a78-8a58-a22ba3efe17c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:18.719903 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11636469-404d-4a78-8a58-a22ba3efe17c None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:18.729238 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 169/328] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:12:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:18.735017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11636469-404d-4a78-8a58-a22ba3efe17c None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:18.750356 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:18.767016 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:18.818387 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 160/329] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:12:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:18.824134 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f99bb3-3ad6-4751-81d9-016d9d1b12b7 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:18.855135 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11636469-404d-4a78-8a58-a22ba3efe17c None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:18.896864 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d63f4a-74b0-4cec-ad20-cf4849eda92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:18.897820 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d63f4a-74b0-4cec-ad20-cf4849eda92e None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:18.898281 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d63f4a-74b0-4cec-ad20-cf4849eda92e None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:18.898745 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d63f4a-74b0-4cec-ad20-cf4849eda92e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:18.948070 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f99bb3-3ad6-4751-81d9-016d9d1b12b7 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:18.976016 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d63f4a-74b0-4cec-ad20-cf4849eda92e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:18.977470 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d63f4a-74b0-4cec-ad20-cf4849eda92e None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:18.982959 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfb45c-23c0-4e3b-bc99-4b915c86962a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:18.983593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfb45c-23c0-4e3b-bc99-4b915c86962a None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:18.983870 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfb45c-23c0-4e3b-bc99-4b915c86962a None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:18.984265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfb45c-23c0-4e3b-bc99-4b915c86962a None admin] PATH_INFO: `/v3/projects/c277629bc0e74ec98f23ed36d4f266d6` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:18.985380 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bfb45c-23c0-4e3b-bc99-4b915c86962a None admin] RBAC: Authorizing `identity:get_project(project_id=c277629bc0e74ec98f23ed36d4f266d6)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:18.986917 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bfb45c-23c0-4e3b-bc99-4b915c86962a None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:18.988555 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 161/330] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:12:18 2022] GET /identity/v3/projects/c277629bc0e74ec98f23ed36d4f266d6 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:18.994112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfb45c-23c0-4e3b-bc99-4b915c86962a None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:19.003018 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:19.012232 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:19.075640 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 170/331] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:12:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 19 02:12:19.081763 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d63f4a-74b0-4cec-ad20-cf4849eda92e None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:19.096476 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfb45c-23c0-4e3b-bc99-4b915c86962a None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:19.129782 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ef245-5783-4d7b-af15-d4d719c154d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:19.130337 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ef245-5783-4d7b-af15-d4d719c154d1 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:19.130649 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ef245-5783-4d7b-af15-d4d719c154d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:19.130955 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ef245-5783-4d7b-af15-d4d719c154d1 None admin] PATH_INFO: `/v3/groups/6cfb6526f2984b1aa28060d61089a1df` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:19.132056 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ef245-5783-4d7b-af15-d4d719c154d1 None admin] RBAC: Authorizing `identity:get_group(group_id=6cfb6526f2984b1aa28060d61089a1df)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:19.133494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ef245-5783-4d7b-af15-d4d719c154d1 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:19.135106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 162/332] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 19 02:12:18 2022] GET /identity/v3/groups/6cfb6526f2984b1aa28060d61089a1df => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:19.140976 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ef245-5783-4d7b-af15-d4d719c154d1 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:19.178986 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d63f4a-74b0-4cec-ad20-cf4849eda92e None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:19.204673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:19.212875 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34a4b2-75a3-489e-9e82-f3efc189356e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:19.213511 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34a4b2-75a3-489e-9e82-f3efc189356e None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:19.213789 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34a4b2-75a3-489e-9e82-f3efc189356e None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:19.214059 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34a4b2-75a3-489e-9e82-f3efc189356e None admin] PATH_INFO: `/v3/projects/223a4736f80b47779a253b8ee6250bb6` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:19.215597 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34a4b2-75a3-489e-9e82-f3efc189356e None admin] RBAC: Authorizing `identity:get_project(project_id=223a4736f80b47779a253b8ee6250bb6)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:19.237456 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34a4b2-75a3-489e-9e82-f3efc189356e None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:19.237456 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 171/333] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:12:19 2022] GET /identity/v3/projects/223a4736f80b47779a253b8ee6250bb6 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:19.237456 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34a4b2-75a3-489e-9e82-f3efc189356e None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:19.237735 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:19.240480 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ef245-5783-4d7b-af15-d4d719c154d1 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:19.273022 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d531f-002c-452b-90cf-0bda0aa9d5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:19.273621 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d531f-002c-452b-90cf-0bda0aa9d5bf None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:19.273895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d531f-002c-452b-90cf-0bda0aa9d5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:19.274164 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d531f-002c-452b-90cf-0bda0aa9d5bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:19.274913 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d531f-002c-452b-90cf-0bda0aa9d5bf None admin] RBAC: Adding query filter params (group.id=6cfb6526f2984b1aa28060d61089a1df, role.id=619c0bef418849679ac636aa63923dc9, scope.project.id=c277629bc0e74ec98f23ed36d4f266d6) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:19.275219 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d531f-002c-452b-90cf-0bda0aa9d5bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:19.276691 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d531f-002c-452b-90cf-0bda0aa9d5bf None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:19.282216 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 163/334] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 19 02:12:19 2022] GET /identity/v3/role_assignments?group.id=6cfb6526f2984b1aa28060d61089a1df&scope.project.id=c277629bc0e74ec98f23ed36d4f266d6&role.id=619c0bef418849679ac636aa63923dc9 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:19.328297 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34a4b2-75a3-489e-9e82-f3efc189356e None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:19.364592 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee6717-e0eb-48fb-8819-bb3af5b73244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:19.365238 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee6717-e0eb-48fb-8819-bb3af5b73244 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:19.365515 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee6717-e0eb-48fb-8819-bb3af5b73244 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:19.365792 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee6717-e0eb-48fb-8819-bb3af5b73244 None admin] PATH_INFO: `/v3/groups/5341f49e47de4d0ea3c3cae8b7e5b9fd` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:19.366977 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee6717-e0eb-48fb-8819-bb3af5b73244 None admin] RBAC: Authorizing `identity:get_group(group_id=5341f49e47de4d0ea3c3cae8b7e5b9fd)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:19.368425 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee6717-e0eb-48fb-8819-bb3af5b73244 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:19.370028 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 172/335] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 19 02:12:19 2022] GET /identity/v3/groups/5341f49e47de4d0ea3c3cae8b7e5b9fd => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:19.376161 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d531f-002c-452b-90cf-0bda0aa9d5bf None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:19.483929 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d531f-002c-452b-90cf-0bda0aa9d5bf None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:19.518533 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12106d1-0c5a-46c3-bc76-a741afe9e372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:19.519256 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12106d1-0c5a-46c3-bc76-a741afe9e372 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:19.519539 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12106d1-0c5a-46c3-bc76-a741afe9e372 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:19.519806 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12106d1-0c5a-46c3-bc76-a741afe9e372 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:19.520527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12106d1-0c5a-46c3-bc76-a741afe9e372 None admin] RBAC: Adding query filter params (group.id=5341f49e47de4d0ea3c3cae8b7e5b9fd, role.id=e2e7c80d19c141bc9f9bfc13c2ec2a12, scope.project.id=223a4736f80b47779a253b8ee6250bb6) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:19.520831 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12106d1-0c5a-46c3-bc76-a741afe9e372 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:19.522335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12106d1-0c5a-46c3-bc76-a741afe9e372 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:19.528261 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 164/336] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 19 02:12:19 2022] GET /identity/v3/role_assignments?group.id=5341f49e47de4d0ea3c3cae8b7e5b9fd&scope.project.id=223a4736f80b47779a253b8ee6250bb6&role.id=e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:22.062581 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04305684-3d31-4ad9-95fb-534e7c064ab6 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:22.063168 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04305684-3d31-4ad9-95fb-534e7c064ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:22.063168 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04305684-3d31-4ad9-95fb-534e7c064ab6 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:22.064525 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 173/337] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:22.081355 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57928ec6-7675-46bf-b65e-0d876d1af909 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:22.082296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57928ec6-7675-46bf-b65e-0d876d1af909 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:22.082769 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57928ec6-7675-46bf-b65e-0d876d1af909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:22.112430 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-57928ec6-7675-46bf-b65e-0d876d1af909 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:22.114044 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-57928ec6-7675-46bf-b65e-0d876d1af909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:22.123092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:22.199472 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 165/338] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:22.606957 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bd552-c739-45e6-9e4b-546fbcb73cc6 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:22.607693 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bd552-c739-45e6-9e4b-546fbcb73cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:22.608178 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bd552-c739-45e6-9e4b-546fbcb73cc6 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:22.609727 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 174/339] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:22.616817 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e235ee4-62c4-4264-84a0-784bbc8b765b None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:22.617362 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e235ee4-62c4-4264-84a0-784bbc8b765b None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:22.617848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e235ee4-62c4-4264-84a0-784bbc8b765b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:22.644696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-5e235ee4-62c4-4264-84a0-784bbc8b765b None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:22.646224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-5e235ee4-62c4-4264-84a0-784bbc8b765b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:22.693088 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed334a68-cd0f-400e-87c6-20ee3fab0eed None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:22.693660 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed334a68-cd0f-400e-87c6-20ee3fab0eed None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:22.694182 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed334a68-cd0f-400e-87c6-20ee3fab0eed None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:22.696033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 175/340] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:22.700550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed334a68-cd0f-400e-87c6-20ee3fab0eed None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:22.733176 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 166/341] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:22.734440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b7c8b-70f9-4ad5-8340-fb20bff0f8c6 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:22.734719 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b7c8b-70f9-4ad5-8340-fb20bff0f8c6 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:22.739106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b7c8b-70f9-4ad5-8340-fb20bff0f8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:22.781483 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-974b7c8b-70f9-4ad5-8340-fb20bff0f8c6 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:22.783135 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-974b7c8b-70f9-4ad5-8340-fb20bff0f8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:22.810279 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:22.858111 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed334a68-cd0f-400e-87c6-20ee3fab0eed None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:22.895955 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b6984-a64a-4a9e-81d1-8581d51b9a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:22.896936 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b6984-a64a-4a9e-81d1-8581d51b9a68 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:22.897410 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b6984-a64a-4a9e-81d1-8581d51b9a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:22.897874 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b6984-a64a-4a9e-81d1-8581d51b9a68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:22.910331 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b6984-a64a-4a9e-81d1-8581d51b9a68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:22.912165 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b6984-a64a-4a9e-81d1-8581d51b9a68 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:22.927933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-1a8b6984-a64a-4a9e-81d1-8581d51b9a68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:22.927933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:22.927933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:22.927933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:22.927933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:22.927933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:22.927933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:22.927933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:22.927933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:22.927933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:22.927933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:22.927933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:22.927933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:22.927933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:22.927933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:22.927933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:22.928920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:22.928920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:22.928920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:22.928920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:22.928920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:22.928920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:22.928920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:22.928920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:22.928920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:22.928920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:22.928920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:22.928920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:22.928920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:22.928920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:22.928920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:22.928920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:22.928920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:22.929779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:22.929779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:22.929779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:22.931576 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 176/342] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:12:22.938056 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d61f62-0d1f-4553-b1af-a70769ceeefd None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:22.938592 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d61f62-0d1f-4553-b1af-a70769ceeefd None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:22.939095 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d61f62-0d1f-4553-b1af-a70769ceeefd None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:22.941378 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 177/343] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:22.942262 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d61f62-0d1f-4553-b1af-a70769ceeefd None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:22.956306 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 167/344] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:22.958133 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494660a-452b-479e-b42d-2c453b5f43d3 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:22.958639 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494660a-452b-479e-b42d-2c453b5f43d3 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:22.959279 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494660a-452b-479e-b42d-2c453b5f43d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:22.967118 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:22.987845 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-e494660a-452b-479e-b42d-2c453b5f43d3 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:22.990980 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-e494660a-452b-479e-b42d-2c453b5f43d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:23.078904 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d61f62-0d1f-4553-b1af-a70769ceeefd None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:23.093961 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:23.106441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 168/345] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:23.107412 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494660a-452b-479e-b42d-2c453b5f43d3 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:23.116770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90002bce-4fca-4d39-9d93-8dea678a8f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:23.117721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90002bce-4fca-4d39-9d93-8dea678a8f56 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:23.118208 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90002bce-4fca-4d39-9d93-8dea678a8f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:23.118677 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90002bce-4fca-4d39-9d93-8dea678a8f56 None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:23.119545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90002bce-4fca-4d39-9d93-8dea678a8f56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:23.120057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90002bce-4fca-4d39-9d93-8dea678a8f56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:23.121687 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90002bce-4fca-4d39-9d93-8dea678a8f56 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:23.136300 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 178/346] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:23.145649 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90002bce-4fca-4d39-9d93-8dea678a8f56 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:23.268751 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494660a-452b-479e-b42d-2c453b5f43d3 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:23.307007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:23.307235 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90002bce-4fca-4d39-9d93-8dea678a8f56 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:23.318721 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f3626-c67f-4051-8c28-b64f43a5804d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:23.319386 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f3626-c67f-4051-8c28-b64f43a5804d None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:23.319664 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f3626-c67f-4051-8c28-b64f43a5804d None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:23.320528 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f3626-c67f-4051-8c28-b64f43a5804d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:23.337065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f3626-c67f-4051-8c28-b64f43a5804d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:23.339276 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f3626-c67f-4051-8c28-b64f43a5804d None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:23.359266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-893f3626-c67f-4051-8c28-b64f43a5804d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:23.359266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:23.359266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:23.359266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:23.359266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:23.359266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:23.359266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:23.359266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:23.359266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:23.359266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:23.359266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:23.359266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:23.359266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:23.359266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:23.359266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:23.359266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:23.360220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:23.360220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:23.360220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:23.360220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:23.360220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:23.360220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:23.360220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:23.360220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:23.360220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:23.360220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:23.360220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:23.360220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:23.360220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:23.360220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:23.360220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:23.360220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:23.360220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:23.361093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:23.361093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:23.361093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:23.361093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 169/347] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:23.361093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f3626-c67f-4051-8c28-b64f43a5804d None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:23.371333 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acb839-abb6-47f8-b3ff-2fb8e411fb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:23.371879 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acb839-abb6-47f8-b3ff-2fb8e411fb0f None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:23.372158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acb839-abb6-47f8-b3ff-2fb8e411fb0f None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:23.372432 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acb839-abb6-47f8-b3ff-2fb8e411fb0f None admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:23.373083 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69acb839-abb6-47f8-b3ff-2fb8e411fb0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:23.374512 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69acb839-abb6-47f8-b3ff-2fb8e411fb0f None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:23.465749 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 179/348] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 02:12:23 2022] POST /identity/v3/users => generated 246 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:12:23.465749 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acb839-abb6-47f8-b3ff-2fb8e411fb0f None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:23.491340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f3626-c67f-4051-8c28-b64f43a5804d None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:23.515230 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:23.548850 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8111f7-22ac-4014-bd9b-d71451c69e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:23.549652 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8111f7-22ac-4014-bd9b-d71451c69e21 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:23.561674 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8111f7-22ac-4014-bd9b-d71451c69e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:23.561674 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8111f7-22ac-4014-bd9b-d71451c69e21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:23.570505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8111f7-22ac-4014-bd9b-d71451c69e21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:23.572492 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8111f7-22ac-4014-bd9b-d71451c69e21 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:23.594557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-2a8111f7-22ac-4014-bd9b-d71451c69e21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:23.594557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:23.594557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:23.594557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:23.594557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:23.594557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:23.594557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:23.594557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:23.594557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:23.594557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:23.594557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:23.594557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:23.594557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:23.594557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:23.594557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:23.594557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:23.597031 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:23.597031 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:23.597031 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:23.597031 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:23.597031 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:23.597031 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:23.597031 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:23.597031 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:23.597031 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:23.597031 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:23.597031 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:23.597031 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:23.597031 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:23.597031 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:23.597031 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:23.597031 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:23.597031 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:23.597888 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:23.597888 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:23.597888 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:23.604250 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 170/349] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:23.605494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8111f7-22ac-4014-bd9b-d71451c69e21 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:23.609219 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acb839-abb6-47f8-b3ff-2fb8e411fb0f None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:23.649006 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:23.651893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4aced7-d1e1-4e96-b026-bd50af47bbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:23.652508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4aced7-d1e1-4e96-b026-bd50af47bbab None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:23.652784 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4aced7-d1e1-4e96-b026-bd50af47bbab None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:23.653055 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4aced7-d1e1-4e96-b026-bd50af47bbab None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:23.653706 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4aced7-d1e1-4e96-b026-bd50af47bbab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:23.654008 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4aced7-d1e1-4e96-b026-bd50af47bbab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:23.655459 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4aced7-d1e1-4e96-b026-bd50af47bbab None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:23.669944 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 180/350] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:23.670769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4aced7-d1e1-4e96-b026-bd50af47bbab None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:23.727230 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8111f7-22ac-4014-bd9b-d71451c69e21 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:23.763847 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52755902-3773-42dc-8dd7-f40f9ed658b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:23.764509 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52755902-3773-42dc-8dd7-f40f9ed658b1 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:23.764864 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52755902-3773-42dc-8dd7-f40f9ed658b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:23.765136 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52755902-3773-42dc-8dd7-f40f9ed658b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:23.777501 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52755902-3773-42dc-8dd7-f40f9ed658b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:23.779032 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52755902-3773-42dc-8dd7-f40f9ed658b1 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:23.789054 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:23.798880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-52755902-3773-42dc-8dd7-f40f9ed658b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:23.798880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:23.798880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:23.798880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:23.798880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:23.798880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:23.798880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:23.798880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:23.798880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:23.798880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:23.798880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:23.798880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:23.798880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:23.798880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:23.798880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:23.798880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:23.800562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:23.800562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:23.800562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:23.800562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:23.800562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:23.800562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:23.800562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:23.800562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:23.800562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:23.800562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:23.800562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:23.800562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:23.800562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:23.800562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:23.800562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:23.800562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:23.800562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:23.801438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:23.801438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:23.801438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:23.804335 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4aced7-d1e1-4e96-b026-bd50af47bbab None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:23.805733 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 171/351] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:23.806521 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52755902-3773-42dc-8dd7-f40f9ed658b1 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:23.849655 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce916b9-6792-4c1e-bcf6-a93b6b40b95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:23.850662 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce916b9-6792-4c1e-bcf6-a93b6b40b95f None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:23.851166 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce916b9-6792-4c1e-bcf6-a93b6b40b95f None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:23.851639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce916b9-6792-4c1e-bcf6-a93b6b40b95f None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:23.852527 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce916b9-6792-4c1e-bcf6-a93b6b40b95f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:23.853279 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce916b9-6792-4c1e-bcf6-a93b6b40b95f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:23.855127 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce916b9-6792-4c1e-bcf6-a93b6b40b95f None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:23.869951 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 181/352] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:23.876274 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce916b9-6792-4c1e-bcf6-a93b6b40b95f None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:23.909798 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:23.921835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52755902-3773-42dc-8dd7-f40f9ed658b1 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:23.959149 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c042951-e7ac-4074-b118-6776d2ec1bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:23.959766 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c042951-e7ac-4074-b118-6776d2ec1bb6 None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:23.960046 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c042951-e7ac-4074-b118-6776d2ec1bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:23.960316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c042951-e7ac-4074-b118-6776d2ec1bb6 None admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:23.960956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c042951-e7ac-4074-b118-6776d2ec1bb6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:23.962396 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c042951-e7ac-4074-b118-6776d2ec1bb6 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:23.983871 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce916b9-6792-4c1e-bcf6-a93b6b40b95f None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:24.018735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c484135-0dd0-416a-b93b-c56ebd4d5e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:24.019371 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c484135-0dd0-416a-b93b-c56ebd4d5e7e None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:24.019673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c484135-0dd0-416a-b93b-c56ebd4d5e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:24.019939 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c484135-0dd0-416a-b93b-c56ebd4d5e7e None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:24.020579 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c484135-0dd0-416a-b93b-c56ebd4d5e7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:24.020941 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c484135-0dd0-416a-b93b-c56ebd4d5e7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:24.022325 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c484135-0dd0-416a-b93b-c56ebd4d5e7e None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:24.038851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 182/353] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:24.038851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c484135-0dd0-416a-b93b-c56ebd4d5e7e None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:24.047946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:24.049637 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 172/354] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 02:12:23 2022] POST /identity/v3/users => generated 248 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:12:24.051182 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fb64a-f2fe-43ae-8928-057d2b170927 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:24.051539 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fb64a-f2fe-43ae-8928-057d2b170927 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:24.051891 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fb64a-f2fe-43ae-8928-057d2b170927 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:24.057611 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 173/355] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:24.057611 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fb64a-f2fe-43ae-8928-057d2b170927 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:24.159702 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c484135-0dd0-416a-b93b-c56ebd4d5e7e None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:24.198538 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fb64a-f2fe-43ae-8928-057d2b170927 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:24.199093 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce6a6d-fb40-4968-b52f-d857d27abc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:24.199421 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce6a6d-fb40-4968-b52f-d857d27abc8e None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:24.199946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce6a6d-fb40-4968-b52f-d857d27abc8e None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:24.200321 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce6a6d-fb40-4968-b52f-d857d27abc8e None admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:24.201105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce6a6d-fb40-4968-b52f-d857d27abc8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:24.202758 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce6a6d-fb40-4968-b52f-d857d27abc8e None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:24.249255 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7e888-6e39-4a53-b7da-0a1e6a6187eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:24.249875 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7e888-6e39-4a53-b7da-0a1e6a6187eb None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:24.250154 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7e888-6e39-4a53-b7da-0a1e6a6187eb None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:24.250428 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7e888-6e39-4a53-b7da-0a1e6a6187eb None admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:24.251104 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7e888-6e39-4a53-b7da-0a1e6a6187eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:24.253174 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7e888-6e39-4a53-b7da-0a1e6a6187eb None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:24.325636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 183/356] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 02:12:24 2022] POST /identity/v3/users => generated 248 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:12:24.331733 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd3a7f-ecb5-4c4b-b5e8-f25642f1779d None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:24.332025 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd3a7f-ecb5-4c4b-b5e8-f25642f1779d None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:24.332306 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd3a7f-ecb5-4c4b-b5e8-f25642f1779d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:24.355427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:24.356155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-a2cd3a7f-ecb5-4c4b-b5e8-f25642f1779d None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:24.362655 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 174/357] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 02:12:24 2022] POST /identity/v3/users => generated 249 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:12:24.363461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-a2cd3a7f-ecb5-4c4b-b5e8-f25642f1779d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:24.441926 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:24.455139 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 184/358] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:24.733257 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7e888-6e39-4a53-b7da-0a1e6a6187eb None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:24.856973 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7e888-6e39-4a53-b7da-0a1e6a6187eb None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:24.897118 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e33665-06ae-4630-865e-9521fc8f5da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:24.897729 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e33665-06ae-4630-865e-9521fc8f5da3 None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:24.898005 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e33665-06ae-4630-865e-9521fc8f5da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:24.898276 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e33665-06ae-4630-865e-9521fc8f5da3 None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:24.898981 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e33665-06ae-4630-865e-9521fc8f5da3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:24.900415 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e33665-06ae-4630-865e-9521fc8f5da3 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:24.951215 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.sql.core [None req-a1e33665-06ae-4630-865e-9521fc8f5da3 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 19 02:12:24.951215 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 19 02:12:24.951215 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [parameters: {'id': 'b2374e1350cf47fba38cee933253a7f0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 19 02:12:24.951215 dv-cinder-861491-4-smb devstack@keystone.service[81671]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81671) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 02:12:24.968290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-a1e33665-06ae-4630-865e-9521fc8f5da3 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 19 02:12:24.968290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:24.968290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 02:12:24.968290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 02:12:24.968290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 02:12:24.968290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 02:12:24.968290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 02:12:24.968290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 02:12:24.968290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 02:12:24.968290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application conn.query(q) Oct 19 02:12:24.968290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 02:12:24.968290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 02:12:24.968290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 02:12:24.968290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application result.read() Oct 19 02:12:24.968290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 02:12:24.969214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 02:12:24.969214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 02:12:24.969214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 02:12:24.969214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 02:12:24.969214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 02:12:24.969214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 02:12:24.969214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 02:12:24.969214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 19 02:12:24.969214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:24.969214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 02:12:24.969214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:24.969214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:24.969214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 02:12:24.969214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 02:12:24.969214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 19 02:12:24.969214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return ref.to_dict() Oct 19 02:12:24.969214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 02:12:24.969214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application next(self.gen) Oct 19 02:12:24.970144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 02:12:24.970144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application yield resource Oct 19 02:12:24.970144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 02:12:24.970144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application next(self.gen) Oct 19 02:12:24.970144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 02:12:24.970144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 02:12:24.970144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 02:12:24.970144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 02:12:24.970144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 02:12:24.970144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise self.value Oct 19 02:12:24.970144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 02:12:24.970144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 02:12:24.970144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 02:12:24.970144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application session.commit() Oct 19 02:12:24.970144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 02:12:24.970144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 02:12:24.970144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 02:12:24.971082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 02:12:24.971082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 02:12:24.971082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application self.session.flush() Oct 19 02:12:24.971082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 02:12:24.971082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 02:12:24.971082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 02:12:24.971082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 02:12:24.971082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 02:12:24.971082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application compat.raise_( Oct 19 02:12:24.971082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 02:12:24.971082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception Oct 19 02:12:24.971082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 02:12:24.971082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 02:12:24.971082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 02:12:24.971082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 02:12:24.971082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 02:12:24.971082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 02:12:24.972017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 02:12:24.972017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 02:12:24.972017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 19 02:12:24.972017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 19 02:12:24.972017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 02:12:24.972017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 02:12:24.972017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 02:12:24.972017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 02:12:24.972017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 02:12:24.972017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 02:12:24.972017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 02:12:24.972017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 02:12:24.972017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 02:12:24.972017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 02:12:24.972017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 02:12:24.972017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception Oct 19 02:12:24.972831 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 02:12:24.972831 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 02:12:24.972831 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 02:12:24.972831 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 02:12:24.972831 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 02:12:24.972831 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 02:12:24.972831 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 02:12:24.972831 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application conn.query(q) Oct 19 02:12:24.972831 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 02:12:24.972831 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 02:12:24.972831 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 02:12:24.972831 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application result.read() Oct 19 02:12:24.972831 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 02:12:24.972831 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 02:12:24.972831 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 02:12:24.972831 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 02:12:24.973605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 02:12:24.973605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 02:12:24.973605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 02:12:24.973605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 02:12:24.973605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 19 02:12:24.973605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 19 02:12:24.973605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [parameters: {'id': 'b2374e1350cf47fba38cee933253a7f0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 19 02:12:24.973605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 02:12:24.973605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:24.973605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:12:24.973605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:24.973605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:24.973605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:24.973605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:24.973605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:24.973605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:24.974408 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:24.974408 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:24.974408 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:24.974408 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:24.974408 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:24.974408 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:24.974408 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 19 02:12:24.974408 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 19 02:12:24.974408 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:24.974408 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:24.974408 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 19 02:12:24.974408 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 19 02:12:24.974408 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 02:12:24.974408 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 02:12:24.974408 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 19 02:12:24.974408 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:24.977592 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 175/359] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Oct 19 02:12:24 2022] POST /identity/v3/roles => generated 144 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:24.977735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd3a7f-ecb5-4c4b-b5e8-f25642f1779d None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:25.096206 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd3a7f-ecb5-4c4b-b5e8-f25642f1779d None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:25.131962 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e3dc3-b76a-4588-bfd8-8cd5392e3e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:25.132599 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e3dc3-b76a-4588-bfd8-8cd5392e3e2b None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:25.132872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e3dc3-b76a-4588-bfd8-8cd5392e3e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:25.133139 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e3dc3-b76a-4588-bfd8-8cd5392e3e2b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:25.143747 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e3dc3-b76a-4588-bfd8-8cd5392e3e2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:25.148751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-975e3dc3-b76a-4588-bfd8-8cd5392e3e2b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 02:12:25.148751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:25.148751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:25.148751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:25.148751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:25.148751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:25.148751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:25.148751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:25.148751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:25.148751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:25.148751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:25.148751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:25.148751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:25.148751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:25.148751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:25.148751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:25.150779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:25.150779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:25.150779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:25.150779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:25.150779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:25.150779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:25.150779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:25.150779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:25.150779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:25.150779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:25.150779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:25.150779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:25.150779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:25.150779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:25.150779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:25.150779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:25.152750 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:25.152750 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:25.152750 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:25.152750 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:25.152750 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:25.152750 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:25.152750 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:25.152750 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:25.152750 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:25.152750 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:25.152750 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 02:12:25.152750 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:25.154847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 185/360] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 02:12:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:25.157043 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e33665-06ae-4630-865e-9521fc8f5da3 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:25.256278 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:25.318038 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e33665-06ae-4630-865e-9521fc8f5da3 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:25.367527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab7ae1-b6ed-47f9-8bb0-e2cdd507db3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:25.368303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab7ae1-b6ed-47f9-8bb0-e2cdd507db3d None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:25.368589 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab7ae1-b6ed-47f9-8bb0-e2cdd507db3d None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:25.368851 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab7ae1-b6ed-47f9-8bb0-e2cdd507db3d None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:25.369565 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab7ae1-b6ed-47f9-8bb0-e2cdd507db3d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:25.369865 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab7ae1-b6ed-47f9-8bb0-e2cdd507db3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:25.371281 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab7ae1-b6ed-47f9-8bb0-e2cdd507db3d None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:25.380614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 176/361] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:12:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:25.946659 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e526e09-9ef2-4acd-8c24-989c82ca463a None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:25.947203 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e526e09-9ef2-4acd-8c24-989c82ca463a None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:25.947203 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e526e09-9ef2-4acd-8c24-989c82ca463a None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:25.948543 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 186/362] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:25.957224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315099b-652f-4831-bff0-bbf64d395f3d None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:25.957224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315099b-652f-4831-bff0-bbf64d395f3d None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:25.957224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315099b-652f-4831-bff0-bbf64d395f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:25.975595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-7315099b-652f-4831-bff0-bbf64d395f3d None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:25.977096 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-7315099b-652f-4831-bff0-bbf64d395f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:26.066296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 177/363] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:26.502246 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e526e09-9ef2-4acd-8c24-989c82ca463a None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:26.586683 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:26.649985 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e526e09-9ef2-4acd-8c24-989c82ca463a None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:26.699109 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474cb30-977f-4dab-ac49-3e04a0577c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:26.699744 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474cb30-977f-4dab-ac49-3e04a0577c5c None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:26.700022 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474cb30-977f-4dab-ac49-3e04a0577c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:26.700294 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474cb30-977f-4dab-ac49-3e04a0577c5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:26.719747 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474cb30-977f-4dab-ac49-3e04a0577c5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:26.725993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-e474cb30-977f-4dab-ac49-3e04a0577c5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:12:26.725993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:26.725993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:26.725993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:26.725993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:26.725993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:26.725993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:26.725993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:26.725993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:26.725993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:26.725993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:26.725993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:26.725993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:26.725993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:26.725993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:26.725993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:26.726896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:26.726896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:26.726896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:26.726896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:26.726896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:26.726896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:26.726896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:26.726896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:26.726896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:26.726896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:26.726896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:26.726896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:26.726896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:26.726896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:26.726896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:26.726896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:26.727847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:26.727847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:26.727847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:26.727847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:26.727847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:26.727847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:26.727847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:26.727847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:26.727847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:26.727847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:26.727847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:12:26.727847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:26.727847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 187/364] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 02:12:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:26.728501 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59472a9d-1d1d-4169-a592-81b55f2666a8 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:26.728895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59472a9d-1d1d-4169-a592-81b55f2666a8 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:26.728895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59472a9d-1d1d-4169-a592-81b55f2666a8 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:26.730195 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 178/365] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:26.735024 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474cb30-977f-4dab-ac49-3e04a0577c5c None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:26.735279 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd35696-bf5c-4477-a969-0335dde5000e None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:26.735706 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd35696-bf5c-4477-a969-0335dde5000e None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:26.736107 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd35696-bf5c-4477-a969-0335dde5000e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:26.771817 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-ccd35696-bf5c-4477-a969-0335dde5000e None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:26.774506 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ccd35696-bf5c-4477-a969-0335dde5000e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:26.884200 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:26.906245 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474cb30-977f-4dab-ac49-3e04a0577c5c None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:26.907033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 179/366] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:26.910627 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff036dbb-cc1a-488c-99ca-d9893f3efe82 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:26.911008 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff036dbb-cc1a-488c-99ca-d9893f3efe82 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:26.911350 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff036dbb-cc1a-488c-99ca-d9893f3efe82 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:26.912946 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 180/367] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:26.923485 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a32b8-1898-4181-be31-e92ef428b65f None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:26.924011 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a32b8-1898-4181-be31-e92ef428b65f None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:26.924765 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a32b8-1898-4181-be31-e92ef428b65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:26.929075 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:26.948343 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907a2e6-0a23-4e6d-b177-d8d7a3498701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:26.948985 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907a2e6-0a23-4e6d-b177-d8d7a3498701 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:26.949203 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907a2e6-0a23-4e6d-b177-d8d7a3498701 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:26.949572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907a2e6-0a23-4e6d-b177-d8d7a3498701 None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:26.950328 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907a2e6-0a23-4e6d-b177-d8d7a3498701 None admin] RBAC: Adding query filter params (name=service) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:26.950663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907a2e6-0a23-4e6d-b177-d8d7a3498701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:26.952097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907a2e6-0a23-4e6d-b177-d8d7a3498701 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:26.961060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 188/368] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 02:12:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:26.962783 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-929a32b8-1898-4181-be31-e92ef428b65f None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:26.963989 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-929a32b8-1898-4181-be31-e92ef428b65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:26.971916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907a2e6-0a23-4e6d-b177-d8d7a3498701 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:27.072694 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 181/369] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:27.132452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907a2e6-0a23-4e6d-b177-d8d7a3498701 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:27.167432 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff0ae0-5f95-468f-9563-523e41b2af7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:27.168061 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff0ae0-5f95-468f-9563-523e41b2af7b None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:27.168335 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff0ae0-5f95-468f-9563-523e41b2af7b None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:27.168606 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff0ae0-5f95-468f-9563-523e41b2af7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:27.180270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff0ae0-5f95-468f-9563-523e41b2af7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:27.181715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff0ae0-5f95-468f-9563-523e41b2af7b None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:27.197079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-9fff0ae0-5f95-468f-9563-523e41b2af7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:27.197079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:27.197079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:27.197079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:27.197079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:27.197079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:27.197079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:27.197079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:27.197079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:27.197079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:27.197079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:27.197079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:27.197079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:27.197079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:27.197079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:27.197079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:27.197975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:27.197975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:27.197975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:27.197975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:27.197975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:27.197975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:27.197975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:27.197975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:27.197975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:27.197975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:27.197975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:27.197975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:27.197975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:27.197975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:27.197975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:27.197975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:27.197975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:27.199552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:27.199552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:27.199552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:27.199552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 189/370] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:27.203715 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a32b8-1898-4181-be31-e92ef428b65f None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:27.238759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff0ae0-5f95-468f-9563-523e41b2af7b None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:27.285651 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:27.400714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a32b8-1898-4181-be31-e92ef428b65f None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:27.423330 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:27.446118 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff0ae0-5f95-468f-9563-523e41b2af7b None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:27.447883 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce4c4f-b499-4b62-a1ce-37ad6e121d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:27.448503 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce4c4f-b499-4b62-a1ce-37ad6e121d14 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:27.448779 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce4c4f-b499-4b62-a1ce-37ad6e121d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:27.449046 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce4c4f-b499-4b62-a1ce-37ad6e121d14 None admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:27.450694 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce4c4f-b499-4b62-a1ce-37ad6e121d14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:27.451018 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce4c4f-b499-4b62-a1ce-37ad6e121d14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:27.452405 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce4c4f-b499-4b62-a1ce-37ad6e121d14 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:27.472648 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 182/371] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:27.473507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce4c4f-b499-4b62-a1ce-37ad6e121d14 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:27.503606 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e64149-e45f-4758-87da-66b12994a7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:27.504234 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e64149-e45f-4758-87da-66b12994a7fd None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:27.504535 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e64149-e45f-4758-87da-66b12994a7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:27.505027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e64149-e45f-4758-87da-66b12994a7fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:27.518779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e64149-e45f-4758-87da-66b12994a7fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:27.525514 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-31e64149-e45f-4758-87da-66b12994a7fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:12:27.525514 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:27.525514 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:27.525514 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:27.525514 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:27.525514 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:27.525514 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:27.525514 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:27.525514 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:27.525514 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:27.525514 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:27.525514 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:27.525514 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:27.525514 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:27.525514 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:27.525514 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:27.526416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:27.526416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:27.526416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:27.526416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:27.526416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:27.526416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:27.526416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:27.526416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:27.526416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:27.526416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:27.526416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:27.526416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:27.526416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:27.526416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:27.526416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:27.526416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:27.527240 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:27.527240 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:27.527240 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:27.527240 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:27.527240 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:27.527240 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:27.527240 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:27.527240 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:27.527240 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:27.527240 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:27.527240 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:12:27.527240 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:27.527240 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 190/372] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 02:12:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:12:27.527903 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e64149-e45f-4758-87da-66b12994a7fd None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:27.587218 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce4c4f-b499-4b62-a1ce-37ad6e121d14 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:27.626363 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:27.626977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766c616-9f44-47a9-b235-9ad0b436e98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:27.627653 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766c616-9f44-47a9-b235-9ad0b436e98e None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:27.627936 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766c616-9f44-47a9-b235-9ad0b436e98e None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:27.628337 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766c616-9f44-47a9-b235-9ad0b436e98e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:27.636506 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e64149-e45f-4758-87da-66b12994a7fd None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:27.638626 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766c616-9f44-47a9-b235-9ad0b436e98e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:27.643661 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-d766c616-9f44-47a9-b235-9ad0b436e98e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:12:27.643661 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:27.643661 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:27.643661 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:27.643661 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:27.643661 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:27.643661 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:27.643661 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:27.643661 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:27.643661 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:27.643661 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:27.643661 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:27.643661 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:27.643661 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:27.643661 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:27.643661 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:27.644546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:27.644546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:27.644546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:27.644546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:27.644546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:27.644546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:27.644546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:27.644546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:27.644546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:27.644546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:27.644546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:27.644546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:27.644546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:27.644546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:27.644546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:27.644546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:27.645343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:27.645343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:27.645343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:27.645343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:27.645343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:27.645343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:27.645343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:27.645343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:27.645343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:27.645343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:27.645343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:12:27.645343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:27.645343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 183/373] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 02:12:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:27.646514 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53b3aa-658c-4a41-8435-f25f41c99dd6 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:27.646514 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53b3aa-658c-4a41-8435-f25f41c99dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:27.646768 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53b3aa-658c-4a41-8435-f25f41c99dd6 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:27.648042 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 184/374] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:27.652421 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53b3aa-658c-4a41-8435-f25f41c99dd6 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:27.683542 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b46dd-05d7-4e19-9848-009acd9a78c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:27.684176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b46dd-05d7-4e19-9848-009acd9a78c8 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:27.684461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b46dd-05d7-4e19-9848-009acd9a78c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:27.684735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b46dd-05d7-4e19-9848-009acd9a78c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:27.688457 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:27.692917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b46dd-05d7-4e19-9848-009acd9a78c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:27.694398 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b46dd-05d7-4e19-9848-009acd9a78c8 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:27.707780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-715b46dd-05d7-4e19-9848-009acd9a78c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 02:12:27.707780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:27.707780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:27.707780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:27.707780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:27.707780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:27.707780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:27.707780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:27.707780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:27.707780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:27.707780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:27.707780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:27.707780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 02:12:27.707780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 02:12:27.707780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 02:12:27.707780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 02:12:27.708716 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:27.708716 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:27.708716 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:12:27.708716 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:27.708716 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:12:27.708716 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:27.708716 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:27.708716 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:27.708716 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:27.708716 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:27.708716 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:27.708716 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:27.708716 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:27.708716 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:27.708716 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:27.708716 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:27.708716 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:27.708716 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:27.709610 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:27.709610 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:27.709610 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 02:12:27.709610 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 02:12:27.709610 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 02:12:27.709610 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 02:12:27.709610 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 02:12:27.709610 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 02:12:27.709610 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 02:12:27.709610 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:27.709610 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 191/375] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 19 02:12:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:27.710270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b46dd-05d7-4e19-9848-009acd9a78c8 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:27.764234 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53b3aa-658c-4a41-8435-f25f41c99dd6 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:27.802144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67c97f-6f62-46a0-a007-aceabea04298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:27.802889 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67c97f-6f62-46a0-a007-aceabea04298 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:27.803168 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67c97f-6f62-46a0-a007-aceabea04298 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:27.803437 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67c97f-6f62-46a0-a007-aceabea04298 None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:27.804098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67c97f-6f62-46a0-a007-aceabea04298 None admin] RBAC: Adding query filter params (name=service) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:27.804411 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67c97f-6f62-46a0-a007-aceabea04298 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:27.805977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67c97f-6f62-46a0-a007-aceabea04298 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:27.818655 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b46dd-05d7-4e19-9848-009acd9a78c8 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:27.820810 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 185/376] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 02:12:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:27.821917 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4ac94-1a2a-4abe-83dc-18f051b67961 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:27.822205 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4ac94-1a2a-4abe-83dc-18f051b67961 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:27.822480 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4ac94-1a2a-4abe-83dc-18f051b67961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:27.842316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-f2d4ac94-1a2a-4abe-83dc-18f051b67961 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:27.843772 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-f2d4ac94-1a2a-4abe-83dc-18f051b67961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:27.854182 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b48b5d-c333-4c41-a991-76ede604c997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:27.854796 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b48b5d-c333-4c41-a991-76ede604c997 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:27.855108 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b48b5d-c333-4c41-a991-76ede604c997 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:27.855377 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b48b5d-c333-4c41-a991-76ede604c997 None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:27.856037 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b48b5d-c333-4c41-a991-76ede604c997 None admin] RBAC: Adding query filter params (name=service) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:27.856360 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b48b5d-c333-4c41-a991-76ede604c997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:27.857738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b48b5d-c333-4c41-a991-76ede604c997 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:27.866577 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 192/377] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 02:12:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:27.867481 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b48b5d-c333-4c41-a991-76ede604c997 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:27.885036 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:27.919223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 186/378] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:27.927785 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4ac94-1a2a-4abe-83dc-18f051b67961 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:27.959769 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:27.981745 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b48b5d-c333-4c41-a991-76ede604c997 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:28.020621 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff313c7b-a420-4feb-afa5-682d70f28669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:28.021279 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff313c7b-a420-4feb-afa5-682d70f28669 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:28.021593 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff313c7b-a420-4feb-afa5-682d70f28669 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:28.021804 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff313c7b-a420-4feb-afa5-682d70f28669 None admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:28.022529 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff313c7b-a420-4feb-afa5-682d70f28669 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:28.022852 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff313c7b-a420-4feb-afa5-682d70f28669 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:28.024464 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff313c7b-a420-4feb-afa5-682d70f28669 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:28.041195 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4ac94-1a2a-4abe-83dc-18f051b67961 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:28.070980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 193/379] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 19 02:12:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:28.072170 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff313c7b-a420-4feb-afa5-682d70f28669 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:28.086344 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebd06c-c666-40b0-8931-4a1f720be6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:28.087024 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebd06c-c666-40b0-8931-4a1f720be6dc None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:28.087301 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebd06c-c666-40b0-8931-4a1f720be6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:28.087569 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebd06c-c666-40b0-8931-4a1f720be6dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:28.101978 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebd06c-c666-40b0-8931-4a1f720be6dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:28.103735 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebd06c-c666-40b0-8931-4a1f720be6dc None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:28.123644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-54ebd06c-c666-40b0-8931-4a1f720be6dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:28.123644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:28.123644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:28.123644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:28.123644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:28.123644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:28.123644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:28.123644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:28.123644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:28.123644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:28.123644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:28.123644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:28.123644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:28.123644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:28.123644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:28.123644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:28.124572 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:28.124572 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:28.124572 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:28.124572 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:28.124572 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:28.124572 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:28.124572 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:28.124572 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:28.124572 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:28.124572 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:28.124572 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:28.124572 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:28.124572 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:28.124572 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:28.124572 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:28.124572 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:28.124572 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:28.125418 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:28.125418 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:28.125418 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:28.132023 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 187/380] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:28.132023 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebd06c-c666-40b0-8931-4a1f720be6dc None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:28.169718 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:28.204289 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff313c7b-a420-4feb-afa5-682d70f28669 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:28.241842 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:28.243510 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c2c8e-c492-462e-88e9-f17aac285331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:28.243954 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c2c8e-c492-462e-88e9-f17aac285331 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:28.244233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c2c8e-c492-462e-88e9-f17aac285331 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:28.244536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c2c8e-c492-462e-88e9-f17aac285331 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:28.257328 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c2c8e-c492-462e-88e9-f17aac285331 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:28.258840 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c2c8e-c492-462e-88e9-f17aac285331 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:28.262077 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebd06c-c666-40b0-8931-4a1f720be6dc None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:28.274787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-d66c2c8e-c492-462e-88e9-f17aac285331 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:28.274787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:28.274787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:28.274787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:28.274787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:28.274787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:28.274787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:28.274787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:28.274787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:28.274787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:28.274787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:28.274787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:28.274787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:28.274787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:28.274787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:28.274787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:28.275835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:28.275835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:28.275835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:28.275835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:28.275835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:28.275835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:28.275835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:28.275835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:28.275835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:28.275835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:28.275835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:28.275835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:28.275835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:28.275835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:28.275835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:28.275835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:28.275835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:28.276740 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:28.276740 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:28.276740 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:28.276740 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 194/381] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:28.277731 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c2c8e-c492-462e-88e9-f17aac285331 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:28.296323 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7903bf-8f1b-48db-9e74-d222464e7200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:28.296939 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7903bf-8f1b-48db-9e74-d222464e7200 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:28.297266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7903bf-8f1b-48db-9e74-d222464e7200 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:28.297530 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7903bf-8f1b-48db-9e74-d222464e7200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:28.308925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7903bf-8f1b-48db-9e74-d222464e7200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:28.310671 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7903bf-8f1b-48db-9e74-d222464e7200 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:28.325128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-7c7903bf-8f1b-48db-9e74-d222464e7200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:28.325128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:28.325128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:28.325128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:28.325128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:28.325128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:28.325128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:28.325128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:28.325128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:28.325128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:28.325128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:28.325128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:28.325128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:28.325128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:28.325128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:28.325128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:28.326047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:28.326047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:28.326047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:28.326047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:28.326047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:28.326047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:28.326047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:28.326047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:28.326047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:28.326047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:28.326047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:28.326047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:28.326047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:28.326047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:28.326047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:28.326047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:28.326047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:28.326913 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:28.326913 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:28.326913 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:28.327076 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 188/382] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:28.327791 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7903bf-8f1b-48db-9e74-d222464e7200 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:28.383176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c2c8e-c492-462e-88e9-f17aac285331 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:28.409208 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:28.421167 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b244b6-6059-4ab7-8adc-6465794d2eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:28.421167 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b244b6-6059-4ab7-8adc-6465794d2eaf None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:28.421418 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b244b6-6059-4ab7-8adc-6465794d2eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:28.421500 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b244b6-6059-4ab7-8adc-6465794d2eaf None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:28.422108 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b244b6-6059-4ab7-8adc-6465794d2eaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:28.422408 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b244b6-6059-4ab7-8adc-6465794d2eaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:28.424445 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b244b6-6059-4ab7-8adc-6465794d2eaf None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:28.428126 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7903bf-8f1b-48db-9e74-d222464e7200 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:28.435943 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 195/383] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:28.437196 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd99c1e-cfb4-4544-b6e2-f8eeddcf0c70 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:28.437485 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd99c1e-cfb4-4544-b6e2-f8eeddcf0c70 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:28.437756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd99c1e-cfb4-4544-b6e2-f8eeddcf0c70 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:28.439676 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 196/384] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:28.440913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd99c1e-cfb4-4544-b6e2-f8eeddcf0c70 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:28.463868 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:28.468951 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead9be3-4164-44cf-b9ea-bfd4d3b2a5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:28.469577 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead9be3-4164-44cf-b9ea-bfd4d3b2a5d0 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:28.469856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead9be3-4164-44cf-b9ea-bfd4d3b2a5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:28.470128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead9be3-4164-44cf-b9ea-bfd4d3b2a5d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:28.481532 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead9be3-4164-44cf-b9ea-bfd4d3b2a5d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:28.487092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-4ead9be3-4164-44cf-b9ea-bfd4d3b2a5d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:12:28.487092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:28.487092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:28.487092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:28.487092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:28.487092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:28.487092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:28.487092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:28.487092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:28.487092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:28.487092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:28.487092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:28.487092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:28.487092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:28.487092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:28.487092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:28.487966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:28.487966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:28.487966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:28.487966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:28.487966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:28.487966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:28.487966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:28.487966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:28.487966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:28.487966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:28.487966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:28.487966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:28.487966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:28.487966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:28.487966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:28.487966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:28.488746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:28.488746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:28.488746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:28.488746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:28.488746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:28.488746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:28.488746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:28.488746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:28.488746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:28.488746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:28.488746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:12:28.488746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:28.488746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 189/385] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 02:12:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:28.489424 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead9be3-4164-44cf-b9ea-bfd4d3b2a5d0 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:28.547397 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd99c1e-cfb4-4544-b6e2-f8eeddcf0c70 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:28.583711 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac42ef4-6131-4a1d-a2b4-18b72ffb7f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:28.584308 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac42ef4-6131-4a1d-a2b4-18b72ffb7f6b None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:28.584617 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac42ef4-6131-4a1d-a2b4-18b72ffb7f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:28.584890 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac42ef4-6131-4a1d-a2b4-18b72ffb7f6b None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:28.585531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac42ef4-6131-4a1d-a2b4-18b72ffb7f6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:28.585834 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac42ef4-6131-4a1d-a2b4-18b72ffb7f6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:28.587246 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac42ef4-6131-4a1d-a2b4-18b72ffb7f6b None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:28.591696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead9be3-4164-44cf-b9ea-bfd4d3b2a5d0 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:28.598250 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 197/386] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:28.599082 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac42ef4-6131-4a1d-a2b4-18b72ffb7f6b None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:28.624797 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6462c6-3179-4faa-b6e6-7006ca425876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:28.625397 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6462c6-3179-4faa-b6e6-7006ca425876 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:28.625672 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6462c6-3179-4faa-b6e6-7006ca425876 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:28.625936 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6462c6-3179-4faa-b6e6-7006ca425876 None admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:28.626575 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6462c6-3179-4faa-b6e6-7006ca425876 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:28.627554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6462c6-3179-4faa-b6e6-7006ca425876 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:28.628924 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6462c6-3179-4faa-b6e6-7006ca425876 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:28.639673 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 190/387] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:28.640810 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568dabd-d233-495f-aeef-568143332357 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:28.641091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568dabd-d233-495f-aeef-568143332357 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:28.641360 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568dabd-d233-495f-aeef-568143332357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:28.641966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:28.659340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-2568dabd-d233-495f-aeef-568143332357 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:28.660573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-2568dabd-d233-495f-aeef-568143332357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:28.700327 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac42ef4-6131-4a1d-a2b4-18b72ffb7f6b None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:28.707758 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:28.726940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 191/388] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:28.727750 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568dabd-d233-495f-aeef-568143332357 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:28.737701 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0a68c-0cf3-4439-acf5-09131ea6fea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:28.738328 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0a68c-0cf3-4439-acf5-09131ea6fea4 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:28.738605 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0a68c-0cf3-4439-acf5-09131ea6fea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:28.738910 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0a68c-0cf3-4439-acf5-09131ea6fea4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:28.747497 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0a68c-0cf3-4439-acf5-09131ea6fea4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:28.748916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0a68c-0cf3-4439-acf5-09131ea6fea4 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:28.761160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-37d0a68c-0cf3-4439-acf5-09131ea6fea4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 19 02:12:28.761160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:28.761160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:28.761160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:28.761160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:28.761160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:28.761160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:28.761160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:28.761160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:28.761160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:28.761160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:28.761160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:28.761160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 02:12:28.761160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 02:12:28.761160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 02:12:28.761160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 02:12:28.762060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:28.762060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:28.762060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:12:28.762060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:28.762060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:12:28.762060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:28.762060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:28.762060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:28.762060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:28.762060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:28.762060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:28.762060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:28.762060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:28.762060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:28.762060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:28.762060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:28.762060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:28.762060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:28.762971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:28.762971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:28.762971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 02:12:28.762971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 02:12:28.762971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 02:12:28.762971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 02:12:28.762971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 02:12:28.762971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 02:12:28.762971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 19 02:12:28.762971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:28.762971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 198/389] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:12:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:28.764162 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0a68c-0cf3-4439-acf5-09131ea6fea4 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:28.838432 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568dabd-d233-495f-aeef-568143332357 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:28.872381 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0a68c-0cf3-4439-acf5-09131ea6fea4 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:28.874105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:28.875072 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b63b5e-4dfc-4cb9-802b-efb38068b98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:28.875686 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b63b5e-4dfc-4cb9-802b-efb38068b98f None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:28.875955 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b63b5e-4dfc-4cb9-802b-efb38068b98f None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:28.876229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b63b5e-4dfc-4cb9-802b-efb38068b98f None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:28.876983 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b63b5e-4dfc-4cb9-802b-efb38068b98f None admin] RBAC: Adding query filter params (name=service) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:28.877278 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b63b5e-4dfc-4cb9-802b-efb38068b98f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:28.878654 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b63b5e-4dfc-4cb9-802b-efb38068b98f None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:28.891208 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 192/390] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 02:12:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:28.891954 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b63b5e-4dfc-4cb9-802b-efb38068b98f None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:28.907531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98be34d-106b-4c14-8590-3e0d6a2441df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:28.908688 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98be34d-106b-4c14-8590-3e0d6a2441df None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:28.908956 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98be34d-106b-4c14-8590-3e0d6a2441df None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:28.909223 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98be34d-106b-4c14-8590-3e0d6a2441df None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:28.917824 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98be34d-106b-4c14-8590-3e0d6a2441df None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:28.919293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98be34d-106b-4c14-8590-3e0d6a2441df None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:28.930574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-f98be34d-106b-4c14-8590-3e0d6a2441df None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 02:12:28.930574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:28.930574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:28.930574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:28.930574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:28.930574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:28.930574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:28.930574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:28.930574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:28.930574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:28.930574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:28.930574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:28.930574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 02:12:28.930574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 02:12:28.930574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 02:12:28.930574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 02:12:28.931709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:28.931709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:28.931709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:12:28.931709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:28.931709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:12:28.931709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:28.931709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:28.931709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:28.931709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:28.931709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:28.931709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:28.931709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:28.931709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:28.931709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:28.931709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:28.931709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:28.931709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:28.931709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:28.932795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:28.932795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:28.932795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 02:12:28.932795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 02:12:28.932795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 02:12:28.932795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 02:12:28.932795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 02:12:28.932795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 02:12:28.932795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 02:12:28.932795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:28.936843 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 199/391] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:12:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:28.937677 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98be34d-106b-4c14-8590-3e0d6a2441df None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:28.942942 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:28.998069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b63b5e-4dfc-4cb9-802b-efb38068b98f None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:29.031101 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126852b2-a357-45a3-bdc4-d5e8de94936b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:29.031723 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126852b2-a357-45a3-bdc4-d5e8de94936b None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:29.031999 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126852b2-a357-45a3-bdc4-d5e8de94936b None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:29.032269 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126852b2-a357-45a3-bdc4-d5e8de94936b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:29.039328 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126852b2-a357-45a3-bdc4-d5e8de94936b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:29.040779 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126852b2-a357-45a3-bdc4-d5e8de94936b None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:29.048455 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98be34d-106b-4c14-8590-3e0d6a2441df None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:29.053051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-126852b2-a357-45a3-bdc4-d5e8de94936b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:29.053051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:29.053051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:29.053051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:29.053051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:29.053051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:29.053051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:29.053051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:29.053051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:29.053051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:29.053051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:29.053051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:29.053051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 02:12:29.053051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 02:12:29.053051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 02:12:29.054061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 02:12:29.054061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:29.054061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:29.054061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:29.054061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:29.054061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:29.054061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:29.054061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:29.054061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:29.054061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:29.054061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:29.054061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:29.054061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:29.054061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:29.054061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:29.054061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:29.054061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:29.055071 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 02:12:29.055071 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 02:12:29.055071 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 02:12:29.055071 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 02:12:29.055071 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 02:12:29.055071 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 02:12:29.055071 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:29.055071 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:29.058927 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 193/392] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:12:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:29.059624 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126852b2-a357-45a3-bdc4-d5e8de94936b None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:29.081994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef825e-16b5-4c9e-ae35-5f5687dc5a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:29.082595 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef825e-16b5-4c9e-ae35-5f5687dc5a5a None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:29.082903 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef825e-16b5-4c9e-ae35-5f5687dc5a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:29.083173 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef825e-16b5-4c9e-ae35-5f5687dc5a5a None admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:29.083900 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef825e-16b5-4c9e-ae35-5f5687dc5a5a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:29.084203 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef825e-16b5-4c9e-ae35-5f5687dc5a5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:29.085620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef825e-16b5-4c9e-ae35-5f5687dc5a5a None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:29.104403 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 200/393] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Oct 19 02:12:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:29.105192 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef825e-16b5-4c9e-ae35-5f5687dc5a5a None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:29.126476 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:29.159931 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126852b2-a357-45a3-bdc4-d5e8de94936b None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:29.162166 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:29.193447 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36813621-7272-47ba-8eff-6e6314c9d743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:29.194066 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36813621-7272-47ba-8eff-6e6314c9d743 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:29.194359 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36813621-7272-47ba-8eff-6e6314c9d743 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:29.194607 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36813621-7272-47ba-8eff-6e6314c9d743 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:29.204329 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36813621-7272-47ba-8eff-6e6314c9d743 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:29.206340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36813621-7272-47ba-8eff-6e6314c9d743 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:29.207162 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef825e-16b5-4c9e-ae35-5f5687dc5a5a None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:29.221774 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-36813621-7272-47ba-8eff-6e6314c9d743 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:29.221774 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:29.221774 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:29.221774 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:29.221774 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:29.221774 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:29.221774 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:29.221774 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:29.221774 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:29.221774 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:29.221774 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:29.221774 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:29.221774 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:29.221774 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:29.221774 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:29.221774 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:29.222770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:29.222770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:29.222770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:29.222770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:29.222770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:29.222770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:29.222770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:29.222770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:29.222770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:29.222770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:29.222770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:29.222770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:29.222770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:29.222770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:29.222770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:29.222770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:29.222770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:29.223638 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:29.223638 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:29.223638 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:29.223638 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 194/394] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:29.223638 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36813621-7272-47ba-8eff-6e6314c9d743 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:29.248816 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19179aa-c479-4e86-b0a2-f06758e566f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:29.249463 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19179aa-c479-4e86-b0a2-f06758e566f8 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:29.249739 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19179aa-c479-4e86-b0a2-f06758e566f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:29.250014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19179aa-c479-4e86-b0a2-f06758e566f8 None admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:29.250740 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19179aa-c479-4e86-b0a2-f06758e566f8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:29.251069 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19179aa-c479-4e86-b0a2-f06758e566f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:29.252665 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19179aa-c479-4e86-b0a2-f06758e566f8 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:29.270696 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 201/395] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Oct 19 02:12:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:29.271544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19179aa-c479-4e86-b0a2-f06758e566f8 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:29.326826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36813621-7272-47ba-8eff-6e6314c9d743 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:29.353606 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:29.361118 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b76351-7a20-4f47-8703-5493c5ed847c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:29.364097 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b76351-7a20-4f47-8703-5493c5ed847c None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:29.364097 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b76351-7a20-4f47-8703-5493c5ed847c None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:29.364097 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b76351-7a20-4f47-8703-5493c5ed847c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:29.372596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b76351-7a20-4f47-8703-5493c5ed847c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:29.374057 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b76351-7a20-4f47-8703-5493c5ed847c None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:29.374430 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19179aa-c479-4e86-b0a2-f06758e566f8 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:29.388167 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-86b76351-7a20-4f47-8703-5493c5ed847c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:29.388167 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:29.388167 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:29.388167 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:29.388167 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:29.388167 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:29.388167 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:29.388167 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:29.388167 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:29.388167 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:29.388167 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:29.388167 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:29.388167 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:29.388167 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:29.388167 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:29.388167 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:29.389069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:29.389069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:29.389069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:29.389069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:29.389069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:29.389069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:29.389069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:29.389069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:29.389069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:29.389069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:29.389069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:29.389069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:29.389069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:29.389069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:29.389069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:29.389069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:29.389069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:29.389893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:29.389893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:29.389893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:29.389893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 195/396] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:29.390102 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b76351-7a20-4f47-8703-5493c5ed847c None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:29.401159 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:29.411761 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99900f-265a-4d5a-9298-09bd5b3e4a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:29.412362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99900f-265a-4d5a-9298-09bd5b3e4a59 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:29.412636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99900f-265a-4d5a-9298-09bd5b3e4a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:29.412902 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99900f-265a-4d5a-9298-09bd5b3e4a59 None admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:29.414574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99900f-265a-4d5a-9298-09bd5b3e4a59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:29.414574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99900f-265a-4d5a-9298-09bd5b3e4a59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:29.415378 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99900f-265a-4d5a-9298-09bd5b3e4a59 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:29.432758 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 202/397] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 02:12:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:29.432758 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99900f-265a-4d5a-9298-09bd5b3e4a59 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:29.488883 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b76351-7a20-4f47-8703-5493c5ed847c None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:29.522442 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2bbf2-f49c-4b59-a831-4a5396e6c0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:29.523026 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2bbf2-f49c-4b59-a831-4a5396e6c0c9 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:29.523309 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2bbf2-f49c-4b59-a831-4a5396e6c0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:29.523573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2bbf2-f49c-4b59-a831-4a5396e6c0c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:29.534876 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2bbf2-f49c-4b59-a831-4a5396e6c0c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:29.535200 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99900f-265a-4d5a-9298-09bd5b3e4a59 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:29.536314 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2bbf2-f49c-4b59-a831-4a5396e6c0c9 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:29.550307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-d0f2bbf2-f49c-4b59-a831-4a5396e6c0c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:29.550307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:29.550307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:29.550307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:29.550307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:29.550307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:29.550307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:29.550307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:29.550307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:29.550307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:29.550307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:29.550307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:29.550307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:29.550307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:29.550307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:29.550307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:29.551253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:29.551253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:29.551253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:29.551253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:29.551253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:29.551253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:29.551253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:29.551253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:29.551253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:29.551253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:29.551253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:29.551253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:29.551253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:29.551253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:29.551253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:29.551253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:29.551253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:29.552302 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:29.552302 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:29.552302 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:29.552302 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 196/398] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:29.552302 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2bbf2-f49c-4b59-a831-4a5396e6c0c9 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:29.572068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df3d52-48e9-47ea-82aa-1ab3ffc00988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:29.572768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df3d52-48e9-47ea-82aa-1ab3ffc00988 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:29.573041 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df3d52-48e9-47ea-82aa-1ab3ffc00988 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:29.573309 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df3d52-48e9-47ea-82aa-1ab3ffc00988 None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:29.573942 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df3d52-48e9-47ea-82aa-1ab3ffc00988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:29.574237 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df3d52-48e9-47ea-82aa-1ab3ffc00988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:29.575634 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df3d52-48e9-47ea-82aa-1ab3ffc00988 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:29.582593 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:29.587458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 203/399] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:29.588117 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df3d52-48e9-47ea-82aa-1ab3ffc00988 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:29.618091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:29.658509 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2bbf2-f49c-4b59-a831-4a5396e6c0c9 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:29.688333 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df3d52-48e9-47ea-82aa-1ab3ffc00988 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:29.692388 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c228a47-0626-4d20-9003-af8140976753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:29.693004 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c228a47-0626-4d20-9003-af8140976753 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:29.693278 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c228a47-0626-4d20-9003-af8140976753 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:29.693545 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c228a47-0626-4d20-9003-af8140976753 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:29.703866 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c228a47-0626-4d20-9003-af8140976753 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:29.706138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c228a47-0626-4d20-9003-af8140976753 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:29.720037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-9c228a47-0626-4d20-9003-af8140976753 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:29.720037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:29.720037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:29.720037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:29.720037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:29.720037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:29.720037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:29.720037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:29.720037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:29.720037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:29.720037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:29.720037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:29.720037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:29.720037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:29.720037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:29.720037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:29.720967 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:29.720967 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:29.720967 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:29.720967 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:29.720967 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:29.720967 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:29.720967 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:29.720967 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:29.720967 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:29.720967 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:29.720967 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:29.720967 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:29.720967 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:29.720967 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:29.720967 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:29.720967 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:29.720967 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:29.721817 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:29.721817 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:29.721817 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:29.721817 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 197/400] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:29.722256 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c228a47-0626-4d20-9003-af8140976753 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:29.727339 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e20fb-54c5-497b-9443-8d4cf17471b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:29.727957 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e20fb-54c5-497b-9443-8d4cf17471b7 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:29.728237 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e20fb-54c5-497b-9443-8d4cf17471b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:29.728509 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e20fb-54c5-497b-9443-8d4cf17471b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:29.729161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e20fb-54c5-497b-9443-8d4cf17471b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:29.729463 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e20fb-54c5-497b-9443-8d4cf17471b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:29.730845 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e20fb-54c5-497b-9443-8d4cf17471b7 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:29.742797 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 204/401] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:29.743617 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e20fb-54c5-497b-9443-8d4cf17471b7 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:29.804009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:29.825559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c228a47-0626-4d20-9003-af8140976753 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:29.838562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:29.844793 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e20fb-54c5-497b-9443-8d4cf17471b7 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:29.863198 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d7c7a-bed2-4b4b-b068-f8b2ed6d810c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:29.863851 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d7c7a-bed2-4b4b-b068-f8b2ed6d810c None admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:29.864125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d7c7a-bed2-4b4b-b068-f8b2ed6d810c None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:29.864387 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d7c7a-bed2-4b4b-b068-f8b2ed6d810c None admin] PATH_INFO: `/v3/projects/91449401454c493cbf423888db8b8454/users/58a78f75a63e4d258a4afbeb748e59f6/roles/abb44cb94d7c46d3955fd92860aff94d` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:29.879126 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d7c7a-bed2-4b4b-b068-f8b2ed6d810c None admin] RBAC: Authorizing `identity:create_grant(project_id=91449401454c493cbf423888db8b8454, user_id=58a78f75a63e4d258a4afbeb748e59f6, role_id=abb44cb94d7c46d3955fd92860aff94d)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:29.880577 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d7c7a-bed2-4b4b-b068-f8b2ed6d810c None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:29.883156 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ee491-421e-4ffb-b913-c58e84b0a4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:29.883760 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ee491-421e-4ffb-b913-c58e84b0a4fe None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:29.884042 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ee491-421e-4ffb-b913-c58e84b0a4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:29.884346 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ee491-421e-4ffb-b913-c58e84b0a4fe None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:29.884946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ee491-421e-4ffb-b913-c58e84b0a4fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:29.885243 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ee491-421e-4ffb-b913-c58e84b0a4fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:29.886600 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ee491-421e-4ffb-b913-c58e84b0a4fe None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:29.897990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 205/402] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:29.898772 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ee491-421e-4ffb-b913-c58e84b0a4fe None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:29.958186 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 198/403] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 02:12:29 2022] PUT /identity/v3/projects/91449401454c493cbf423888db8b8454/users/58a78f75a63e4d258a4afbeb748e59f6/roles/abb44cb94d7c46d3955fd92860aff94d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:12:29.959052 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d7c7a-bed2-4b4b-b068-f8b2ed6d810c None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:30.013812 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ee491-421e-4ffb-b913-c58e84b0a4fe None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:30.035483 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:30.055653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae6263-80fb-4632-8983-5f463074d1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:30.056325 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae6263-80fb-4632-8983-5f463074d1d2 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:30.056599 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae6263-80fb-4632-8983-5f463074d1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:30.056875 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae6263-80fb-4632-8983-5f463074d1d2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:30.065665 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae6263-80fb-4632-8983-5f463074d1d2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:30.067256 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae6263-80fb-4632-8983-5f463074d1d2 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:30.075428 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d7c7a-bed2-4b4b-b068-f8b2ed6d810c None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:30.082150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-93ae6263-80fb-4632-8983-5f463074d1d2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 19 02:12:30.082150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:30.082150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:30.082150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:30.082150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:30.082150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:30.082150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:30.082150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:30.082150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:30.082150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:30.082150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:30.082150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:30.082150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 02:12:30.082150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 02:12:30.082150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 02:12:30.082150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 02:12:30.083149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:30.083149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:30.083149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:12:30.083149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:30.083149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:12:30.083149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:30.083149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:30.083149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:30.083149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:30.083149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:30.083149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:30.083149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:30.083149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:30.083149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:30.083149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:30.083149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:30.083149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:30.083149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:30.084031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:30.084031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:30.084031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 02:12:30.084031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 02:12:30.084031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 02:12:30.084031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 02:12:30.084031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 02:12:30.084031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 02:12:30.084031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 19 02:12:30.084031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:30.090026 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 206/404] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 02:12:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:30.090026 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae6263-80fb-4632-8983-5f463074d1d2 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:30.114030 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603ea5d-0ad6-492b-a4a4-e9c5df11868b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:30.114653 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603ea5d-0ad6-492b-a4a4-e9c5df11868b None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:30.114964 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603ea5d-0ad6-492b-a4a4-e9c5df11868b None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:30.115234 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603ea5d-0ad6-492b-a4a4-e9c5df11868b None admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:30.115893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603ea5d-0ad6-492b-a4a4-e9c5df11868b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:30.116260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603ea5d-0ad6-492b-a4a4-e9c5df11868b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:30.117694 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603ea5d-0ad6-492b-a4a4-e9c5df11868b None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:30.130015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 199/405] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:30.130920 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603ea5d-0ad6-492b-a4a4-e9c5df11868b None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:30.158401 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:30.202951 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae6263-80fb-4632-8983-5f463074d1d2 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:30.243810 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603ea5d-0ad6-492b-a4a4-e9c5df11868b None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:30.245659 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4043d4-6b6d-4883-a43d-6c3df8810fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:30.246275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4043d4-6b6d-4883-a43d-6c3df8810fa3 None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:30.246552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4043d4-6b6d-4883-a43d-6c3df8810fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:30.246843 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4043d4-6b6d-4883-a43d-6c3df8810fa3 None admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:30.247546 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4043d4-6b6d-4883-a43d-6c3df8810fa3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:30.248984 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4043d4-6b6d-4883-a43d-6c3df8810fa3 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:30.278533 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975d167-ffc6-40d8-9e56-549bd9de8939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:30.279181 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975d167-ffc6-40d8-9e56-549bd9de8939 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:30.279449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975d167-ffc6-40d8-9e56-549bd9de8939 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:30.279721 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975d167-ffc6-40d8-9e56-549bd9de8939 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:30.286922 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975d167-ffc6-40d8-9e56-549bd9de8939 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:30.288363 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975d167-ffc6-40d8-9e56-549bd9de8939 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:30.299560 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-0975d167-ffc6-40d8-9e56-549bd9de8939 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:30.299560 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:30.299560 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:30.299560 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:30.299560 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:30.299560 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:30.299560 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:30.299560 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:30.299560 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:30.299560 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:30.299560 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:30.299560 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:30.299560 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 02:12:30.299560 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 02:12:30.299560 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 02:12:30.300610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 02:12:30.300610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:30.300610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:30.300610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:30.300610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:30.300610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:30.300610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:30.300610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:30.300610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:30.300610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:30.300610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:30.300610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:30.300610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:30.300610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:30.300610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:30.300610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:30.300610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:30.301494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 02:12:30.301494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 02:12:30.301494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 02:12:30.301494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 02:12:30.301494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 02:12:30.301494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 02:12:30.301494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:30.301494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:30.301494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 200/406] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:12:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:30.301494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975d167-ffc6-40d8-9e56-549bd9de8939 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:30.384457 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:30.400146 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 207/407] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 02:12:30 2022] POST /identity/v3/users => generated 247 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:12:30.400976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4043d4-6b6d-4883-a43d-6c3df8810fa3 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:30.415695 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975d167-ffc6-40d8-9e56-549bd9de8939 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:30.456536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:30.460115 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5189c-f71b-4137-bf0f-10d50b57de74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:30.460948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5189c-f71b-4137-bf0f-10d50b57de74 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:30.461455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5189c-f71b-4137-bf0f-10d50b57de74 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:30.462010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5189c-f71b-4137-bf0f-10d50b57de74 None admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:30.462975 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5189c-f71b-4137-bf0f-10d50b57de74 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:30.463501 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5189c-f71b-4137-bf0f-10d50b57de74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:30.464816 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5189c-f71b-4137-bf0f-10d50b57de74 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:30.515087 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 201/408] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Oct 19 02:12:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:30.515087 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5189c-f71b-4137-bf0f-10d50b57de74 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:30.544464 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4043d4-6b6d-4883-a43d-6c3df8810fa3 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:30.590253 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb02ea-1330-448f-ac09-f3575090df25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:30.591030 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb02ea-1330-448f-ac09-f3575090df25 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:30.591381 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb02ea-1330-448f-ac09-f3575090df25 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:30.591658 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb02ea-1330-448f-ac09-f3575090df25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:30.600794 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb02ea-1330-448f-ac09-f3575090df25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:30.602812 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb02ea-1330-448f-ac09-f3575090df25 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:30.619859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-3cbb02ea-1330-448f-ac09-f3575090df25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:30.619859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:30.619859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:30.619859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:30.619859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:30.619859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:30.619859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:30.619859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:30.619859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:30.619859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:30.619859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:30.619859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:30.619859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 02:12:30.619859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 02:12:30.619859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 02:12:30.620777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 02:12:30.620777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:30.620777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:30.620777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:30.620777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:30.620777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:30.620777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:30.620777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:30.620777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:30.620777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:30.620777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:30.620777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:30.620777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:30.620777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:30.620777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:30.620777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:30.620777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:30.621625 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 02:12:30.621625 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 02:12:30.621625 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 02:12:30.621625 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 02:12:30.621625 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 02:12:30.621625 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 02:12:30.621625 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:30.621625 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:30.621625 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 208/409] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:12:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:30.622073 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb02ea-1330-448f-ac09-f3575090df25 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:30.655054 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5189c-f71b-4137-bf0f-10d50b57de74 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:30.696211 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec73d22-1478-4097-80a5-5128082b0e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:30.696822 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec73d22-1478-4097-80a5-5128082b0e12 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:30.697122 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec73d22-1478-4097-80a5-5128082b0e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:30.697368 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec73d22-1478-4097-80a5-5128082b0e12 None admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:30.698069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec73d22-1478-4097-80a5-5128082b0e12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:30.698370 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec73d22-1478-4097-80a5-5128082b0e12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:30.699865 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec73d22-1478-4097-80a5-5128082b0e12 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:30.715707 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:30.719715 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 202/410] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 02:12:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:30.721283 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec73d22-1478-4097-80a5-5128082b0e12 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:30.743691 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:30.754691 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb02ea-1330-448f-ac09-f3575090df25 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:30.799972 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a071e6b-01ec-4ec8-af3e-032efcd7123e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:30.800612 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a071e6b-01ec-4ec8-af3e-032efcd7123e None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:30.800890 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a071e6b-01ec-4ec8-af3e-032efcd7123e None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:30.801162 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a071e6b-01ec-4ec8-af3e-032efcd7123e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:30.817125 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a071e6b-01ec-4ec8-af3e-032efcd7123e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:30.819053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a071e6b-01ec-4ec8-af3e-032efcd7123e None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:30.833507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec73d22-1478-4097-80a5-5128082b0e12 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:30.839144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-1a071e6b-01ec-4ec8-af3e-032efcd7123e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:30.839144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:30.839144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:30.839144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:30.839144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:30.839144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:30.839144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:30.839144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:30.839144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:30.839144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:30.839144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:30.839144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:30.839144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:30.839144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:30.839144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:30.839144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:30.840067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:30.840067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:30.840067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:30.840067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:30.840067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:30.840067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:30.840067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:30.840067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:30.840067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:30.840067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:30.840067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:30.840067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:30.840067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:30.840067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:30.840067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:30.840067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:30.840067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:30.840913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:30.840913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:30.840913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:30.840913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 209/411] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:30.842000 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a071e6b-01ec-4ec8-af3e-032efcd7123e None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:30.877826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b64d2c-c988-4ef3-b8c9-a019324b4744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:30.878592 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b64d2c-c988-4ef3-b8c9-a019324b4744 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:30.879024 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b64d2c-c988-4ef3-b8c9-a019324b4744 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:30.879394 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b64d2c-c988-4ef3-b8c9-a019324b4744 None admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:30.880199 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b64d2c-c988-4ef3-b8c9-a019324b4744 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:30.880608 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b64d2c-c988-4ef3-b8c9-a019324b4744 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:30.882165 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b64d2c-c988-4ef3-b8c9-a019324b4744 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:30.895895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 203/412] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 02:12:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:30.896847 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b64d2c-c988-4ef3-b8c9-a019324b4744 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:30.973531 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:30.985168 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a071e6b-01ec-4ec8-af3e-032efcd7123e None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:31.021239 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b64d2c-c988-4ef3-b8c9-a019324b4744 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:31.023152 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b489f-1b87-4a85-9b3d-a6fc596fa367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:31.024570 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b489f-1b87-4a85-9b3d-a6fc596fa367 None admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:31.024570 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b489f-1b87-4a85-9b3d-a6fc596fa367 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:31.024570 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b489f-1b87-4a85-9b3d-a6fc596fa367 None admin] PATH_INFO: `/v3/projects/91449401454c493cbf423888db8b8454/users/d9e8a7a5b8944272a2d1bd2140819ee9/roles/abb44cb94d7c46d3955fd92860aff94d` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:31.039932 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b489f-1b87-4a85-9b3d-a6fc596fa367 None admin] RBAC: Authorizing `identity:create_grant(project_id=91449401454c493cbf423888db8b8454, user_id=d9e8a7a5b8944272a2d1bd2140819ee9, role_id=abb44cb94d7c46d3955fd92860aff94d)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:31.041518 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b489f-1b87-4a85-9b3d-a6fc596fa367 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:31.045562 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:31.058105 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf56c06-a084-4c16-bc07-1addc572a541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:31.058713 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf56c06-a084-4c16-bc07-1addc572a541 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:31.060910 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf56c06-a084-4c16-bc07-1addc572a541 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:31.060910 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf56c06-a084-4c16-bc07-1addc572a541 None admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:31.060910 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf56c06-a084-4c16-bc07-1addc572a541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:31.060910 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf56c06-a084-4c16-bc07-1addc572a541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:31.061868 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf56c06-a084-4c16-bc07-1addc572a541 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:31.075442 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 204/413] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:31.076113 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf56c06-a084-4c16-bc07-1addc572a541 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:31.116792 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 210/414] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 02:12:30 2022] PUT /identity/v3/projects/91449401454c493cbf423888db8b8454/users/d9e8a7a5b8944272a2d1bd2140819ee9/roles/abb44cb94d7c46d3955fd92860aff94d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:12:31.117647 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b489f-1b87-4a85-9b3d-a6fc596fa367 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:31.249787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b489f-1b87-4a85-9b3d-a6fc596fa367 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:31.285538 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf56c06-a084-4c16-bc07-1addc572a541 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:31.296296 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb5156-0774-440d-a686-c7dffe1c38b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:31.296946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb5156-0774-440d-a686-c7dffe1c38b3 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:31.297226 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb5156-0774-440d-a686-c7dffe1c38b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:31.297496 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb5156-0774-440d-a686-c7dffe1c38b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:31.307274 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb5156-0774-440d-a686-c7dffe1c38b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:31.309293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb5156-0774-440d-a686-c7dffe1c38b3 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:31.323552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-62cb5156-0774-440d-a686-c7dffe1c38b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:31.323552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:31.323552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:31.323552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:31.323552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:31.323552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:31.323552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:31.323552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:31.323552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:31.323552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:31.323552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:31.323552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:31.323552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 02:12:31.323552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 02:12:31.323552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 02:12:31.324461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 02:12:31.324461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:31.324461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:31.324461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:31.324461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:31.324461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:31.324461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:31.324461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:31.324461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:31.324461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:31.324461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:31.324461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:31.324461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:31.324461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:31.324461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:31.324461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:31.324461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:31.325285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 02:12:31.325285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 02:12:31.325285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 02:12:31.325285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 02:12:31.325285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 02:12:31.325285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 02:12:31.325285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:31.325285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:31.325285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 211/415] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:12:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:31.332002 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:31.335854 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb5156-0774-440d-a686-c7dffe1c38b3 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:31.363682 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432992b-93af-45b9-8780-d8af2f977e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:31.364364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432992b-93af-45b9-8780-d8af2f977e22 None admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:31.364645 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432992b-93af-45b9-8780-d8af2f977e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:31.364920 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432992b-93af-45b9-8780-d8af2f977e22 None admin] PATH_INFO: `/v3/projects/91449401454c493cbf423888db8b8454/users/0f1f37f8136349edac3a52793e2fef8e/roles/abb44cb94d7c46d3955fd92860aff94d` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:31.403730 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432992b-93af-45b9-8780-d8af2f977e22 None admin] RBAC: Authorizing `identity:create_grant(project_id=91449401454c493cbf423888db8b8454, user_id=0f1f37f8136349edac3a52793e2fef8e, role_id=abb44cb94d7c46d3955fd92860aff94d)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:31.405221 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432992b-93af-45b9-8780-d8af2f977e22 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:31.409122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:31.460217 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb5156-0774-440d-a686-c7dffe1c38b3 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:31.480181 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 205/416] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 02:12:31 2022] PUT /identity/v3/projects/91449401454c493cbf423888db8b8454/users/0f1f37f8136349edac3a52793e2fef8e/roles/abb44cb94d7c46d3955fd92860aff94d => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:12:31.517216 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de2ebd-8e12-460d-b09a-d5711f18f2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:31.518220 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de2ebd-8e12-460d-b09a-d5711f18f2a7 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:31.518391 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de2ebd-8e12-460d-b09a-d5711f18f2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:31.518602 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de2ebd-8e12-460d-b09a-d5711f18f2a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:31.519425 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de2ebd-8e12-460d-b09a-d5711f18f2a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:31.519738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de2ebd-8e12-460d-b09a-d5711f18f2a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:31.521176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de2ebd-8e12-460d-b09a-d5711f18f2a7 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:31.538359 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 212/417] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 02:12:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:31.544375 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432992b-93af-45b9-8780-d8af2f977e22 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:31.676528 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432992b-93af-45b9-8780-d8af2f977e22 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:31.728762 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f413190-d16d-47f8-8ee8-6adb55b32084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:31.729440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f413190-d16d-47f8-8ee8-6adb55b32084 None admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:31.729716 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f413190-d16d-47f8-8ee8-6adb55b32084 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:31.729987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f413190-d16d-47f8-8ee8-6adb55b32084 None admin] PATH_INFO: `/v3/projects/91449401454c493cbf423888db8b8454/users/e7e4640bd879468d81ec0281827687ad/roles/abb44cb94d7c46d3955fd92860aff94d` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:31.750507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f413190-d16d-47f8-8ee8-6adb55b32084 None admin] RBAC: Authorizing `identity:create_grant(project_id=91449401454c493cbf423888db8b8454, user_id=e7e4640bd879468d81ec0281827687ad, role_id=abb44cb94d7c46d3955fd92860aff94d)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:31.752817 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f413190-d16d-47f8-8ee8-6adb55b32084 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:31.810966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 206/418] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 02:12:31 2022] PUT /identity/v3/projects/91449401454c493cbf423888db8b8454/users/e7e4640bd879468d81ec0281827687ad/roles/abb44cb94d7c46d3955fd92860aff94d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:12:32.208586 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dd7ba-053b-4f71-95b2-07db99defafa None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:32.209327 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dd7ba-053b-4f71-95b2-07db99defafa None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:32.209327 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dd7ba-053b-4f71-95b2-07db99defafa None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:32.212801 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 213/419] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:32.216105 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701c546-5da5-4f55-b6a0-9462e76730d4 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:32.216610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701c546-5da5-4f55-b6a0-9462e76730d4 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:32.216776 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701c546-5da5-4f55-b6a0-9462e76730d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:32.244759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-a701c546-5da5-4f55-b6a0-9462e76730d4 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:32.246005 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-a701c546-5da5-4f55-b6a0-9462e76730d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:32.270954 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:32.353286 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 207/420] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:32.755940 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0dd7ba-053b-4f71-95b2-07db99defafa None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:32.893104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0dd7ba-053b-4f71-95b2-07db99defafa None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:32.917817 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:32.943300 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7597b03-493e-4f71-bef8-7e8b060db97b None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:32.943608 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7597b03-493e-4f71-bef8-7e8b060db97b None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:32.943853 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7597b03-493e-4f71-bef8-7e8b060db97b None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:32.945315 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 208/421] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:32.945418 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95669443-7783-48cd-92ff-ecd26b1ec697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:32.945881 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95669443-7783-48cd-92ff-ecd26b1ec697 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:32.946161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95669443-7783-48cd-92ff-ecd26b1ec697 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:32.946432 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95669443-7783-48cd-92ff-ecd26b1ec697 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:32.951580 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7a5c7-f32c-4bb6-9459-80ffe1467331 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:32.952094 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7a5c7-f32c-4bb6-9459-80ffe1467331 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:32.952579 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7a5c7-f32c-4bb6-9459-80ffe1467331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:32.967565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95669443-7783-48cd-92ff-ecd26b1ec697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:32.973653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-95669443-7783-48cd-92ff-ecd26b1ec697 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:12:32.973653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:32.973653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:32.973653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:32.973653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:32.973653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:32.973653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:32.973653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:32.973653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:32.973653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:32.973653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:32.973653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:32.973653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:32.973653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:32.973653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:32.973653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:32.974531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:32.974531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:32.974531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:32.974531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:32.974531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:32.974531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:32.974531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:32.974531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:32.974531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:32.974531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:32.974531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:32.974531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:32.974531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:32.974531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:32.974531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:32.974531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:32.975359 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:32.975359 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:32.975359 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:32.975359 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:32.975359 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:32.975359 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:32.975359 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:32.975359 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:32.975359 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:32.975359 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:32.975359 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:12:32.975359 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:32.978680 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 214/422] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 02:12:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:32.983195 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-cfd7a5c7-f32c-4bb6-9459-80ffe1467331 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:32.984676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-cfd7a5c7-f32c-4bb6-9459-80ffe1467331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:32.985693 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95669443-7783-48cd-92ff-ecd26b1ec697 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:33.100105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95669443-7783-48cd-92ff-ecd26b1ec697 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:33.146908 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 209/423] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 02:12:33.157288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5591644-4cc2-4c3f-a418-4ee3c373238d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:33.158084 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5591644-4cc2-4c3f-a418-4ee3c373238d None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:33.158472 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5591644-4cc2-4c3f-a418-4ee3c373238d None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:33.162875 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5591644-4cc2-4c3f-a418-4ee3c373238d None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:33.163603 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5591644-4cc2-4c3f-a418-4ee3c373238d None admin] RBAC: Adding query filter params (name=service) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:33.163919 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5591644-4cc2-4c3f-a418-4ee3c373238d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:33.165298 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5591644-4cc2-4c3f-a418-4ee3c373238d None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:33.182192 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 215/424] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 02:12:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:33.187912 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7a5c7-f32c-4bb6-9459-80ffe1467331 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:33.328794 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:33.350770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7a5c7-f32c-4bb6-9459-80ffe1467331 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:33.403639 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3668114-9b97-4214-b0dc-27bf6cedc4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:33.404275 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3668114-9b97-4214-b0dc-27bf6cedc4f7 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:33.404556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3668114-9b97-4214-b0dc-27bf6cedc4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:33.404825 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3668114-9b97-4214-b0dc-27bf6cedc4f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:33.419482 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3668114-9b97-4214-b0dc-27bf6cedc4f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:33.420943 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3668114-9b97-4214-b0dc-27bf6cedc4f7 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:33.443570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-d3668114-9b97-4214-b0dc-27bf6cedc4f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:33.443570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:33.443570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:33.443570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:33.443570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:33.443570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:33.443570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:33.443570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:33.443570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:33.443570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:33.443570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:33.443570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:33.443570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:33.443570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:33.443570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:33.443570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:33.444552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:33.444552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:33.444552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:33.444552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:33.444552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:33.444552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:33.444552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:33.444552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:33.444552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:33.444552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:33.444552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:33.444552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:33.444552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:33.444552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:33.444552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:33.444552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:33.444552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:33.445378 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:33.445378 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:33.445378 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:33.445378 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 210/425] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:33.450608 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5591644-4cc2-4c3f-a418-4ee3c373238d None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:33.468975 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3668114-9b97-4214-b0dc-27bf6cedc4f7 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:33.537409 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:33.604209 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3668114-9b97-4214-b0dc-27bf6cedc4f7 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:33.629105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5591644-4cc2-4c3f-a418-4ee3c373238d None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:33.661446 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:33.675714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f930fb9-b831-4942-8525-3ddeac372891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:33.676403 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f930fb9-b831-4942-8525-3ddeac372891 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:33.676656 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f930fb9-b831-4942-8525-3ddeac372891 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:33.676927 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f930fb9-b831-4942-8525-3ddeac372891 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:33.681009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced657e-c8fd-4832-8ca8-08061f8d06e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:33.681962 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced657e-c8fd-4832-8ca8-08061f8d06e0 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:33.682444 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced657e-c8fd-4832-8ca8-08061f8d06e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:33.682979 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced657e-c8fd-4832-8ca8-08061f8d06e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:33.684343 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced657e-c8fd-4832-8ca8-08061f8d06e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:33.685187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced657e-c8fd-4832-8ca8-08061f8d06e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:33.686857 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced657e-c8fd-4832-8ca8-08061f8d06e0 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:33.703695 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f930fb9-b831-4942-8525-3ddeac372891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:33.713185 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-4f930fb9-b831-4942-8525-3ddeac372891 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:12:33.713185 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:33.713185 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:33.713185 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:33.713185 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:33.713185 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:33.713185 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:33.713185 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:33.713185 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:33.713185 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:33.713185 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:33.713185 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:33.713185 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:33.713185 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:33.713185 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:33.713185 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:33.714172 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:33.714172 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:33.714172 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:33.714172 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:33.714172 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:33.714172 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:33.714172 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:33.714172 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:33.714172 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:33.714172 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:33.714172 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:33.714172 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:33.714172 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:33.714172 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:33.714172 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:33.714172 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:33.715004 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:33.715004 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:33.715004 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:33.715004 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:33.715004 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:33.715004 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:33.715004 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:33.715004 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:33.715004 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:33.715004 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:33.715004 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:12:33.715004 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:33.718787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 216/426] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:33.724649 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 211/427] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 02:12:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:12:33.727043 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced657e-c8fd-4832-8ca8-08061f8d06e0 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:33.730925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f930fb9-b831-4942-8525-3ddeac372891 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:33.863357 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:33.867206 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced657e-c8fd-4832-8ca8-08061f8d06e0 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:33.878475 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f930fb9-b831-4942-8525-3ddeac372891 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:33.903399 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2530a2-87aa-49c6-9e95-efd55331ad0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:33.904132 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2530a2-87aa-49c6-9e95-efd55331ad0c None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:33.904339 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2530a2-87aa-49c6-9e95-efd55331ad0c None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:33.904559 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2530a2-87aa-49c6-9e95-efd55331ad0c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:33.912569 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2530a2-87aa-49c6-9e95-efd55331ad0c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:33.914015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2530a2-87aa-49c6-9e95-efd55331ad0c None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:33.917388 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c948817-4cd0-4ea7-9376-b404b3f3312b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:33.918271 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c948817-4cd0-4ea7-9376-b404b3f3312b None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:33.918753 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c948817-4cd0-4ea7-9376-b404b3f3312b None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:33.919255 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c948817-4cd0-4ea7-9376-b404b3f3312b None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:33.920120 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c948817-4cd0-4ea7-9376-b404b3f3312b None admin] RBAC: Adding query filter params (name=service) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:33.920642 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c948817-4cd0-4ea7-9376-b404b3f3312b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:33.922210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c948817-4cd0-4ea7-9376-b404b3f3312b None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:33.926112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-ad2530a2-87aa-49c6-9e95-efd55331ad0c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 02:12:33.926112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:33.926112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:33.926112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:33.926112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:33.926112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:33.926112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:33.926112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:33.926112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:33.926112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:33.926112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:33.926112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:33.926112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 02:12:33.926112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 02:12:33.926112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 02:12:33.926112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 02:12:33.927031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:33.927031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:33.927031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:12:33.927031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:33.927031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:12:33.927031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:33.927031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:33.927031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:33.927031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:33.927031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:33.927031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:33.927031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:33.927031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:33.927031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:33.927031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:33.927031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:33.927031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:33.927031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:33.928020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:33.928020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:33.928020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 02:12:33.928020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 02:12:33.928020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 02:12:33.928020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 02:12:33.928020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 02:12:33.928020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 02:12:33.928020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 02:12:33.928020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:33.928020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 217/428] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 19 02:12:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:12:33.933450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905cb8d-6743-4e7d-80ce-1382c5910c16 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:33.933450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905cb8d-6743-4e7d-80ce-1382c5910c16 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:33.933450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905cb8d-6743-4e7d-80ce-1382c5910c16 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:33.933450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 218/429] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:33.935823 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905cb8d-6743-4e7d-80ce-1382c5910c16 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:33.940975 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 212/430] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 02:12:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:33.942467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7e64e-ae53-46cf-bbc0-3be55788cc87 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:33.943000 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7e64e-ae53-46cf-bbc0-3be55788cc87 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:33.943482 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7e64e-ae53-46cf-bbc0-3be55788cc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:33.962391 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-05f7e64e-ae53-46cf-bbc0-3be55788cc87 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:33.963946 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-05f7e64e-ae53-46cf-bbc0-3be55788cc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:34.027318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:34.042951 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 213/431] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:34.044411 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7e64e-ae53-46cf-bbc0-3be55788cc87 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:34.045248 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905cb8d-6743-4e7d-80ce-1382c5910c16 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:34.091175 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821ec64-4cbe-4167-bba6-6f7141664ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:34.091175 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821ec64-4cbe-4167-bba6-6f7141664ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:34.091175 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821ec64-4cbe-4167-bba6-6f7141664ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:34.091175 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821ec64-4cbe-4167-bba6-6f7141664ec2 None admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:34.091580 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821ec64-4cbe-4167-bba6-6f7141664ec2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:34.091580 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821ec64-4cbe-4167-bba6-6f7141664ec2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:34.091580 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821ec64-4cbe-4167-bba6-6f7141664ec2 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:34.109625 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 219/432] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 19 02:12:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:34.117004 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821ec64-4cbe-4167-bba6-6f7141664ec2 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:34.151168 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:34.177527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7e64e-ae53-46cf-bbc0-3be55788cc87 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:34.222861 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248dec0e-c033-47df-9a11-754a5f8adcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:34.222861 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dec0e-c033-47df-9a11-754a5f8adcbe None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:34.222861 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dec0e-c033-47df-9a11-754a5f8adcbe None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:34.222861 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dec0e-c033-47df-9a11-754a5f8adcbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:34.236077 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248dec0e-c033-47df-9a11-754a5f8adcbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:34.237625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248dec0e-c033-47df-9a11-754a5f8adcbe None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:34.253594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-248dec0e-c033-47df-9a11-754a5f8adcbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:34.253594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:34.253594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:34.253594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:34.253594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:34.253594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:34.253594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:34.253594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:34.253594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:34.253594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:34.253594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:34.253594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:34.253594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:34.253594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:34.253594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:34.253594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:34.254527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:34.254527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:34.254527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:34.254527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:34.254527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:34.254527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:34.254527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:34.254527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:34.254527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:34.254527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:34.254527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:34.254527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:34.254527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:34.254527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:34.254527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:34.254527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:34.254527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:34.255398 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:34.255398 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:34.255398 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:34.255398 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 214/433] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:34.260271 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248dec0e-c033-47df-9a11-754a5f8adcbe None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:34.311268 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:34.334450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821ec64-4cbe-4167-bba6-6f7141664ec2 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:34.378867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a1d8f-a907-4d8b-b872-718d1dfa9fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:34.379440 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a1d8f-a907-4d8b-b872-718d1dfa9fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:34.379717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a1d8f-a907-4d8b-b872-718d1dfa9fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:34.379985 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a1d8f-a907-4d8b-b872-718d1dfa9fa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:34.446205 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248dec0e-c033-47df-9a11-754a5f8adcbe None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:34.489811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a1d8f-a907-4d8b-b872-718d1dfa9fa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:34.490470 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e3fdd-38a8-47b0-bfe3-1df89daaa723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:34.491014 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e3fdd-38a8-47b0-bfe3-1df89daaa723 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:34.491330 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a1d8f-a907-4d8b-b872-718d1dfa9fa2 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:34.491424 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e3fdd-38a8-47b0-bfe3-1df89daaa723 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:34.491659 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e3fdd-38a8-47b0-bfe3-1df89daaa723 None admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:34.492303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e3fdd-38a8-47b0-bfe3-1df89daaa723 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:34.492603 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e3fdd-38a8-47b0-bfe3-1df89daaa723 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:34.494215 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e3fdd-38a8-47b0-bfe3-1df89daaa723 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:34.508039 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 215/434] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:34.509035 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e3fdd-38a8-47b0-bfe3-1df89daaa723 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:34.513081 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:34.600501 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 220/435] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:12:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 19 02:12:34.601758 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5251c-69e5-4530-a962-665c1584de84 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:34.602035 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5251c-69e5-4530-a962-665c1584de84 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:34.602307 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5251c-69e5-4530-a962-665c1584de84 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:34.603746 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 221/436] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:34.604268 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5251c-69e5-4530-a962-665c1584de84 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:34.609363 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:34.615927 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e3fdd-38a8-47b0-bfe3-1df89daaa723 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:34.651773 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d6c5a-8bed-4442-9d5c-6f3ab59e748b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:34.652321 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d6c5a-8bed-4442-9d5c-6f3ab59e748b None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:34.652597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d6c5a-8bed-4442-9d5c-6f3ab59e748b None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:34.652871 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d6c5a-8bed-4442-9d5c-6f3ab59e748b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:34.662807 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d6c5a-8bed-4442-9d5c-6f3ab59e748b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:34.667559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-799d6c5a-8bed-4442-9d5c-6f3ab59e748b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:12:34.667559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:34.667559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:34.667559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:34.667559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:34.667559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:34.667559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:34.667559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:34.667559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:34.667559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:34.667559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:34.667559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:34.667559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:34.667559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:34.667559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:34.667559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:34.668614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:34.668614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:34.668614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:34.668614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:34.668614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:34.668614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:34.668614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:34.668614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:34.668614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:34.668614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:34.668614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:34.668614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:34.668614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:34.668614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:34.668614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:34.668614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:34.670147 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:34.670147 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:34.670147 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:34.670147 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:34.670147 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:34.670147 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:34.670147 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:34.670147 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:34.670147 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:34.670147 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:34.670147 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:12:34.670147 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:34.670147 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 216/437] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 02:12:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:34.670147 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e226e1-1c1c-4143-a159-4010d8638b61 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:34.670880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e226e1-1c1c-4143-a159-4010d8638b61 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:34.670880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e226e1-1c1c-4143-a159-4010d8638b61 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:34.671989 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 217/438] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:34.672511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e226e1-1c1c-4143-a159-4010d8638b61 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:34.710825 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5251c-69e5-4530-a962-665c1584de84 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:34.726768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:34.745011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705df0a6-b819-471b-aba8-0866d99e8228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:34.745626 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705df0a6-b819-471b-aba8-0866d99e8228 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:34.745898 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705df0a6-b819-471b-aba8-0866d99e8228 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:34.746163 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705df0a6-b819-471b-aba8-0866d99e8228 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:34.753593 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705df0a6-b819-471b-aba8-0866d99e8228 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:34.755041 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705df0a6-b819-471b-aba8-0866d99e8228 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:34.766563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-705df0a6-b819-471b-aba8-0866d99e8228 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 19 02:12:34.766563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:34.766563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:34.766563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:34.766563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:34.766563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:34.766563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:34.766563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:34.766563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:34.766563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:34.766563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:34.766563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:34.766563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 02:12:34.766563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 02:12:34.766563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 02:12:34.766563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 02:12:34.768667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:34.768667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:34.768667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:12:34.768667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:34.768667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:12:34.768667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:34.768667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:34.768667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:34.768667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:34.768667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:34.768667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:34.768667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:34.768667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:34.768667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:34.768667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:34.768667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:34.768667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:34.768667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:34.770272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:34.770272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:34.770272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 02:12:34.770272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 02:12:34.770272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 02:12:34.770272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 02:12:34.770272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 02:12:34.770272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 02:12:34.770272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 19 02:12:34.770272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:34.770272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 222/439] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 02:12:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:34.770272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd908535-23b9-4950-8d9c-b73a5b3be33b None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:34.770272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd908535-23b9-4950-8d9c-b73a5b3be33b None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:34.770981 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd908535-23b9-4950-8d9c-b73a5b3be33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:34.780024 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e226e1-1c1c-4143-a159-4010d8638b61 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:34.789185 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-fd908535-23b9-4950-8d9c-b73a5b3be33b None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:34.790373 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-fd908535-23b9-4950-8d9c-b73a5b3be33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:34.814344 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788871f9-c498-4e88-9cdd-7fc0d1272c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:34.814997 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788871f9-c498-4e88-9cdd-7fc0d1272c2c None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:34.815278 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788871f9-c498-4e88-9cdd-7fc0d1272c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:34.815547 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788871f9-c498-4e88-9cdd-7fc0d1272c2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:34.826673 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788871f9-c498-4e88-9cdd-7fc0d1272c2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:34.828250 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788871f9-c498-4e88-9cdd-7fc0d1272c2c None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:34.843438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-788871f9-c498-4e88-9cdd-7fc0d1272c2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:34.843438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:34.843438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:34.843438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:34.843438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:34.843438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:34.843438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:34.843438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:34.843438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:34.843438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:34.843438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:34.843438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:34.843438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:34.843438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:34.843438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:34.843438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:34.844517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:34.844517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:34.844517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:34.844517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:34.844517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:34.844517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:34.844517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:34.844517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:34.844517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:34.844517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:34.844517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:34.844517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:34.844517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:34.844517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:34.844517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:34.844517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:34.844517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:34.846039 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:34.846039 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:34.846039 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:34.846039 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 218/440] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:34.846039 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788871f9-c498-4e88-9cdd-7fc0d1272c2c None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:34.856678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:34.862947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 223/441] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:34.864516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9fcd9-498d-404e-b13e-f2916511c428 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:34.870129 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9fcd9-498d-404e-b13e-f2916511c428 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:34.870129 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9fcd9-498d-404e-b13e-f2916511c428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:34.883588 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-2bf9fcd9-498d-404e-b13e-f2916511c428 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:34.884773 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-2bf9fcd9-498d-404e-b13e-f2916511c428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:34.949824 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788871f9-c498-4e88-9cdd-7fc0d1272c2c None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:34.957086 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 224/442] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:34.957928 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9fcd9-498d-404e-b13e-f2916511c428 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:34.998010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57d11f-faf0-4e37-8ad7-2ac0d787e454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:34.999150 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57d11f-faf0-4e37-8ad7-2ac0d787e454 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:35.000307 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:35.001980 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57d11f-faf0-4e37-8ad7-2ac0d787e454 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:35.002465 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57d11f-faf0-4e37-8ad7-2ac0d787e454 None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:35.003392 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57d11f-faf0-4e37-8ad7-2ac0d787e454 None admin] RBAC: Adding query filter params (name=service) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:35.003925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57d11f-faf0-4e37-8ad7-2ac0d787e454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:35.005514 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57d11f-faf0-4e37-8ad7-2ac0d787e454 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:35.016361 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 219/443] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 02:12:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:35.018442 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57d11f-faf0-4e37-8ad7-2ac0d787e454 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:35.074344 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9fcd9-498d-404e-b13e-f2916511c428 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:35.111418 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:35.120734 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45706a-24dc-4b61-9659-d7c702d43f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:35.121503 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45706a-24dc-4b61-9659-d7c702d43f30 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:35.121852 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45706a-24dc-4b61-9659-d7c702d43f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:35.122382 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45706a-24dc-4b61-9659-d7c702d43f30 None admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:35.122953 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45706a-24dc-4b61-9659-d7c702d43f30 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:35.123317 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45706a-24dc-4b61-9659-d7c702d43f30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:35.124829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45706a-24dc-4b61-9659-d7c702d43f30 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:35.146871 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 225/444] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Oct 19 02:12:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:35.146871 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45706a-24dc-4b61-9659-d7c702d43f30 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:35.153993 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57d11f-faf0-4e37-8ad7-2ac0d787e454 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:35.190996 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f374e4-c1ac-4095-8097-4b6674e9da9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:35.191607 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f374e4-c1ac-4095-8097-4b6674e9da9a None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:35.191941 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f374e4-c1ac-4095-8097-4b6674e9da9a None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:35.192226 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f374e4-c1ac-4095-8097-4b6674e9da9a None admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:35.192872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f374e4-c1ac-4095-8097-4b6674e9da9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:35.193170 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f374e4-c1ac-4095-8097-4b6674e9da9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:35.194545 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f374e4-c1ac-4095-8097-4b6674e9da9a None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:35.207062 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 220/445] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:35.207948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f374e4-c1ac-4095-8097-4b6674e9da9a None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:35.253031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:35.261096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45706a-24dc-4b61-9659-d7c702d43f30 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:35.296807 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc7ec3-67c0-4153-80e8-b73f8cb14783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:35.297459 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc7ec3-67c0-4153-80e8-b73f8cb14783 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:35.297729 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc7ec3-67c0-4153-80e8-b73f8cb14783 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:35.297993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc7ec3-67c0-4153-80e8-b73f8cb14783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:35.310230 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc7ec3-67c0-4153-80e8-b73f8cb14783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:35.311702 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc7ec3-67c0-4153-80e8-b73f8cb14783 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:35.315434 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f374e4-c1ac-4095-8097-4b6674e9da9a None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:35.327254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-1bfc7ec3-67c0-4153-80e8-b73f8cb14783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:35.327254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:35.327254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:35.327254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:35.327254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:35.327254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:35.327254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:35.327254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:35.327254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:35.327254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:35.327254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:35.327254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:35.327254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:35.327254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:35.327254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:35.327254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:35.328155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:35.328155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:35.328155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:35.328155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:35.328155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:35.328155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:35.328155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:35.328155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:35.328155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:35.328155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:35.328155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:35.328155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:35.328155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:35.328155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:35.328155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:35.328155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:35.328155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:35.329046 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:35.329046 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:35.329046 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:35.329046 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 226/446] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:35.329270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc7ec3-67c0-4153-80e8-b73f8cb14783 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:35.345789 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:35.351319 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e37f66-e0e5-486b-a890-aebd9e3a1e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:35.351942 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e37f66-e0e5-486b-a890-aebd9e3a1e0d None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:35.352217 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e37f66-e0e5-486b-a890-aebd9e3a1e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:35.356384 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e37f66-e0e5-486b-a890-aebd9e3a1e0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:35.362652 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e37f66-e0e5-486b-a890-aebd9e3a1e0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:35.367382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-22e37f66-e0e5-486b-a890-aebd9e3a1e0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:12:35.367382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:35.367382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:35.367382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:35.367382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:35.367382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:35.367382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:35.367382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:35.367382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:35.367382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:35.367382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:35.367382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:35.367382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:35.367382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:35.367382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:35.367382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:35.368609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:35.368609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:35.368609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:35.368609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:35.368609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:35.368609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:35.368609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:35.368609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:35.368609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:35.368609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:35.368609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:35.368609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:35.368609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:35.368609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:35.368609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:35.368609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:35.369393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:35.369393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:35.369393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:35.369393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:35.369393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:35.369393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:35.369393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:35.369393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:35.369393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:35.369393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:35.369393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:12:35.369393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:35.369393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 221/447] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 02:12:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:35.369393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e37f66-e0e5-486b-a890-aebd9e3a1e0d None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:35.434176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc7ec3-67c0-4153-80e8-b73f8cb14783 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:35.470614 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651e00f-54e6-4d37-a406-4fe423939710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:35.471270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651e00f-54e6-4d37-a406-4fe423939710 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:35.471541 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651e00f-54e6-4d37-a406-4fe423939710 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:35.471809 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651e00f-54e6-4d37-a406-4fe423939710 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:35.474473 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e37f66-e0e5-486b-a890-aebd9e3a1e0d None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:35.481975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651e00f-54e6-4d37-a406-4fe423939710 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:35.483435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651e00f-54e6-4d37-a406-4fe423939710 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:35.490611 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:35.498619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-3651e00f-54e6-4d37-a406-4fe423939710 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:35.498619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:35.498619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:35.498619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:35.498619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:35.498619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:35.498619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:35.498619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:35.498619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:35.498619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:35.498619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:35.498619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:35.498619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:35.498619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:35.498619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:35.498619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:35.499785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:35.499785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:35.499785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:35.499785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:35.499785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:35.499785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:35.499785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:35.499785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:35.499785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:35.499785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:35.499785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:35.499785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:35.499785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:35.499785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:35.499785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:35.499785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:35.499785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:35.500776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:35.500776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:35.500776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:35.500776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 227/448] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:35.500776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651e00f-54e6-4d37-a406-4fe423939710 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:35.513042 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4955301-17b2-4f34-be87-dcbdbc5c66f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:35.513656 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4955301-17b2-4f34-be87-dcbdbc5c66f5 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:35.513930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4955301-17b2-4f34-be87-dcbdbc5c66f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:35.514195 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4955301-17b2-4f34-be87-dcbdbc5c66f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:35.521329 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4955301-17b2-4f34-be87-dcbdbc5c66f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:35.522775 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4955301-17b2-4f34-be87-dcbdbc5c66f5 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:35.534331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-a4955301-17b2-4f34-be87-dcbdbc5c66f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:35.534331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:35.534331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:35.534331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:35.534331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:35.534331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:35.534331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:35.534331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:35.534331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:35.534331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:35.534331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:35.534331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:35.534331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 02:12:35.534331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 02:12:35.534331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 02:12:35.535341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 02:12:35.535341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:35.535341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:35.535341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:35.535341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:35.535341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:35.535341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:35.535341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:35.535341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:35.535341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:35.535341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:35.535341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:35.535341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:35.535341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:35.535341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:35.535341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:35.535341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:35.536212 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 02:12:35.536212 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 02:12:35.536212 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 02:12:35.536212 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 02:12:35.536212 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 02:12:35.536212 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 02:12:35.536212 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:35.536212 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:35.536212 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 222/449] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:12:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:35.536679 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4955301-17b2-4f34-be87-dcbdbc5c66f5 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:35.585852 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:35.606425 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651e00f-54e6-4d37-a406-4fe423939710 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:35.634971 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4955301-17b2-4f34-be87-dcbdbc5c66f5 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:35.639840 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d91d7-3e9c-4a0e-9945-e330bc9a8d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:35.640487 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d91d7-3e9c-4a0e-9945-e330bc9a8d3a None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:35.640765 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d91d7-3e9c-4a0e-9945-e330bc9a8d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:35.641034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d91d7-3e9c-4a0e-9945-e330bc9a8d3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:35.651066 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d91d7-3e9c-4a0e-9945-e330bc9a8d3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:35.656271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-b53d91d7-3e9c-4a0e-9945-e330bc9a8d3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:12:35.656271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:35.656271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:35.656271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:35.656271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:35.656271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:35.656271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:35.656271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:35.656271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:35.656271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:35.656271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:35.656271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:35.656271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:35.656271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:35.656271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:35.656271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:35.657272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:35.657272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:35.657272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:35.657272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:35.657272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:35.657272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:35.657272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:35.657272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:35.657272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:35.657272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:35.657272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:35.657272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:35.657272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:35.657272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:35.657272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:35.657272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:35.659753 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:35.659753 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:35.659753 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:35.659753 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:35.659753 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:35.659753 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:35.659753 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:35.659753 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:35.659753 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:35.659753 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:35.659753 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:12:35.659753 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:35.659753 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 228/450] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 02:12:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:35.659753 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d91d7-3e9c-4a0e-9945-e330bc9a8d3a None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:35.667703 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3d145-8e4a-41e9-9cf5-081cfb65df43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:35.668299 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3d145-8e4a-41e9-9cf5-081cfb65df43 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:35.668574 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3d145-8e4a-41e9-9cf5-081cfb65df43 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:35.668843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3d145-8e4a-41e9-9cf5-081cfb65df43 None admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:35.669479 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3d145-8e4a-41e9-9cf5-081cfb65df43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:35.669776 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3d145-8e4a-41e9-9cf5-081cfb65df43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:35.671168 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3d145-8e4a-41e9-9cf5-081cfb65df43 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:35.682800 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 223/451] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:35.683596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3d145-8e4a-41e9-9cf5-081cfb65df43 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:35.721966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:35.766404 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d91d7-3e9c-4a0e-9945-e330bc9a8d3a None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:35.781960 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3d145-8e4a-41e9-9cf5-081cfb65df43 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:35.793199 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:35.800185 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7db720-c2c3-421b-8608-55acd21e0200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:35.800776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7db720-c2c3-421b-8608-55acd21e0200 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:35.801055 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7db720-c2c3-421b-8608-55acd21e0200 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:35.801324 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7db720-c2c3-421b-8608-55acd21e0200 None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:35.801982 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7db720-c2c3-421b-8608-55acd21e0200 None admin] RBAC: Adding query filter params (name=service) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:35.802280 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7db720-c2c3-421b-8608-55acd21e0200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:35.803669 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7db720-c2c3-421b-8608-55acd21e0200 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:35.811843 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 229/452] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 02:12:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:35.812440 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7db720-c2c3-421b-8608-55acd21e0200 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:35.821076 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0ef97-d236-4450-bb4e-c5e59e665fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:35.821685 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0ef97-d236-4450-bb4e-c5e59e665fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:35.821966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0ef97-d236-4450-bb4e-c5e59e665fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:35.822239 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0ef97-d236-4450-bb4e-c5e59e665fd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:35.823329 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0ef97-d236-4450-bb4e-c5e59e665fd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:35.823641 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0ef97-d236-4450-bb4e-c5e59e665fd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:35.825392 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0ef97-d236-4450-bb4e-c5e59e665fd3 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:35.837445 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 224/453] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:35.838335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0ef97-d236-4450-bb4e-c5e59e665fd3 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:35.917211 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7db720-c2c3-421b-8608-55acd21e0200 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:35.937011 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0ef97-d236-4450-bb4e-c5e59e665fd3 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:35.937794 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:35.951590 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32440888-9d83-4121-bd47-55de08622254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:35.952186 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32440888-9d83-4121-bd47-55de08622254 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:35.952465 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32440888-9d83-4121-bd47-55de08622254 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:35.952730 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32440888-9d83-4121-bd47-55de08622254 None admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:35.953407 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32440888-9d83-4121-bd47-55de08622254 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:35.953704 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32440888-9d83-4121-bd47-55de08622254 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:35.955452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32440888-9d83-4121-bd47-55de08622254 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:35.966984 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 230/454] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 02:12:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:35.967763 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32440888-9d83-4121-bd47-55de08622254 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:35.971046 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b50b5-351f-4d89-9a95-7d6d23685e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:35.971662 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b50b5-351f-4d89-9a95-7d6d23685e35 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:35.971942 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b50b5-351f-4d89-9a95-7d6d23685e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:35.972337 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b50b5-351f-4d89-9a95-7d6d23685e35 None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:35.973024 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b50b5-351f-4d89-9a95-7d6d23685e35 None admin] RBAC: Adding query filter params (name=service) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:35.973325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b50b5-351f-4d89-9a95-7d6d23685e35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:35.974695 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b50b5-351f-4d89-9a95-7d6d23685e35 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:35.984676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 225/455] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 02:12:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:35.985630 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b50b5-351f-4d89-9a95-7d6d23685e35 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:36.018956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:36.069131 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32440888-9d83-4121-bd47-55de08622254 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:36.086515 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b50b5-351f-4d89-9a95-7d6d23685e35 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:36.103180 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8eea2-37f5-4cd1-8c57-9da958a7d68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:36.103798 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8eea2-37f5-4cd1-8c57-9da958a7d68d None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:36.104073 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8eea2-37f5-4cd1-8c57-9da958a7d68d None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:36.104340 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8eea2-37f5-4cd1-8c57-9da958a7d68d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:36.111814 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8eea2-37f5-4cd1-8c57-9da958a7d68d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:36.113301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8eea2-37f5-4cd1-8c57-9da958a7d68d None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:36.119739 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269bfc3-122a-4cb8-af13-a6da539017cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:36.120352 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269bfc3-122a-4cb8-af13-a6da539017cd None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:36.120624 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269bfc3-122a-4cb8-af13-a6da539017cd None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:36.120888 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269bfc3-122a-4cb8-af13-a6da539017cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:36.125057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-56b8eea2-37f5-4cd1-8c57-9da958a7d68d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 19 02:12:36.125057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:36.125057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:36.125057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:36.125057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:36.125057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:36.125057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:36.125057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:36.125057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:36.125057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:36.125057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:36.125057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:36.125057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 02:12:36.125057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 02:12:36.125057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 02:12:36.125057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 02:12:36.125930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:36.125930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:36.125930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:12:36.125930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:36.125930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:12:36.125930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:36.125930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:36.125930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:36.125930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:36.125930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:36.125930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:36.125930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:36.125930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:36.125930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:36.125930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:36.125930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:36.125930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:36.125930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:36.127033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:36.127033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:36.127033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 02:12:36.127033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 02:12:36.127033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 02:12:36.127033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 02:12:36.127033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 02:12:36.127033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 02:12:36.127033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 19 02:12:36.127033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:36.127033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 231/456] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:12:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:36.127598 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8eea2-37f5-4cd1-8c57-9da958a7d68d None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:36.134734 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269bfc3-122a-4cb8-af13-a6da539017cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:36.136210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269bfc3-122a-4cb8-af13-a6da539017cd None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:36.151439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-4269bfc3-122a-4cb8-af13-a6da539017cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:36.151439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:36.151439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:36.151439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:36.151439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:36.151439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:36.151439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:36.151439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:36.151439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:36.151439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:36.151439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:36.151439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:36.151439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:36.151439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:36.151439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:36.151439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:36.152522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:36.152522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:36.152522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:36.152522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:36.152522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:36.152522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:36.152522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:36.152522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:36.152522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:36.152522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:36.152522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:36.152522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:36.152522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:36.152522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:36.152522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:36.152522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:36.152522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:36.153444 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:36.153444 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:36.153444 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:36.153444 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 226/457] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:36.153444 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269bfc3-122a-4cb8-af13-a6da539017cd None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:36.171028 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:36.229770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8eea2-37f5-4cd1-8c57-9da958a7d68d None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:36.237824 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:36.253281 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269bfc3-122a-4cb8-af13-a6da539017cd None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:36.262494 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9caf64c-1504-4a8b-b720-a08d93da982f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:36.263217 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caf64c-1504-4a8b-b720-a08d93da982f None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:36.263497 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caf64c-1504-4a8b-b720-a08d93da982f None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:36.263766 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caf64c-1504-4a8b-b720-a08d93da982f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:36.270726 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9caf64c-1504-4a8b-b720-a08d93da982f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:36.272180 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9caf64c-1504-4a8b-b720-a08d93da982f None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:36.283158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-f9caf64c-1504-4a8b-b720-a08d93da982f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:36.283158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:36.283158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:36.283158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:36.283158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:36.283158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:36.283158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:36.283158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:36.283158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:36.283158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:36.283158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:36.283158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:36.283158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 02:12:36.283158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 02:12:36.283158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 02:12:36.284060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 02:12:36.284060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:36.284060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:36.284060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:36.284060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:36.284060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:36.284060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:36.284060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:36.284060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:36.284060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:36.284060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:36.284060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:36.284060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:36.284060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:36.284060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:36.284060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:36.284060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:36.284917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 02:12:36.284917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 02:12:36.284917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 02:12:36.284917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 02:12:36.284917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 02:12:36.284917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 02:12:36.284917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:36.284917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:36.284917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 232/458] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:12:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:36.285415 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9caf64c-1504-4a8b-b720-a08d93da982f None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:36.289952 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a98f9-9deb-4ea8-8bc2-424dd2098d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:36.290558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a98f9-9deb-4ea8-8bc2-424dd2098d9d None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:36.290854 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a98f9-9deb-4ea8-8bc2-424dd2098d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:36.291125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a98f9-9deb-4ea8-8bc2-424dd2098d9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:36.291853 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a98f9-9deb-4ea8-8bc2-424dd2098d9d None admin] RBAC: Adding query filter params (role.id=abb44cb94d7c46d3955fd92860aff94d, scope.project.id=91449401454c493cbf423888db8b8454, user.id=58a78f75a63e4d258a4afbeb748e59f6) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:36.292154 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a98f9-9deb-4ea8-8bc2-424dd2098d9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:36.293580 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a98f9-9deb-4ea8-8bc2-424dd2098d9d None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:36.306221 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 227/459] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 02:12:36 2022] GET /identity/v3/role_assignments?user.id=58a78f75a63e4d258a4afbeb748e59f6&scope.project.id=91449401454c493cbf423888db8b8454&role.id=abb44cb94d7c46d3955fd92860aff94d => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:36.306221 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a98f9-9deb-4ea8-8bc2-424dd2098d9d None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:36.406806 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:36.410781 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9caf64c-1504-4a8b-b720-a08d93da982f None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:36.448034 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a98f9-9deb-4ea8-8bc2-424dd2098d9d None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:36.449176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36561a53-b180-4ca1-ab21-f75dd1e5ce34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:36.449822 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36561a53-b180-4ca1-ab21-f75dd1e5ce34 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:36.450105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36561a53-b180-4ca1-ab21-f75dd1e5ce34 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:36.450369 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36561a53-b180-4ca1-ab21-f75dd1e5ce34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:36.462599 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36561a53-b180-4ca1-ab21-f75dd1e5ce34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:36.464242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36561a53-b180-4ca1-ab21-f75dd1e5ce34 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:36.481438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-36561a53-b180-4ca1-ab21-f75dd1e5ce34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:36.481438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:36.481438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:36.481438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:36.481438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:36.481438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:36.481438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:36.481438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:36.481438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:36.481438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:36.481438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:36.481438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:36.481438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:36.481438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:36.481438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:36.481438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:36.482326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:36.482326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:36.482326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:36.482326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:36.482326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:36.482326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:36.482326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:36.482326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:36.482326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:36.482326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:36.482326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:36.482326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:36.482326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:36.482326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:36.482326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:36.482326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:36.482326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:36.483843 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:36.483843 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:36.483843 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:36.483843 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 233/460] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:36.483843 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36561a53-b180-4ca1-ab21-f75dd1e5ce34 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:36.487952 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fb4a0-0b7f-423a-956d-bcd843dc2d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:36.488575 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fb4a0-0b7f-423a-956d-bcd843dc2d72 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:36.488855 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fb4a0-0b7f-423a-956d-bcd843dc2d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:36.489137 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fb4a0-0b7f-423a-956d-bcd843dc2d72 None admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:36.489863 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4fb4a0-0b7f-423a-956d-bcd843dc2d72 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:36.490172 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4fb4a0-0b7f-423a-956d-bcd843dc2d72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:36.491643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4fb4a0-0b7f-423a-956d-bcd843dc2d72 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:36.510639 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 228/461] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Oct 19 02:12:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:36.511488 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fb4a0-0b7f-423a-956d-bcd843dc2d72 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:36.521085 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:36.595734 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36561a53-b180-4ca1-ab21-f75dd1e5ce34 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:36.618053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fb4a0-0b7f-423a-956d-bcd843dc2d72 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:36.632583 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebfecc-718d-4e88-8ded-45fcb239f154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:36.633325 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebfecc-718d-4e88-8ded-45fcb239f154 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:36.633613 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebfecc-718d-4e88-8ded-45fcb239f154 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:36.633884 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebfecc-718d-4e88-8ded-45fcb239f154 None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:36.634524 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebfecc-718d-4e88-8ded-45fcb239f154 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:36.634848 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebfecc-718d-4e88-8ded-45fcb239f154 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:36.636226 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebfecc-718d-4e88-8ded-45fcb239f154 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:36.648702 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 234/462] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:36.649517 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebfecc-718d-4e88-8ded-45fcb239f154 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:36.657308 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c211e-f251-41db-8cf8-72d579615ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:36.658438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c211e-f251-41db-8cf8-72d579615ebb None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:36.658898 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c211e-f251-41db-8cf8-72d579615ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:36.659179 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c211e-f251-41db-8cf8-72d579615ebb None admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:36.659880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c211e-f251-41db-8cf8-72d579615ebb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:36.660183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c211e-f251-41db-8cf8-72d579615ebb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:36.661620 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c211e-f251-41db-8cf8-72d579615ebb None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:36.666654 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:36.679975 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 229/463] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 02:12:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:36.679975 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c211e-f251-41db-8cf8-72d579615ebb None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:36.745801 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:36.765110 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebfecc-718d-4e88-8ded-45fcb239f154 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:36.781243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c211e-f251-41db-8cf8-72d579615ebb None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:36.801220 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a77f0-27e7-4326-bab7-6cc4788ce27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:36.801822 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a77f0-27e7-4326-bab7-6cc4788ce27f None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:36.802094 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a77f0-27e7-4326-bab7-6cc4788ce27f None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:36.802362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a77f0-27e7-4326-bab7-6cc4788ce27f None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:36.803156 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a77f0-27e7-4326-bab7-6cc4788ce27f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:36.803711 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a77f0-27e7-4326-bab7-6cc4788ce27f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:36.804817 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a77f0-27e7-4326-bab7-6cc4788ce27f None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:36.818856 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 235/464] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:36.818856 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a77f0-27e7-4326-bab7-6cc4788ce27f None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:36.823327 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bab18-98e3-4f20-8903-9d84f2220b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:36.823949 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bab18-98e3-4f20-8903-9d84f2220b5f None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:36.824223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bab18-98e3-4f20-8903-9d84f2220b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:36.824489 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bab18-98e3-4f20-8903-9d84f2220b5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:36.893943 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:36.895173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26bab18-98e3-4f20-8903-9d84f2220b5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:36.896665 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26bab18-98e3-4f20-8903-9d84f2220b5f None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:36.929552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a77f0-27e7-4326-bab7-6cc4788ce27f None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:36.964804 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacaa4d-c963-45e4-8229-2b1e2ee065ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:36.965430 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacaa4d-c963-45e4-8229-2b1e2ee065ce None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:36.965711 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacaa4d-c963-45e4-8229-2b1e2ee065ce None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:36.965986 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacaa4d-c963-45e4-8229-2b1e2ee065ce None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:36.974350 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:36.974496 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacaa4d-c963-45e4-8229-2b1e2ee065ce None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:36.975819 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacaa4d-c963-45e4-8229-2b1e2ee065ce None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:36.987104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-eaacaa4d-c963-45e4-8229-2b1e2ee065ce None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 02:12:36.987104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:36.987104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:36.987104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:36.987104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:36.987104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:36.987104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:36.987104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:36.987104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:36.987104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:36.987104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:36.987104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:36.987104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 02:12:36.987104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 02:12:36.987104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 02:12:36.987104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 02:12:36.988019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:36.988019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:36.988019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:12:36.988019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:36.988019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:12:36.988019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:36.988019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:36.988019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:36.988019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:36.988019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:36.988019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:36.988019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:36.988019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:36.988019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:36.988019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:36.988019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:36.988019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:36.988019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:36.988908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:36.988908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:36.988908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 02:12:36.988908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 02:12:36.988908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 02:12:36.988908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 02:12:36.988908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 02:12:36.988908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 02:12:36.988908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 02:12:36.988908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:36.988908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 236/465] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:12:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:36.989454 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacaa4d-c963-45e4-8229-2b1e2ee065ce None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:37.025884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 230/466] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:12:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:37.025884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bab18-98e3-4f20-8903-9d84f2220b5f None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:37.107217 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacaa4d-c963-45e4-8229-2b1e2ee065ce None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:37.125325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bab18-98e3-4f20-8903-9d84f2220b5f None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:37.139087 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:37.144663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d15dbf-dee6-4102-990a-1bb8c2df16d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:37.145311 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d15dbf-dee6-4102-990a-1bb8c2df16d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:37.145656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d15dbf-dee6-4102-990a-1bb8c2df16d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:37.145857 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d15dbf-dee6-4102-990a-1bb8c2df16d5 None admin] PATH_INFO: `/v3/projects/91449401454c493cbf423888db8b8454/users/f906e9835f5c4e709915c6553b41aeff/roles/abb44cb94d7c46d3955fd92860aff94d` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:37.160748 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d02b0-569d-4183-bf2f-3d4305c56470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:37.161370 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d02b0-569d-4183-bf2f-3d4305c56470 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:37.161646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d02b0-569d-4183-bf2f-3d4305c56470 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:37.161833 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d15dbf-dee6-4102-990a-1bb8c2df16d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=91449401454c493cbf423888db8b8454, user_id=f906e9835f5c4e709915c6553b41aeff, role_id=abb44cb94d7c46d3955fd92860aff94d)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:37.161934 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d02b0-569d-4183-bf2f-3d4305c56470 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:37.163323 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d15dbf-dee6-4102-990a-1bb8c2df16d5 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:37.169431 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d02b0-569d-4183-bf2f-3d4305c56470 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:37.170888 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d02b0-569d-4183-bf2f-3d4305c56470 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:37.183759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-ef4d02b0-569d-4183-bf2f-3d4305c56470 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 19 02:12:37.183759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:37.183759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:37.183759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:37.183759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:37.183759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:37.183759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:37.183759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:37.183759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:37.183759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:37.183759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:37.183759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:37.183759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 02:12:37.183759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 02:12:37.183759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 02:12:37.183759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 02:12:37.185121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:37.185121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:37.185121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:12:37.185121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:37.185121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:12:37.185121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:37.185121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:37.185121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:37.185121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:37.185121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:37.185121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:37.185121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:37.185121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:37.185121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:37.185121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:37.185121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:37.185121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:37.185121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:37.186042 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:37.186042 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:37.186042 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 02:12:37.186042 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 02:12:37.186042 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 02:12:37.186042 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 02:12:37.186042 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 02:12:37.186042 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 02:12:37.186042 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 19 02:12:37.186042 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:37.186042 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 231/467] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 02:12:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:37.186628 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d02b0-569d-4183-bf2f-3d4305c56470 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:37.216046 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:37.259092 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 237/468] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 02:12:36 2022] PUT /identity/v3/projects/91449401454c493cbf423888db8b8454/users/f906e9835f5c4e709915c6553b41aeff/roles/abb44cb94d7c46d3955fd92860aff94d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:12:37.260232 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d15dbf-dee6-4102-990a-1bb8c2df16d5 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:37.311956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d02b0-569d-4183-bf2f-3d4305c56470 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:37.366270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46766f-e3f9-4460-88ad-7739faba9d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:37.367116 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46766f-e3f9-4460-88ad-7739faba9d8c None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:37.367514 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46766f-e3f9-4460-88ad-7739faba9d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:37.367821 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46766f-e3f9-4460-88ad-7739faba9d8c None admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:37.368761 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46766f-e3f9-4460-88ad-7739faba9d8c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:37.369331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46766f-e3f9-4460-88ad-7739faba9d8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:37.371678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46766f-e3f9-4460-88ad-7739faba9d8c None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:37.395571 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d15dbf-dee6-4102-990a-1bb8c2df16d5 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:37.407140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 232/469] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Oct 19 02:12:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:37.408593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46766f-e3f9-4460-88ad-7739faba9d8c None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:37.444402 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38d4b3-5f9a-4b57-89f5-1bc362b833cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:37.445411 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38d4b3-5f9a-4b57-89f5-1bc362b833cd None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:37.445790 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38d4b3-5f9a-4b57-89f5-1bc362b833cd None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:37.446184 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38d4b3-5f9a-4b57-89f5-1bc362b833cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:37.457992 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38d4b3-5f9a-4b57-89f5-1bc362b833cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:37.459500 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38d4b3-5f9a-4b57-89f5-1bc362b833cd None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:37.476648 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-8b38d4b3-5f9a-4b57-89f5-1bc362b833cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:37.476648 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:37.476648 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:37.476648 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:37.476648 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:37.476648 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:37.476648 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:37.476648 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:37.476648 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:37.476648 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:37.476648 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:37.476648 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:37.476648 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:37.476648 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:37.476648 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:37.476648 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:37.477566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:37.477566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:37.477566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:37.477566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:37.477566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:37.477566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:37.477566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:37.477566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:37.477566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:37.477566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:37.477566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:37.477566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:37.477566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:37.477566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:37.477566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:37.477566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:37.477566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:37.478384 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:37.478384 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:37.478384 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:37.479098 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 238/470] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:37.479580 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38d4b3-5f9a-4b57-89f5-1bc362b833cd None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:37.516022 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:37.521411 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:37.533661 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46766f-e3f9-4460-88ad-7739faba9d8c None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:37.570498 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9461c-548e-42a2-b2cc-c0022cfef3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:37.571039 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9461c-548e-42a2-b2cc-c0022cfef3cb None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:37.571318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9461c-548e-42a2-b2cc-c0022cfef3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:37.571586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9461c-548e-42a2-b2cc-c0022cfef3cb None admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:37.572372 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9461c-548e-42a2-b2cc-c0022cfef3cb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:37.572681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9461c-548e-42a2-b2cc-c0022cfef3cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:37.574423 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9461c-548e-42a2-b2cc-c0022cfef3cb None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:37.593154 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 233/471] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Oct 19 02:12:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:37.594053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38d4b3-5f9a-4b57-89f5-1bc362b833cd None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:37.599056 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9461c-548e-42a2-b2cc-c0022cfef3cb None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:37.632124 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d58b7-6257-4fcd-9552-65202c8273e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:37.633519 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d58b7-6257-4fcd-9552-65202c8273e3 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:37.634107 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d58b7-6257-4fcd-9552-65202c8273e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:37.634596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d58b7-6257-4fcd-9552-65202c8273e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:37.709809 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d58b7-6257-4fcd-9552-65202c8273e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:37.710718 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9461c-548e-42a2-b2cc-c0022cfef3cb None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:37.711864 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d58b7-6257-4fcd-9552-65202c8273e3 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:37.747503 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:37.749838 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6a0bb-f665-4307-895e-5bea5580dc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:37.750450 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6a0bb-f665-4307-895e-5bea5580dc80 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:37.750729 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6a0bb-f665-4307-895e-5bea5580dc80 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:37.751028 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6a0bb-f665-4307-895e-5bea5580dc80 None admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:37.751803 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6a0bb-f665-4307-895e-5bea5580dc80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:37.752159 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6a0bb-f665-4307-895e-5bea5580dc80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:37.753596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6a0bb-f665-4307-895e-5bea5580dc80 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:37.765569 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 234/472] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:37.766390 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6a0bb-f665-4307-895e-5bea5580dc80 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:37.770153 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:37.839672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 239/473] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:12:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:37.840692 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d58b7-6257-4fcd-9552-65202c8273e3 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:37.883153 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6a0bb-f665-4307-895e-5bea5580dc80 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:37.917707 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f355444-48d0-4a29-a9de-240932dcfc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:37.918342 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f355444-48d0-4a29-a9de-240932dcfc0a None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:37.918625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f355444-48d0-4a29-a9de-240932dcfc0a None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:37.918938 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f355444-48d0-4a29-a9de-240932dcfc0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:37.977291 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d58b7-6257-4fcd-9552-65202c8273e3 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:37.995192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f355444-48d0-4a29-a9de-240932dcfc0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:37.997097 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f355444-48d0-4a29-a9de-240932dcfc0a None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:38.003206 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:38.014734 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46c4ee-1dcd-488b-b7a8-3f5d825443db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:38.015412 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46c4ee-1dcd-488b-b7a8-3f5d825443db None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:38.019396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46c4ee-1dcd-488b-b7a8-3f5d825443db None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:38.019396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46c4ee-1dcd-488b-b7a8-3f5d825443db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:38.019396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:38.024819 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46c4ee-1dcd-488b-b7a8-3f5d825443db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:38.026451 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46c4ee-1dcd-488b-b7a8-3f5d825443db None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:38.038881 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-3a46c4ee-1dcd-488b-b7a8-3f5d825443db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:38.038881 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:38.038881 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:38.038881 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:38.038881 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:38.038881 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:38.038881 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:38.038881 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:38.038881 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:38.038881 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:38.038881 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:38.038881 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:38.038881 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 02:12:38.038881 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 02:12:38.038881 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 02:12:38.039847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 02:12:38.039847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:38.039847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:38.039847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:38.039847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:38.039847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:38.039847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:38.039847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:38.039847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:38.039847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:38.039847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:38.039847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:38.039847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:38.039847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:38.039847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:38.039847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:38.039847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:38.040668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 02:12:38.040668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 02:12:38.040668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 02:12:38.040668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 02:12:38.040668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 02:12:38.040668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 02:12:38.040668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:38.040668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:38.043140 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 240/474] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:12:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:38.044124 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46c4ee-1dcd-488b-b7a8-3f5d825443db None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:38.117990 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 235/475] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:12:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:38.123633 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f355444-48d0-4a29-a9de-240932dcfc0a None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:38.182247 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46c4ee-1dcd-488b-b7a8-3f5d825443db None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:38.229103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b58ee-51a4-4290-82a0-dc8a797091a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:38.230072 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b58ee-51a4-4290-82a0-dc8a797091a7 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:38.230559 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b58ee-51a4-4290-82a0-dc8a797091a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:38.231180 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b58ee-51a4-4290-82a0-dc8a797091a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:38.244030 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b58ee-51a4-4290-82a0-dc8a797091a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:38.245254 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f355444-48d0-4a29-a9de-240932dcfc0a None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:38.245992 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b58ee-51a4-4290-82a0-dc8a797091a7 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:38.262776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-709b58ee-51a4-4290-82a0-dc8a797091a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:38.262776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:38.262776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:38.262776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:38.262776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:38.262776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:38.262776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:38.262776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:38.262776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:38.262776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:38.262776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:38.262776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:38.262776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:38.262776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:38.262776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:38.262776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:38.263721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:38.263721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:38.263721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:38.263721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:38.263721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:38.263721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:38.263721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:38.263721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:38.263721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:38.263721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:38.263721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:38.263721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:38.263721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:38.263721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:38.263721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:38.263721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:38.263721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:38.264553 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:38.264553 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:38.264553 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:38.270994 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:38.271471 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 241/476] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:38.272569 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b58ee-51a4-4290-82a0-dc8a797091a7 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:38.291950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f2202-cdad-4014-b08e-4415d762ea68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:38.292905 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f2202-cdad-4014-b08e-4415d762ea68 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:38.293351 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f2202-cdad-4014-b08e-4415d762ea68 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:38.293815 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f2202-cdad-4014-b08e-4415d762ea68 None admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:38.294930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f2202-cdad-4014-b08e-4415d762ea68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:38.295428 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f2202-cdad-4014-b08e-4415d762ea68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:38.297337 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f2202-cdad-4014-b08e-4415d762ea68 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:38.311855 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 236/477] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 02:12:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:38.313204 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f2202-cdad-4014-b08e-4415d762ea68 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:38.328632 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:38.402915 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b58ee-51a4-4290-82a0-dc8a797091a7 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:38.427382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f2202-cdad-4014-b08e-4415d762ea68 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:38.453988 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bc1e2-4831-48e8-807b-f6bb3992262f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:38.456092 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bc1e2-4831-48e8-807b-f6bb3992262f None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:38.456608 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bc1e2-4831-48e8-807b-f6bb3992262f None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:38.457427 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bc1e2-4831-48e8-807b-f6bb3992262f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:38.469894 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d59157-4cbc-4ee5-a102-3a503d561dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:38.470671 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d59157-4cbc-4ee5-a102-3a503d561dfd None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:38.471113 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d59157-4cbc-4ee5-a102-3a503d561dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:38.471897 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d59157-4cbc-4ee5-a102-3a503d561dfd None admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:38.472322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d59157-4cbc-4ee5-a102-3a503d561dfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:38.472693 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d59157-4cbc-4ee5-a102-3a503d561dfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:38.474157 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d59157-4cbc-4ee5-a102-3a503d561dfd None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:38.474510 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160bc1e2-4831-48e8-807b-f6bb3992262f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:38.476466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160bc1e2-4831-48e8-807b-f6bb3992262f None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:38.492362 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 237/478] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:38.493337 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d59157-4cbc-4ee5-a102-3a503d561dfd None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:38.494811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-160bc1e2-4831-48e8-807b-f6bb3992262f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:38.494811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:38.494811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:38.494811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:38.494811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:38.494811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:38.494811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:38.494811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:38.494811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:38.494811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:38.494811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:38.494811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:38.494811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:38.494811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:38.494811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:38.494811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:38.495695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:38.495695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:38.495695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:38.495695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:38.495695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:38.495695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:38.495695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:38.495695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:38.495695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:38.495695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:38.495695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:38.495695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:38.495695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:38.495695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:38.495695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:38.495695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:38.495695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:38.496509 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:38.496509 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:38.496509 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:38.499511 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 242/479] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:38.500482 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bc1e2-4831-48e8-807b-f6bb3992262f None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:38.525672 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:38.615509 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d59157-4cbc-4ee5-a102-3a503d561dfd None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:38.616531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:38.621715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bc1e2-4831-48e8-807b-f6bb3992262f None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:38.649578 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e7100-2835-46b0-9582-92869020fe6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:38.650183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e7100-2835-46b0-9582-92869020fe6c None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:38.650465 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e7100-2835-46b0-9582-92869020fe6c None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:38.650734 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e7100-2835-46b0-9582-92869020fe6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:38.651484 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e7100-2835-46b0-9582-92869020fe6c None admin] RBAC: Adding query filter params (role.id=abb44cb94d7c46d3955fd92860aff94d, scope.project.id=91449401454c493cbf423888db8b8454, user.id=d9e8a7a5b8944272a2d1bd2140819ee9) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:38.651790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e7100-2835-46b0-9582-92869020fe6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:38.653274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e7100-2835-46b0-9582-92869020fe6c None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:38.659832 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 238/480] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 02:12:38 2022] GET /identity/v3/role_assignments?user.id=d9e8a7a5b8944272a2d1bd2140819ee9&scope.project.id=91449401454c493cbf423888db8b8454&role.id=abb44cb94d7c46d3955fd92860aff94d => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:38.660593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e7100-2835-46b0-9582-92869020fe6c None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:38.668101 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0bf2e-aa79-47e0-8ed1-7ed8495d0b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:38.669392 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0bf2e-aa79-47e0-8ed1-7ed8495d0b04 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:38.670225 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0bf2e-aa79-47e0-8ed1-7ed8495d0b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:38.671724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0bf2e-aa79-47e0-8ed1-7ed8495d0b04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:38.681591 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0bf2e-aa79-47e0-8ed1-7ed8495d0b04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:38.683739 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0bf2e-aa79-47e0-8ed1-7ed8495d0b04 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:38.699062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-e6f0bf2e-aa79-47e0-8ed1-7ed8495d0b04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:38.699062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:38.699062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:38.699062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:38.699062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:38.699062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:38.699062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:38.699062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:38.699062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:38.699062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:38.699062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:38.699062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:38.699062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 02:12:38.699062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 02:12:38.699062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 02:12:38.700151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 02:12:38.700151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:38.700151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:38.700151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:38.700151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:38.700151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:38.700151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:38.700151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:38.700151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:38.700151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:38.700151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:38.700151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:38.700151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:38.700151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:38.700151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:38.700151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:38.700151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:38.701192 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 02:12:38.701192 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 02:12:38.701192 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 02:12:38.701192 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 02:12:38.701192 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 02:12:38.701192 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 02:12:38.701192 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:38.701192 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:38.702961 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 243/481] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:12:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:38.704857 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9568d7d-880e-4613-9f43-4283598b0ee3 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:38.705213 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9568d7d-880e-4613-9f43-4283598b0ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:38.705612 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9568d7d-880e-4613-9f43-4283598b0ee3 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:38.710938 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 244/482] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:38.710938 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9568d7d-880e-4613-9f43-4283598b0ee3 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:38.780116 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:38.797805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e7100-2835-46b0-9582-92869020fe6c None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:38.843806 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9568d7d-880e-4613-9f43-4283598b0ee3 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:38.847522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241ce5a-1c3d-4fc2-8467-0d0e3362dcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:38.848150 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241ce5a-1c3d-4fc2-8467-0d0e3362dcc4 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:38.849332 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241ce5a-1c3d-4fc2-8467-0d0e3362dcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:38.849626 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241ce5a-1c3d-4fc2-8467-0d0e3362dcc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:38.850303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241ce5a-1c3d-4fc2-8467-0d0e3362dcc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:38.850613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241ce5a-1c3d-4fc2-8467-0d0e3362dcc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:38.852059 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241ce5a-1c3d-4fc2-8467-0d0e3362dcc4 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:38.869840 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 239/483] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:38.872223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89960f0-76b6-4859-9053-0b352ee2d08b None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:38.872582 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89960f0-76b6-4859-9053-0b352ee2d08b None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:38.872926 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89960f0-76b6-4859-9053-0b352ee2d08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:38.895715 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-c89960f0-76b6-4859-9053-0b352ee2d08b None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:38.896928 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c89960f0-76b6-4859-9053-0b352ee2d08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:38.897521 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5444f5-bca2-4664-b9b6-a86fe829ee61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:38.898120 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5444f5-bca2-4664-b9b6-a86fe829ee61 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:38.898402 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5444f5-bca2-4664-b9b6-a86fe829ee61 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:38.898676 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5444f5-bca2-4664-b9b6-a86fe829ee61 None admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:38.901015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5444f5-bca2-4664-b9b6-a86fe829ee61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:38.901015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5444f5-bca2-4664-b9b6-a86fe829ee61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:38.901184 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5444f5-bca2-4664-b9b6-a86fe829ee61 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:38.916296 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 245/484] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 02:12:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:38.917107 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5444f5-bca2-4664-b9b6-a86fe829ee61 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:38.946368 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:38.984174 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 240/485] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:38.986962 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89960f0-76b6-4859-9053-0b352ee2d08b None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:39.052776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5444f5-bca2-4664-b9b6-a86fe829ee61 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:39.082845 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:39.116356 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079b2ef-2e8c-477a-891a-34a82a47abe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:39.117361 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079b2ef-2e8c-477a-891a-34a82a47abe5 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:39.117836 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079b2ef-2e8c-477a-891a-34a82a47abe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:39.118321 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079b2ef-2e8c-477a-891a-34a82a47abe5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:39.118438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89960f0-76b6-4859-9053-0b352ee2d08b None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:39.134130 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079b2ef-2e8c-477a-891a-34a82a47abe5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:39.134130 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079b2ef-2e8c-477a-891a-34a82a47abe5 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:39.158536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-a079b2ef-2e8c-477a-891a-34a82a47abe5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:39.158536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:39.158536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:39.158536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:39.158536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:39.158536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:39.158536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:39.158536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:39.158536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:39.158536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:39.158536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:39.158536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:39.158536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 02:12:39.158536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 02:12:39.158536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 02:12:39.159452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 02:12:39.159452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:39.159452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:39.159452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:39.159452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:39.159452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:39.159452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:39.159452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:39.159452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:39.159452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:39.159452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:39.159452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:39.159452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:39.159452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:39.159452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:39.159452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:39.159452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:39.160269 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 02:12:39.160269 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 02:12:39.160269 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 02:12:39.160269 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 02:12:39.160269 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 02:12:39.160269 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 02:12:39.160269 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:39.160269 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:39.160269 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 246/486] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:12:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:39.166555 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079b2ef-2e8c-477a-891a-34a82a47abe5 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:39.184149 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161f4d2-065f-43d9-bf6e-836cd993d401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:39.185017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161f4d2-065f-43d9-bf6e-836cd993d401 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:39.185293 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161f4d2-065f-43d9-bf6e-836cd993d401 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:39.185559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161f4d2-065f-43d9-bf6e-836cd993d401 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:39.186288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161f4d2-065f-43d9-bf6e-836cd993d401 None admin] RBAC: Adding query filter params (role.id=abb44cb94d7c46d3955fd92860aff94d, scope.project.id=91449401454c493cbf423888db8b8454, user.id=0f1f37f8136349edac3a52793e2fef8e) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:39.186591 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161f4d2-065f-43d9-bf6e-836cd993d401 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:39.188064 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161f4d2-065f-43d9-bf6e-836cd993d401 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:39.206670 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 241/487] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 02:12:38 2022] GET /identity/v3/role_assignments?user.id=0f1f37f8136349edac3a52793e2fef8e&scope.project.id=91449401454c493cbf423888db8b8454&role.id=abb44cb94d7c46d3955fd92860aff94d => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:39.300408 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:39.332009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079b2ef-2e8c-477a-891a-34a82a47abe5 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:39.357791 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161f4d2-065f-43d9-bf6e-836cd993d401 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:39.405811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e6686-6638-47fe-a253-bac77a2e7838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:39.406425 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e6686-6638-47fe-a253-bac77a2e7838 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:39.406696 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e6686-6638-47fe-a253-bac77a2e7838 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:39.406989 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e6686-6638-47fe-a253-bac77a2e7838 None admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:39.408320 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e6686-6638-47fe-a253-bac77a2e7838 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:39.409105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e6686-6638-47fe-a253-bac77a2e7838 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:39.410566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e6686-6638-47fe-a253-bac77a2e7838 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:39.433559 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 247/488] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 02:12:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:39.440371 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e6686-6638-47fe-a253-bac77a2e7838 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:39.544092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161f4d2-065f-43d9-bf6e-836cd993d401 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:39.580243 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e6686-6638-47fe-a253-bac77a2e7838 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:39.590224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c895cb-d0ff-4690-8a1c-73e285f14217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:39.591089 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c895cb-d0ff-4690-8a1c-73e285f14217 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:39.598141 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c895cb-d0ff-4690-8a1c-73e285f14217 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:39.598141 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c895cb-d0ff-4690-8a1c-73e285f14217 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:39.602347 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:39.605145 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c895cb-d0ff-4690-8a1c-73e285f14217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:39.611586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-f1c895cb-d0ff-4690-8a1c-73e285f14217 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:12:39.611586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:39.611586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:39.611586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:39.611586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:39.611586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:39.611586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:39.611586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:39.611586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:39.611586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:39.611586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:39.611586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:39.611586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:39.611586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:39.611586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:39.611586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:39.612529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:39.612529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:39.612529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:39.612529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:39.612529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:39.612529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:39.612529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:39.612529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:39.612529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:39.612529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:39.612529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:39.612529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:39.612529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:39.612529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:39.612529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:39.612529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:39.613318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:39.613318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:39.613318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:39.613318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:39.613318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:39.613318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:39.613318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:39.613318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:39.613318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:39.613318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:39.613318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:12:39.613318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:39.613318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 242/489] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 02:12:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:12:39.613966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01353210-30ae-475c-8aaa-f62f97bb9351 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:39.614672 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01353210-30ae-475c-8aaa-f62f97bb9351 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:39.614672 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01353210-30ae-475c-8aaa-f62f97bb9351 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:39.615847 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 243/490] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:39.618368 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01353210-30ae-475c-8aaa-f62f97bb9351 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:39.636870 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d33461-4633-47e5-b044-8b4c5c814f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:39.637952 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d33461-4633-47e5-b044-8b4c5c814f3e None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:39.638560 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d33461-4633-47e5-b044-8b4c5c814f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:39.638981 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d33461-4633-47e5-b044-8b4c5c814f3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:39.639790 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d33461-4633-47e5-b044-8b4c5c814f3e None admin] RBAC: Adding query filter params (role.id=abb44cb94d7c46d3955fd92860aff94d, scope.project.id=91449401454c493cbf423888db8b8454, user.id=e7e4640bd879468d81ec0281827687ad) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:39.640167 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d33461-4633-47e5-b044-8b4c5c814f3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:39.642555 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d33461-4633-47e5-b044-8b4c5c814f3e None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:39.649749 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 248/491] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 02:12:39 2022] GET /identity/v3/role_assignments?user.id=e7e4640bd879468d81ec0281827687ad&scope.project.id=91449401454c493cbf423888db8b8454&role.id=abb44cb94d7c46d3955fd92860aff94d => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:39.651288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5e745-cd70-48a7-ac3f-750782d11051 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:39.651777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5e745-cd70-48a7-ac3f-750782d11051 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:39.652225 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5e745-cd70-48a7-ac3f-750782d11051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:39.671490 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-cbe5e745-cd70-48a7-ac3f-750782d11051 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:39.673491 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-cbe5e745-cd70-48a7-ac3f-750782d11051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:39.676011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:39.783666 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 249/492] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:39.791704 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01353210-30ae-475c-8aaa-f62f97bb9351 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:39.858290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dab3df-b3fc-4294-8608-6348279daacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:39.858949 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dab3df-b3fc-4294-8608-6348279daacc None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:39.859226 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dab3df-b3fc-4294-8608-6348279daacc None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:39.859493 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dab3df-b3fc-4294-8608-6348279daacc None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:39.860165 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dab3df-b3fc-4294-8608-6348279daacc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:39.860466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dab3df-b3fc-4294-8608-6348279daacc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:39.862503 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dab3df-b3fc-4294-8608-6348279daacc None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:39.872693 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 244/493] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:12:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:39.878234 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5e745-cd70-48a7-ac3f-750782d11051 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:40.016650 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5e745-cd70-48a7-ac3f-750782d11051 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:40.047765 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:40.058624 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180dfd4-bf26-4c7b-975b-905d77ebbe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:40.059294 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180dfd4-bf26-4c7b-975b-905d77ebbe8d None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:40.059671 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180dfd4-bf26-4c7b-975b-905d77ebbe8d None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:40.060203 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180dfd4-bf26-4c7b-975b-905d77ebbe8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:40.071263 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180dfd4-bf26-4c7b-975b-905d77ebbe8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:40.072713 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180dfd4-bf26-4c7b-975b-905d77ebbe8d None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:40.094514 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dab3df-b3fc-4294-8608-6348279daacc None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:40.095508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-c180dfd4-bf26-4c7b-975b-905d77ebbe8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:40.095508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:40.095508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:40.095508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:40.095508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:40.095508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:40.095508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:40.095508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:40.095508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:40.095508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:40.095508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:40.095508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:40.095508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:40.095508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:40.095508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:40.095508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:40.096524 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:40.096524 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:40.096524 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:40.096524 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:40.096524 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:40.096524 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:40.096524 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:40.096524 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:40.096524 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:40.096524 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:40.096524 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:40.096524 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:40.096524 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:40.096524 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:40.096524 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:40.096524 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:40.096524 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:40.097394 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:40.097394 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:40.097394 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:40.097394 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 250/494] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:40.103422 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180dfd4-bf26-4c7b-975b-905d77ebbe8d None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:40.172404 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:40.252093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dab3df-b3fc-4294-8608-6348279daacc None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:40.305512 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180dfd4-bf26-4c7b-975b-905d77ebbe8d None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:40.317584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663d7b2-aec2-4d12-85ba-e12789a86b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:40.318219 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663d7b2-aec2-4d12-85ba-e12789a86b38 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:40.318494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663d7b2-aec2-4d12-85ba-e12789a86b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:40.318760 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663d7b2-aec2-4d12-85ba-e12789a86b38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:40.338705 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663d7b2-aec2-4d12-85ba-e12789a86b38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:40.344053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-a663d7b2-aec2-4d12-85ba-e12789a86b38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:12:40.344053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:40.344053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:40.344053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:40.344053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:40.344053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:40.344053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:40.344053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:40.344053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:40.344053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:40.344053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:40.344053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:40.344053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:40.344053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:40.344053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:40.344053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:40.345720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:40.345720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:40.345720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:40.345720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:40.345720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:40.345720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:40.345720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:40.345720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:40.345720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:40.345720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:40.345720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:40.345720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:40.345720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:40.345720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:40.345720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:40.345720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:40.346544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:40.346544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:40.346544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:40.346544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:40.346544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:40.346544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:40.346544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:40.346544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:40.346544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:40.346544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:40.346544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:12:40.346544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:40.350915 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 245/495] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 02:12:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:40.352219 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663d7b2-aec2-4d12-85ba-e12789a86b38 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:40.381385 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337ae5f-73a8-4b15-8b94-092a7ba42226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:40.382627 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337ae5f-73a8-4b15-8b94-092a7ba42226 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:40.383155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337ae5f-73a8-4b15-8b94-092a7ba42226 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:40.383627 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337ae5f-73a8-4b15-8b94-092a7ba42226 None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:40.384472 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337ae5f-73a8-4b15-8b94-092a7ba42226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:40.384993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337ae5f-73a8-4b15-8b94-092a7ba42226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:40.386642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337ae5f-73a8-4b15-8b94-092a7ba42226 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:40.415768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 251/496] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:40.422362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337ae5f-73a8-4b15-8b94-092a7ba42226 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:40.472587 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663d7b2-aec2-4d12-85ba-e12789a86b38 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:40.519220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:40.522629 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:40.541593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc6c2f-ec44-45af-874c-0117d91f466d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:40.542245 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc6c2f-ec44-45af-874c-0117d91f466d None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:40.542623 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc6c2f-ec44-45af-874c-0117d91f466d None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:40.542917 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc6c2f-ec44-45af-874c-0117d91f466d None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:40.543583 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc6c2f-ec44-45af-874c-0117d91f466d None admin] RBAC: Adding query filter params (name=service) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:40.543881 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc6c2f-ec44-45af-874c-0117d91f466d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:40.545263 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc6c2f-ec44-45af-874c-0117d91f466d None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:40.571248 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 246/497] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 02:12:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:40.574294 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc6c2f-ec44-45af-874c-0117d91f466d None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:40.680800 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337ae5f-73a8-4b15-8b94-092a7ba42226 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:40.692101 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc6c2f-ec44-45af-874c-0117d91f466d None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:40.728413 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766cfb1-33ca-44f6-b722-04e71f66b64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:40.729042 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766cfb1-33ca-44f6-b722-04e71f66b64b None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:40.729316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766cfb1-33ca-44f6-b722-04e71f66b64b None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:40.729624 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766cfb1-33ca-44f6-b722-04e71f66b64b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:40.741732 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766cfb1-33ca-44f6-b722-04e71f66b64b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:40.743228 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766cfb1-33ca-44f6-b722-04e71f66b64b None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:40.759257 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-8766cfb1-33ca-44f6-b722-04e71f66b64b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:40.759257 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:40.759257 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:40.759257 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:40.759257 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:40.759257 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:40.759257 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:40.759257 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:40.759257 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:40.759257 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:40.759257 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:40.759257 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:40.759257 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:40.759257 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:40.759257 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:40.759257 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:40.760193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:40.760193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:40.760193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:40.760193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:40.760193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:40.760193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:40.760193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:40.760193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:40.760193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:40.760193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:40.760193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:40.760193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:40.760193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:40.760193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:40.760193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:40.760193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:40.760193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:40.761104 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:40.761104 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:40.761104 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:40.761104 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 247/498] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:40.767882 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766cfb1-33ca-44f6-b722-04e71f66b64b None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:40.802179 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac53b6-33cf-4152-b6b6-1514fb92abc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:40.802839 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac53b6-33cf-4152-b6b6-1514fb92abc2 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:40.803112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac53b6-33cf-4152-b6b6-1514fb92abc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:40.803380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac53b6-33cf-4152-b6b6-1514fb92abc2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:40.819136 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac53b6-33cf-4152-b6b6-1514fb92abc2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:40.819303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:40.820588 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac53b6-33cf-4152-b6b6-1514fb92abc2 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:40.848231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-ceac53b6-33cf-4152-b6b6-1514fb92abc2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 02:12:40.848231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:40.848231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:40.848231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:40.848231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:40.848231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:40.848231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:40.848231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:40.848231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:40.848231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:40.848231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:40.848231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:40.848231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 02:12:40.848231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 02:12:40.848231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 02:12:40.848231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 02:12:40.849275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:40.849275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:40.849275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:12:40.849275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:40.849275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:12:40.849275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:40.849275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:40.849275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:40.849275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:40.849275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:40.849275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:40.849275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:40.849275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:40.849275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:40.849275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:40.849275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:40.849275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:40.849275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:40.850176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:40.850176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:40.850176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 02:12:40.850176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 02:12:40.850176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 02:12:40.850176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 02:12:40.850176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 02:12:40.850176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 02:12:40.850176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 02:12:40.850176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:40.850176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 252/499] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 19 02:12:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:12:40.860416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac53b6-33cf-4152-b6b6-1514fb92abc2 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:40.959366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766cfb1-33ca-44f6-b722-04e71f66b64b None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:41.013831 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bb976-4504-46b3-8c43-8346a3f8cd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:41.015316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bb976-4504-46b3-8c43-8346a3f8cd92 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:41.015599 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bb976-4504-46b3-8c43-8346a3f8cd92 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:41.015872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bb976-4504-46b3-8c43-8346a3f8cd92 None admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:41.016512 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563bb976-4504-46b3-8c43-8346a3f8cd92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:41.016875 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563bb976-4504-46b3-8c43-8346a3f8cd92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:41.018574 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563bb976-4504-46b3-8c43-8346a3f8cd92 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:41.035293 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 248/500] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:41.038692 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bb976-4504-46b3-8c43-8346a3f8cd92 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:41.080126 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac53b6-33cf-4152-b6b6-1514fb92abc2 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:41.083142 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:41.176232 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bb976-4504-46b3-8c43-8346a3f8cd92 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:41.177278 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971b31d-4973-4c60-8f45-8006dd30f950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:41.177897 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971b31d-4973-4c60-8f45-8006dd30f950 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:41.178177 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971b31d-4973-4c60-8f45-8006dd30f950 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:41.178451 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971b31d-4973-4c60-8f45-8006dd30f950 None admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:41.179186 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:41.179332 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971b31d-4973-4c60-8f45-8006dd30f950 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:41.179512 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971b31d-4973-4c60-8f45-8006dd30f950 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:41.181110 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971b31d-4973-4c60-8f45-8006dd30f950 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:41.224366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93557d-416b-4631-86fc-cf05bf1a2864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:41.225365 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93557d-416b-4631-86fc-cf05bf1a2864 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:41.225837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93557d-416b-4631-86fc-cf05bf1a2864 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:41.226632 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93557d-416b-4631-86fc-cf05bf1a2864 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:41.228695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 253/501] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 19 02:12:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:41.233791 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d948f1-9058-43f2-b54a-13ad453cf7a2 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:41.234295 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d948f1-9058-43f2-b54a-13ad453cf7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:41.234581 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d948f1-9058-43f2-b54a-13ad453cf7a2 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:41.236290 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 254/502] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:41.237192 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d948f1-9058-43f2-b54a-13ad453cf7a2 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:41.240637 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f93557d-416b-4631-86fc-cf05bf1a2864 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:41.243280 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f93557d-416b-4631-86fc-cf05bf1a2864 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:41.259903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-9f93557d-416b-4631-86fc-cf05bf1a2864 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 19 02:12:41.259903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:41.259903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:41.259903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:41.259903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:41.259903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:41.259903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:41.259903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:41.259903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:41.259903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:41.259903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:41.259903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:41.259903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 02:12:41.259903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 02:12:41.259903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 02:12:41.259903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 02:12:41.260872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:41.260872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:41.260872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:12:41.260872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:41.260872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:12:41.260872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:41.260872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:41.260872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:41.260872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:41.260872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:41.260872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:41.260872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:41.260872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:41.260872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:41.260872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:41.260872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:41.260872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:41.260872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:41.261793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:41.261793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:41.261793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 02:12:41.261793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 02:12:41.261793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 02:12:41.261793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 02:12:41.261793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 02:12:41.261793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 02:12:41.261793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 19 02:12:41.261793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:41.268559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 249/503] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 02:12:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:41.268559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df905337-c552-4ad6-99e4-8f2694790585 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:41.268559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df905337-c552-4ad6-99e4-8f2694790585 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:41.268559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df905337-c552-4ad6-99e4-8f2694790585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:41.291213 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-df905337-c552-4ad6-99e4-8f2694790585 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:41.293089 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-df905337-c552-4ad6-99e4-8f2694790585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:41.358765 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d948f1-9058-43f2-b54a-13ad453cf7a2 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:41.370026 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 250/504] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:41.371001 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df905337-c552-4ad6-99e4-8f2694790585 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:41.407247 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4eddd2-34f2-447b-bfa7-704abf694859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:41.408000 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4eddd2-34f2-447b-bfa7-704abf694859 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:41.408834 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4eddd2-34f2-447b-bfa7-704abf694859 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:41.409115 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4eddd2-34f2-447b-bfa7-704abf694859 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:41.430157 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4eddd2-34f2-447b-bfa7-704abf694859 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:41.431570 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4eddd2-34f2-447b-bfa7-704abf694859 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:41.460695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-1b4eddd2-34f2-447b-bfa7-704abf694859 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:41.460695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:41.460695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:41.460695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:41.460695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:41.460695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:41.460695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:41.460695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:41.460695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:41.460695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:41.460695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:41.460695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:41.460695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:41.460695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:41.460695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:41.460695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:41.461738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:41.461738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:41.461738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:41.461738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:41.461738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:41.461738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:41.461738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:41.461738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:41.461738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:41.461738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:41.461738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:41.461738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:41.461738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:41.461738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:41.461738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:41.461738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:41.461738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:41.462603 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:41.462603 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:41.462603 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:41.465751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 255/505] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:41.468154 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4eddd2-34f2-447b-bfa7-704abf694859 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:41.504290 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:41.527212 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:41.553521 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df905337-c552-4ad6-99e4-8f2694790585 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:41.623368 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4eddd2-34f2-447b-bfa7-704abf694859 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:41.660037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2efc29-c62b-4d8b-8815-986de80363d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:41.661408 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2efc29-c62b-4d8b-8815-986de80363d6 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:41.662208 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2efc29-c62b-4d8b-8815-986de80363d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:41.663521 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ad6c2-65a7-4534-9dad-0a90dbd3220b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:41.664035 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2efc29-c62b-4d8b-8815-986de80363d6 None admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:41.664959 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2efc29-c62b-4d8b-8815-986de80363d6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:41.665758 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ad6c2-65a7-4534-9dad-0a90dbd3220b None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:41.666222 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ad6c2-65a7-4534-9dad-0a90dbd3220b None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:41.666716 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2efc29-c62b-4d8b-8815-986de80363d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:41.667204 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ad6c2-65a7-4534-9dad-0a90dbd3220b None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:41.668857 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2efc29-c62b-4d8b-8815-986de80363d6 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:41.669707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ad6c2-65a7-4534-9dad-0a90dbd3220b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:41.670209 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ad6c2-65a7-4534-9dad-0a90dbd3220b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:41.671766 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ad6c2-65a7-4534-9dad-0a90dbd3220b None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:41.693499 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 256/506] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:41.695246 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ad6c2-65a7-4534-9dad-0a90dbd3220b None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:41.701837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 251/507] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Oct 19 02:12:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:41.702728 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2efc29-c62b-4d8b-8815-986de80363d6 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:41.785539 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:41.813410 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2efc29-c62b-4d8b-8815-986de80363d6 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:41.814948 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ad6c2-65a7-4534-9dad-0a90dbd3220b None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:41.853227 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c516c-fdf9-48e9-b60f-bcede1595b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:41.854024 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014cff4-6d72-4d0a-80e0-cfaf65869333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:41.854387 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c516c-fdf9-48e9-b60f-bcede1595b34 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:41.854654 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014cff4-6d72-4d0a-80e0-cfaf65869333 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:41.854955 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014cff4-6d72-4d0a-80e0-cfaf65869333 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:41.855225 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014cff4-6d72-4d0a-80e0-cfaf65869333 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:41.855454 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c516c-fdf9-48e9-b60f-bcede1595b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:41.855896 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c516c-fdf9-48e9-b60f-bcede1595b34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:41.863897 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c516c-fdf9-48e9-b60f-bcede1595b34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:41.865678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c516c-fdf9-48e9-b60f-bcede1595b34 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:41.866073 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014cff4-6d72-4d0a-80e0-cfaf65869333 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:41.867523 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014cff4-6d72-4d0a-80e0-cfaf65869333 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:41.879365 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-f37c516c-fdf9-48e9-b60f-bcede1595b34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:41.879365 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:41.879365 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:41.879365 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:41.879365 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:41.879365 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:41.879365 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:41.879365 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:41.879365 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:41.879365 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:41.879365 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:41.879365 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:41.879365 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 02:12:41.879365 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 02:12:41.879365 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 02:12:41.880288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 02:12:41.880288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:41.880288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:41.880288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:41.880288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:41.880288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:41.880288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:41.880288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:41.880288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:41.880288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:41.880288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:41.880288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:41.880288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:41.880288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:41.880288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:41.880288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:41.880288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:41.881178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 02:12:41.881178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 02:12:41.881178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 02:12:41.881178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 02:12:41.881178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 02:12:41.881178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 02:12:41.881178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:41.881178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:41.883352 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 252/508] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:12:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:41.883590 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-8014cff4-6d72-4d0a-80e0-cfaf65869333 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:41.883590 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:41.883590 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:41.883590 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:41.883590 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:41.883590 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:41.883590 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:41.883590 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:41.883590 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:41.883590 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:41.883590 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:41.883590 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:41.883590 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:41.883590 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:41.883590 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:41.883590 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:41.884478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:41.884478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:41.884478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:41.884478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:41.884478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:41.884478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:41.884478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:41.884478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:41.884478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:41.884478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:41.884478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:41.884478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:41.884478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:41.884478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:41.884478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:41.884478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:41.884478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:41.885422 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:41.885422 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:41.885422 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:41.885422 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 257/509] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:41.886715 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c516c-fdf9-48e9-b60f-bcede1595b34 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:41.888623 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014cff4-6d72-4d0a-80e0-cfaf65869333 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:41.890720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:42.009006 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c516c-fdf9-48e9-b60f-bcede1595b34 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:42.017737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014cff4-6d72-4d0a-80e0-cfaf65869333 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:42.050801 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a374dfe-b2c1-4c72-97d5-cff9c3981290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:42.051446 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a374dfe-b2c1-4c72-97d5-cff9c3981290 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:42.051726 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a374dfe-b2c1-4c72-97d5-cff9c3981290 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:42.051838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:42.051998 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a374dfe-b2c1-4c72-97d5-cff9c3981290 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:42.060727 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7d797-18b8-43d2-aed7-b9cd015228e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:42.061394 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7d797-18b8-43d2-aed7-b9cd015228e3 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:42.061623 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7d797-18b8-43d2-aed7-b9cd015228e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:42.082341 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7d797-18b8-43d2-aed7-b9cd015228e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:42.082341 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7d797-18b8-43d2-aed7-b9cd015228e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:42.082341 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7d797-18b8-43d2-aed7-b9cd015228e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:42.082341 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7d797-18b8-43d2-aed7-b9cd015228e3 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:42.082341 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 258/510] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 02:12:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:42.082341 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7d797-18b8-43d2-aed7-b9cd015228e3 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:42.133487 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a374dfe-b2c1-4c72-97d5-cff9c3981290 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:42.135035 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a374dfe-b2c1-4c72-97d5-cff9c3981290 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:42.139226 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:42.196905 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7d797-18b8-43d2-aed7-b9cd015228e3 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:42.239226 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 253/511] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:12:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:42.243491 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acacf8f-d909-4f2e-830b-1d7ddd5759b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:42.244068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acacf8f-d909-4f2e-830b-1d7ddd5759b6 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:42.244232 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adb6b7-f1b3-4699-a224-6278fcff9f48 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:42.244342 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acacf8f-d909-4f2e-830b-1d7ddd5759b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:42.244524 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adb6b7-f1b3-4699-a224-6278fcff9f48 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:42.244616 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acacf8f-d909-4f2e-830b-1d7ddd5759b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:42.244800 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adb6b7-f1b3-4699-a224-6278fcff9f48 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:42.245215 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acacf8f-d909-4f2e-830b-1d7ddd5759b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:42.245513 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acacf8f-d909-4f2e-830b-1d7ddd5759b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:42.246066 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 254/512] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:42.246733 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adb6b7-f1b3-4699-a224-6278fcff9f48 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:42.246878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acacf8f-d909-4f2e-830b-1d7ddd5759b6 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:42.259646 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 259/513] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:42.260869 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b832dd9-af4c-4fe1-aa31-246818dc5a5d None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:42.261152 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b832dd9-af4c-4fe1-aa31-246818dc5a5d None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:42.261425 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b832dd9-af4c-4fe1-aa31-246818dc5a5d None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:42.262891 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 260/514] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:42.263588 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b832dd9-af4c-4fe1-aa31-246818dc5a5d None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:42.312384 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:42.351117 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adb6b7-f1b3-4699-a224-6278fcff9f48 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:42.353662 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:42.367411 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b832dd9-af4c-4fe1-aa31-246818dc5a5d None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:42.385160 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e323d-4625-4ef8-a5c5-c5667ffd0f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:42.385814 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e323d-4625-4ef8-a5c5-c5667ffd0f32 None admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:42.386313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e323d-4625-4ef8-a5c5-c5667ffd0f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:42.386731 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e323d-4625-4ef8-a5c5-c5667ffd0f32 None admin] PATH_INFO: `/v3/projects/91449401454c493cbf423888db8b8454/users/58a78f75a63e4d258a4afbeb748e59f6/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:42.388925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e323d-4625-4ef8-a5c5-c5667ffd0f32 None admin] RBAC: Authorizing `identity:create_grant(project_id=91449401454c493cbf423888db8b8454, user_id=58a78f75a63e4d258a4afbeb748e59f6, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:42.390366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e323d-4625-4ef8-a5c5-c5667ffd0f32 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:42.401134 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805aaa7-f770-433f-820f-3a8d1f838aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:42.401747 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805aaa7-f770-433f-820f-3a8d1f838aba None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:42.402022 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805aaa7-f770-433f-820f-3a8d1f838aba None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:42.402329 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805aaa7-f770-433f-820f-3a8d1f838aba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:42.413793 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805aaa7-f770-433f-820f-3a8d1f838aba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:42.415302 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805aaa7-f770-433f-820f-3a8d1f838aba None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:42.429826 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-3805aaa7-f770-433f-820f-3a8d1f838aba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:42.429826 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:42.429826 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:42.429826 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:42.429826 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:42.429826 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:42.429826 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:42.429826 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:42.429826 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:42.429826 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:42.429826 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:42.429826 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:42.429826 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:42.429826 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:42.429826 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:42.429826 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:42.431009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:42.431009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:42.431009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:42.431009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:42.431009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:42.431009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:42.431009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:42.431009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:42.431009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:42.431009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:42.431009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:42.431009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:42.431009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:42.431009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:42.431009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:42.431009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:42.431009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:42.431945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:42.431945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:42.431945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:42.431945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 261/515] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:42.432178 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0487369-a096-4532-80b9-ebb764d93904 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:42.432244 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0487369-a096-4532-80b9-ebb764d93904 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:42.432513 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0487369-a096-4532-80b9-ebb764d93904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:42.449242 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 255/516] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 02:12:42 2022] PUT /identity/v3/projects/91449401454c493cbf423888db8b8454/users/58a78f75a63e4d258a4afbeb748e59f6/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:12:42.450164 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e323d-4625-4ef8-a5c5-c5667ffd0f32 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:42.451499 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-d0487369-a096-4532-80b9-ebb764d93904 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:42.452697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-d0487369-a096-4532-80b9-ebb764d93904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:42.535969 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 262/517] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:42.537499 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ace59c-3aba-4204-9896-7a17ee39cb78 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:42.537787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ace59c-3aba-4204-9896-7a17ee39cb78 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:42.538061 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ace59c-3aba-4204-9896-7a17ee39cb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:42.558903 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-26ace59c-3aba-4204-9896-7a17ee39cb78 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:42.560533 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-26ace59c-3aba-4204-9896-7a17ee39cb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:42.589510 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:42.589949 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e323d-4625-4ef8-a5c5-c5667ffd0f32 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:42.646079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 263/518] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:42.646357 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec542c-6846-4367-b7bd-10d2e7aef331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:42.647187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ace59c-3aba-4204-9896-7a17ee39cb78 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:42.647292 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec542c-6846-4367-b7bd-10d2e7aef331 None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:42.647292 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec542c-6846-4367-b7bd-10d2e7aef331 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:42.647536 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec542c-6846-4367-b7bd-10d2e7aef331 None admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:42.648110 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec542c-6846-4367-b7bd-10d2e7aef331 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:42.649679 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec542c-6846-4367-b7bd-10d2e7aef331 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:42.738627 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 256/519] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 02:12:42 2022] POST /identity/v3/users => generated 254 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:12:42.777514 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ace59c-3aba-4204-9896-7a17ee39cb78 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:42.817923 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694409c-391c-469b-a2e9-66d957616e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:42.818903 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694409c-391c-469b-a2e9-66d957616e07 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:42.819392 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694409c-391c-469b-a2e9-66d957616e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:42.819869 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694409c-391c-469b-a2e9-66d957616e07 None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:42.820728 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694409c-391c-469b-a2e9-66d957616e07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:42.821275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694409c-391c-469b-a2e9-66d957616e07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:42.823001 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694409c-391c-469b-a2e9-66d957616e07 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:42.837293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 264/520] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:42.846894 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec542c-6846-4367-b7bd-10d2e7aef331 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:42.848664 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694409c-391c-469b-a2e9-66d957616e07 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:42.871554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:42.879428 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:42.977407 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec542c-6846-4367-b7bd-10d2e7aef331 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:42.995550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694409c-391c-469b-a2e9-66d957616e07 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:43.023711 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acebb5-57b7-4df3-ba0c-d5fb3097703e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:43.024351 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acebb5-57b7-4df3-ba0c-d5fb3097703e None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:43.024622 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acebb5-57b7-4df3-ba0c-d5fb3097703e None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:43.024891 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acebb5-57b7-4df3-ba0c-d5fb3097703e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:43.035221 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acebb5-57b7-4df3-ba0c-d5fb3097703e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:43.036670 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acebb5-57b7-4df3-ba0c-d5fb3097703e None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:43.037517 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe9435-0d8e-4ef9-85eb-66fdfe7bff2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:43.038169 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe9435-0d8e-4ef9-85eb-66fdfe7bff2a None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:43.038437 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe9435-0d8e-4ef9-85eb-66fdfe7bff2a None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:43.038709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe9435-0d8e-4ef9-85eb-66fdfe7bff2a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:43.039330 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe9435-0d8e-4ef9-85eb-66fdfe7bff2a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:43.040679 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe9435-0d8e-4ef9-85eb-66fdfe7bff2a None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:43.050872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-98acebb5-57b7-4df3-ba0c-d5fb3097703e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:43.050872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:43.050872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:43.050872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:43.050872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:43.050872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:43.050872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:43.050872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:43.050872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:43.050872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:43.050872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:43.050872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:43.050872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 02:12:43.050872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 02:12:43.050872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 02:12:43.051930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 02:12:43.051930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:43.051930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:43.051930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:43.051930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:43.051930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:43.051930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:43.051930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:43.051930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:43.051930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:43.051930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:43.051930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:43.051930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:43.051930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:43.051930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:43.051930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:43.051930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:43.053013 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 02:12:43.053013 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 02:12:43.053013 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 02:12:43.053013 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 02:12:43.053013 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 02:12:43.053013 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 02:12:43.053013 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:43.053013 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:43.053522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-acbe9435-0d8e-4ef9-85eb-66fdfe7bff2a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 02:12:43.053522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:43.053522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:12:43.053522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:12:43.053522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:12:43.053522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:12:43.053522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:12:43.053522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:12:43.053522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 02:12:43.053522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:43.053522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:12:43.053522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:43.053522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:43.053522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:43.053522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:43.053522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:43.053522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:43.059345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:43.059345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:43.059345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:43.059345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:43.059345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:43.059345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:43.059345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:12:43.059345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:12:43.059345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:12:43.059345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:12:43.059345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:43.059345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:43.059345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:43.059345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:43.059345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:43.059345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:43.061181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:43.061181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:43.061181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:43.061181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:43.061181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:43.061181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:43.061181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:43.061181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:43.061181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:43.061181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:43.061181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:12:43.061181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:12:43.061181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 02:12:43.061181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:43.061181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 265/521] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Oct 19 02:12:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:12:43.062801 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe9435-0d8e-4ef9-85eb-66fdfe7bff2a None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:43.062954 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 257/522] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:12:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:43.065678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acebb5-57b7-4df3-ba0c-d5fb3097703e None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:43.161108 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:43.180935 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acebb5-57b7-4df3-ba0c-d5fb3097703e None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:43.196554 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:43.200985 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe9435-0d8e-4ef9-85eb-66fdfe7bff2a None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:43.222258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df52fcd-a07c-4572-93c4-0caceb22b158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:43.223206 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df52fcd-a07c-4572-93c4-0caceb22b158 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:43.223759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df52fcd-a07c-4572-93c4-0caceb22b158 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:43.224398 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df52fcd-a07c-4572-93c4-0caceb22b158 None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:43.225309 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df52fcd-a07c-4572-93c4-0caceb22b158 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:43.226004 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df52fcd-a07c-4572-93c4-0caceb22b158 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:43.227620 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df52fcd-a07c-4572-93c4-0caceb22b158 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:43.237810 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 258/523] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Oct 19 02:12:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:43.239012 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df52fcd-a07c-4572-93c4-0caceb22b158 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:43.247210 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397cc0a-820f-43ab-aabb-8237a5697273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:43.247861 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397cc0a-820f-43ab-aabb-8237a5697273 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:43.248141 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397cc0a-820f-43ab-aabb-8237a5697273 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:43.248412 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397cc0a-820f-43ab-aabb-8237a5697273 None admin] PATH_INFO: `/v3/services/network` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:43.249009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397cc0a-820f-43ab-aabb-8237a5697273 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:43.250908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397cc0a-820f-43ab-aabb-8237a5697273 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:43.263305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-1397cc0a-820f-43ab-aabb-8237a5697273 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 02:12:43.263305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:43.263305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:12:43.263305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:12:43.263305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:12:43.263305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:12:43.263305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:12:43.263305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:12:43.263305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 02:12:43.263305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:43.263305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:12:43.263305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:43.263305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:43.263305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:43.263305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:43.263305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:43.263305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:43.264299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:43.264299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:43.264299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:43.264299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:43.264299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:43.264299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:43.264299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:12:43.264299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:12:43.264299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:12:43.264299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:12:43.264299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:43.264299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:43.264299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:43.264299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:43.264299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:43.264299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:43.265695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:43.265695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:43.265695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:43.265695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:43.265695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:43.265695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:43.265695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:43.265695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:43.265695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:43.265695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:43.265695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:12:43.265695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:12:43.265695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 02:12:43.265695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:43.265695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 266/524] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:12:43 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:43.266505 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397cc0a-820f-43ab-aabb-8237a5697273 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:43.357026 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df52fcd-a07c-4572-93c4-0caceb22b158 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:43.393835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b0725-5bf3-430c-b779-7504fb33229a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:43.394808 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b0725-5bf3-430c-b779-7504fb33229a None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:43.395410 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b0725-5bf3-430c-b779-7504fb33229a None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:43.396033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b0725-5bf3-430c-b779-7504fb33229a None admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:43.396918 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b0725-5bf3-430c-b779-7504fb33229a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:43.397418 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b0725-5bf3-430c-b779-7504fb33229a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:43.399143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b0725-5bf3-430c-b779-7504fb33229a None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:43.403794 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397cc0a-820f-43ab-aabb-8237a5697273 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:43.413767 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 259/525] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 02:12:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:43.414951 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b0725-5bf3-430c-b779-7504fb33229a None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:43.418773 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:43.458354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc25973-8f53-4b8b-bd03-5c0714de72d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:43.458990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc25973-8f53-4b8b-bd03-5c0714de72d8 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:43.459267 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc25973-8f53-4b8b-bd03-5c0714de72d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:43.459536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc25973-8f53-4b8b-bd03-5c0714de72d8 None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:43.460173 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc25973-8f53-4b8b-bd03-5c0714de72d8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:43.460472 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc25973-8f53-4b8b-bd03-5c0714de72d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:43.461852 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc25973-8f53-4b8b-bd03-5c0714de72d8 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:43.469394 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 267/526] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Oct 19 02:12:43 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:43.471390 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc25973-8f53-4b8b-bd03-5c0714de72d8 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:43.486735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:43.598782 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc25973-8f53-4b8b-bd03-5c0714de72d8 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:43.603994 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b0725-5bf3-430c-b779-7504fb33229a None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:43.641471 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4adda7-d0eb-40d5-a926-53502e56d1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:43.645035 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4adda7-d0eb-40d5-a926-53502e56d1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:43.645035 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4adda7-d0eb-40d5-a926-53502e56d1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:43.645035 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4adda7-d0eb-40d5-a926-53502e56d1e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:43.645035 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4adda7-d0eb-40d5-a926-53502e56d1e7 None admin] RBAC: Adding query filter params (role.id=abb44cb94d7c46d3955fd92860aff94d, scope.project.id=91449401454c493cbf423888db8b8454, user.id=f906e9835f5c4e709915c6553b41aeff) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:43.645035 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4adda7-d0eb-40d5-a926-53502e56d1e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:43.646459 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4adda7-d0eb-40d5-a926-53502e56d1e7 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:43.653995 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 268/527] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 02:12:43 2022] GET /identity/v3/role_assignments?user.id=f906e9835f5c4e709915c6553b41aeff&scope.project.id=91449401454c493cbf423888db8b8454&role.id=abb44cb94d7c46d3955fd92860aff94d => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:43.691779 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28de2a9-8e66-4184-ba07-83843c9a25c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:43.692751 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28de2a9-8e66-4184-ba07-83843c9a25c7 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:43.693227 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28de2a9-8e66-4184-ba07-83843c9a25c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:43.693691 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28de2a9-8e66-4184-ba07-83843c9a25c7 None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:43.694566 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28de2a9-8e66-4184-ba07-83843c9a25c7 None admin] RBAC: Adding query filter params (name=network) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:43.695098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28de2a9-8e66-4184-ba07-83843c9a25c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:43.696765 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28de2a9-8e66-4184-ba07-83843c9a25c7 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:43.708867 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 260/528] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 02:12:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:43.714717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4adda7-d0eb-40d5-a926-53502e56d1e7 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:43.840703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:43.884171 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4adda7-d0eb-40d5-a926-53502e56d1e7 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:43.929615 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d447f48-fe27-436e-a5c8-9b18de72e370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:43.930471 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d447f48-fe27-436e-a5c8-9b18de72e370 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:43.930912 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d447f48-fe27-436e-a5c8-9b18de72e370 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:43.931374 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d447f48-fe27-436e-a5c8-9b18de72e370 None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:43.932159 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d447f48-fe27-436e-a5c8-9b18de72e370 None admin] RBAC: Adding query filter params (type=network) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:43.932603 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d447f48-fe27-436e-a5c8-9b18de72e370 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:43.934097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d447f48-fe27-436e-a5c8-9b18de72e370 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:43.940595 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 269/529] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 02:12:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:44.998043 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69428d4c-e63b-44fe-8b48-2a08d75bd290 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:44.998567 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69428d4c-e63b-44fe-8b48-2a08d75bd290 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:44.998567 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69428d4c-e63b-44fe-8b48-2a08d75bd290 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:45.000157 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 261/530] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:45.006861 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3b4da-00b0-481a-9214-3dffadb93c56 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:45.007729 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3b4da-00b0-481a-9214-3dffadb93c56 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:45.008196 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3b4da-00b0-481a-9214-3dffadb93c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:45.031801 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-a8c3b4da-00b0-481a-9214-3dffadb93c56 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:45.033364 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-a8c3b4da-00b0-481a-9214-3dffadb93c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:45.117031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 270/531] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:45.477426 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69428d4c-e63b-44fe-8b48-2a08d75bd290 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:45.525604 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd56ad-3843-4346-9b30-91608f1780ef None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:45.525889 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd56ad-3843-4346-9b30-91608f1780ef None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:45.526162 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd56ad-3843-4346-9b30-91608f1780ef None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:45.527755 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 271/532] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:45.533264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322a127-2da6-46a2-a416-f1023fe28448 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:45.533539 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322a127-2da6-46a2-a416-f1023fe28448 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:45.533809 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322a127-2da6-46a2-a416-f1023fe28448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:45.557609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:45.567533 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-8322a127-2da6-46a2-a416-f1023fe28448 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:45.575529 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-8322a127-2da6-46a2-a416-f1023fe28448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:45.594309 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69428d4c-e63b-44fe-8b48-2a08d75bd290 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:45.632811 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be1c5c-57b8-4cf8-9fe4-d71c95d63215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:45.633447 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be1c5c-57b8-4cf8-9fe4-d71c95d63215 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:45.633723 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be1c5c-57b8-4cf8-9fe4-d71c95d63215 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:45.633994 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be1c5c-57b8-4cf8-9fe4-d71c95d63215 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:45.651954 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be1c5c-57b8-4cf8-9fe4-d71c95d63215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:45.658183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-f5be1c5c-57b8-4cf8-9fe4-d71c95d63215 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:12:45.658183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:45.658183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:45.658183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:45.658183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:45.658183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:45.658183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:45.658183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:45.658183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:45.658183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:45.658183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:45.658183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:45.658183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:45.658183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:45.658183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:45.658183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:45.659156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:45.659156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:45.659156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:45.659156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:45.659156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:45.659156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:45.659156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:45.659156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:45.659156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:45.659156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:45.659156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:45.659156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:45.659156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:45.659156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:45.659156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:45.659156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:45.659992 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:45.659992 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:45.659992 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:45.659992 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:45.659992 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:45.659992 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:45.659992 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:45.659992 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:45.659992 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:45.659992 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:45.659992 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:12:45.659992 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:45.665486 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 262/533] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 02:12:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:45.669724 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be1c5c-57b8-4cf8-9fe4-d71c95d63215 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:45.695717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:45.702930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 272/534] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:45.812429 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be1c5c-57b8-4cf8-9fe4-d71c95d63215 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:45.855813 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:45.864940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1c959-c52e-4807-baec-4c4d7de4f5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:45.872768 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1c959-c52e-4807-baec-4c4d7de4f5ae None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:45.872768 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1c959-c52e-4807-baec-4c4d7de4f5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:45.872768 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1c959-c52e-4807-baec-4c4d7de4f5ae None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:45.872988 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1c959-c52e-4807-baec-4c4d7de4f5ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:45.873167 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1c959-c52e-4807-baec-4c4d7de4f5ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:45.874551 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1c959-c52e-4807-baec-4c4d7de4f5ae None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:45.883671 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 263/535] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:12:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:45.889339 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322a127-2da6-46a2-a416-f1023fe28448 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:46.038179 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322a127-2da6-46a2-a416-f1023fe28448 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:46.089921 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181954a-a58b-4025-85bc-21e45e486c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:46.090796 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181954a-a58b-4025-85bc-21e45e486c3d None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:46.091236 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181954a-a58b-4025-85bc-21e45e486c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:46.091648 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181954a-a58b-4025-85bc-21e45e486c3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:46.107577 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181954a-a58b-4025-85bc-21e45e486c3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:46.109226 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181954a-a58b-4025-85bc-21e45e486c3d None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:46.131264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-8181954a-a58b-4025-85bc-21e45e486c3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:46.131264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:46.131264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:46.131264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:46.131264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:46.131264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:46.131264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:46.131264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:46.131264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:46.131264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:46.131264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:46.131264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:46.131264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:46.131264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:46.131264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:46.131264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:46.132450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:46.132450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:46.132450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:46.132450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:46.132450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:46.132450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:46.132450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:46.132450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:46.132450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:46.132450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:46.132450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:46.132450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:46.132450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:46.132450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:46.132450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:46.132450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:46.132450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:46.133537 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:46.133537 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:46.133537 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:46.135360 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 273/536] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:46.140621 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1c959-c52e-4807-baec-4c4d7de4f5ae None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:46.142154 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181954a-a58b-4025-85bc-21e45e486c3d None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:46.221835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:46.295463 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1c959-c52e-4807-baec-4c4d7de4f5ae None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:46.335669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95073923-f43c-4bbe-b92e-ce0cf9a1b406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:46.336290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95073923-f43c-4bbe-b92e-ce0cf9a1b406 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:46.336572 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95073923-f43c-4bbe-b92e-ce0cf9a1b406 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:46.336847 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95073923-f43c-4bbe-b92e-ce0cf9a1b406 None admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:46.337495 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95073923-f43c-4bbe-b92e-ce0cf9a1b406 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:46.337800 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95073923-f43c-4bbe-b92e-ce0cf9a1b406 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:46.339370 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95073923-f43c-4bbe-b92e-ce0cf9a1b406 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:46.355449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 264/537] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:46.357446 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9dfa1a-0ace-4b82-8cec-3b7ae2ed6021 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:46.357956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9dfa1a-0ace-4b82-8cec-3b7ae2ed6021 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:46.358400 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9dfa1a-0ace-4b82-8cec-3b7ae2ed6021 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:46.363685 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181954a-a58b-4025-85bc-21e45e486c3d None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:46.367346 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 265/538] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:46.367346 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe3d0d-19db-492c-a8ed-66adf84e96a6 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:46.367346 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe3d0d-19db-492c-a8ed-66adf84e96a6 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:46.367346 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe3d0d-19db-492c-a8ed-66adf84e96a6 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:46.368032 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 266/539] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:46.368268 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe3d0d-19db-492c-a8ed-66adf84e96a6 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:46.406517 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee00712-910e-4987-8a3e-cabf214b33a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:46.407238 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee00712-910e-4987-8a3e-cabf214b33a0 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:46.407520 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee00712-910e-4987-8a3e-cabf214b33a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:46.407893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee00712-910e-4987-8a3e-cabf214b33a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:46.421793 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee00712-910e-4987-8a3e-cabf214b33a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:46.427656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-8ee00712-910e-4987-8a3e-cabf214b33a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:12:46.427656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:46.427656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:46.427656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:46.427656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:46.427656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:46.427656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:46.427656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:46.427656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:46.427656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:46.427656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:46.427656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:46.427656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:46.427656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:46.427656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:46.427656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:46.428645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:46.428645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:46.428645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:46.428645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:46.428645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:46.428645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:46.428645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:46.428645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:46.428645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:46.428645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:46.428645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:46.428645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:46.428645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:46.428645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:46.428645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:46.428645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:46.430075 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:46.430075 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:46.430075 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:46.430075 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:46.430075 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:46.430075 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:46.430075 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:46.430075 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:46.430075 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:46.430075 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:46.430075 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:12:46.430075 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:46.430755 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:46.430878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 274/540] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 02:12:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:12:46.430878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0bc34-3c9b-465c-be14-0b73563418b1 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:46.430878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0bc34-3c9b-465c-be14-0b73563418b1 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:46.431088 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0bc34-3c9b-465c-be14-0b73563418b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:46.451214 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-bec0bc34-3c9b-465c-be14-0b73563418b1 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:46.452415 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-bec0bc34-3c9b-465c-be14-0b73563418b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:46.486906 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe3d0d-19db-492c-a8ed-66adf84e96a6 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:46.522691 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c337e-da46-4d26-83dd-56c009e14ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:46.523370 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c337e-da46-4d26-83dd-56c009e14ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:46.523654 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c337e-da46-4d26-83dd-56c009e14ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:46.523931 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c337e-da46-4d26-83dd-56c009e14ed5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:46.529172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 275/541] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:46.530679 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da13d26-6d9a-4765-b6f4-5687c282c1cb None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:46.531038 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da13d26-6d9a-4765-b6f4-5687c282c1cb None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:46.531311 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da13d26-6d9a-4765-b6f4-5687c282c1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:46.540695 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c337e-da46-4d26-83dd-56c009e14ed5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:46.542963 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c337e-da46-4d26-83dd-56c009e14ed5 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:46.555561 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-5da13d26-6d9a-4765-b6f4-5687c282c1cb None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:46.556994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-5da13d26-6d9a-4765-b6f4-5687c282c1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:46.559461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-724c337e-da46-4d26-83dd-56c009e14ed5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 02:12:46.559461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:46.559461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:46.559461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:46.559461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:46.559461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:46.559461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:46.559461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:46.559461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:46.559461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:46.559461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:46.559461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:46.559461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 02:12:46.559461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 02:12:46.559461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 02:12:46.559461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 02:12:46.560676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:46.560676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:46.560676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:12:46.560676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:46.560676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:12:46.560676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:46.560676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:46.560676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:46.560676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:46.560676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:46.560676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:46.560676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:46.560676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:46.560676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:46.560676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:46.560676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:46.560676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:46.560676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:46.561598 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:46.561598 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:46.561598 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 02:12:46.561598 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 02:12:46.561598 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 02:12:46.561598 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 02:12:46.561598 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 02:12:46.561598 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 02:12:46.561598 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 02:12:46.561598 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:46.565922 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 267/542] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 19 02:12:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:46.566856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c337e-da46-4d26-83dd-56c009e14ed5 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:46.611512 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:46.643912 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 276/543] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:46.645097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da13d26-6d9a-4765-b6f4-5687c282c1cb None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:46.716307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c337e-da46-4d26-83dd-56c009e14ed5 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:46.752674 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f6952-8100-48c3-a96d-d38b26c3c086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:46.753246 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f6952-8100-48c3-a96d-d38b26c3c086 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:46.753525 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f6952-8100-48c3-a96d-d38b26c3c086 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:46.753795 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f6952-8100-48c3-a96d-d38b26c3c086 None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:46.754567 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f6952-8100-48c3-a96d-d38b26c3c086 None admin] RBAC: Adding query filter params (name=service) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:46.755038 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f6952-8100-48c3-a96d-d38b26c3c086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:46.757072 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f6952-8100-48c3-a96d-d38b26c3c086 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:46.760047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:46.763468 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da13d26-6d9a-4765-b6f4-5687c282c1cb None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:46.774526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 268/544] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 02:12:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:46.774526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ae5d7-2da6-4d8d-a655-668b3f465dc9 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:46.774526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ae5d7-2da6-4d8d-a655-668b3f465dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:46.774526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ae5d7-2da6-4d8d-a655-668b3f465dc9 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:46.774526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 269/545] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:46.775713 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ae5d7-2da6-4d8d-a655-668b3f465dc9 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:46.815276 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6023564-5508-4580-b770-84f93080f5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:46.815945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6023564-5508-4580-b770-84f93080f5d8 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:46.816235 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6023564-5508-4580-b770-84f93080f5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:46.816568 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6023564-5508-4580-b770-84f93080f5d8 None admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:46.817346 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6023564-5508-4580-b770-84f93080f5d8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:46.817659 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6023564-5508-4580-b770-84f93080f5d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:46.819700 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6023564-5508-4580-b770-84f93080f5d8 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:46.838114 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 277/546] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 19 02:12:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:46.839572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd28e8-b9ae-47d6-963f-2672ccbcd3f3 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:46.839861 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd28e8-b9ae-47d6-963f-2672ccbcd3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:46.840137 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd28e8-b9ae-47d6-963f-2672ccbcd3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:46.859115 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-35bd28e8-b9ae-47d6-963f-2672ccbcd3f3 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:46.860847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-35bd28e8-b9ae-47d6-963f-2672ccbcd3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:46.885271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:46.894714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ae5d7-2da6-4d8d-a655-668b3f465dc9 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:46.930945 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b9d83-fe56-43cd-985e-6eee030b9661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:46.931913 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b9d83-fe56-43cd-985e-6eee030b9661 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:46.932025 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 278/547] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:46.932106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b9d83-fe56-43cd-985e-6eee030b9661 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:46.932288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b9d83-fe56-43cd-985e-6eee030b9661 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:46.932560 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd28e8-b9ae-47d6-963f-2672ccbcd3f3 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:46.944087 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b9d83-fe56-43cd-985e-6eee030b9661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:46.945601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b9d83-fe56-43cd-985e-6eee030b9661 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:46.961015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-fb2b9d83-fe56-43cd-985e-6eee030b9661 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:46.961015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:46.961015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:46.961015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:46.961015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:46.961015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:46.961015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:46.961015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:46.961015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:46.961015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:46.961015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:46.961015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:46.961015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:46.961015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:46.961015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:46.961015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:46.962214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:46.962214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:46.962214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:46.962214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:46.962214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:46.962214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:46.962214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:46.962214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:46.962214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:46.962214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:46.962214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:46.962214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:46.962214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:46.962214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:46.962214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:46.962214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:46.962214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:46.963345 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:46.963345 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:46.963345 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:46.963345 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 270/548] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:46.963345 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b9d83-fe56-43cd-985e-6eee030b9661 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:46.989980 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:47.057510 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd28e8-b9ae-47d6-963f-2672ccbcd3f3 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:47.072177 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b9d83-fe56-43cd-985e-6eee030b9661 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:47.094632 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839fe1c-2567-4d61-b860-3a7dd744be9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:47.095276 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839fe1c-2567-4d61-b860-3a7dd744be9e None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:47.095976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839fe1c-2567-4d61-b860-3a7dd744be9e None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:47.096262 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839fe1c-2567-4d61-b860-3a7dd744be9e None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:47.096916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839fe1c-2567-4d61-b860-3a7dd744be9e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:47.098303 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839fe1c-2567-4d61-b860-3a7dd744be9e None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:47.111094 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21142c83-2965-4c15-a48c-ced9c1cf069b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:47.116142 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21142c83-2965-4c15-a48c-ced9c1cf069b None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:47.116142 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21142c83-2965-4c15-a48c-ced9c1cf069b None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:47.116142 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21142c83-2965-4c15-a48c-ced9c1cf069b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:47.182058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21142c83-2965-4c15-a48c-ced9c1cf069b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:47.183505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21142c83-2965-4c15-a48c-ced9c1cf069b None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:47.198543 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 279/549] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 02:12:46 2022] POST /identity/v3/services => generated 251 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:12:47.201752 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839fe1c-2567-4d61-b860-3a7dd744be9e None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:47.214620 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:47.233123 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:47.303724 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 271/550] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:12:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:47.304844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21142c83-2965-4c15-a48c-ced9c1cf069b None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:47.344838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839fe1c-2567-4d61-b860-3a7dd744be9e None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:47.384100 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb974b23-3d4e-4132-8b7c-fefd6507b67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:47.384736 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb974b23-3d4e-4132-8b7c-fefd6507b67b None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:47.385012 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb974b23-3d4e-4132-8b7c-fefd6507b67b None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:47.385282 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb974b23-3d4e-4132-8b7c-fefd6507b67b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:47.398430 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb974b23-3d4e-4132-8b7c-fefd6507b67b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:47.403966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-cb974b23-3d4e-4132-8b7c-fefd6507b67b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:12:47.403966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:47.403966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:47.403966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:47.403966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:47.403966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:47.403966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:47.403966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:47.403966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:47.403966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:47.403966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:47.403966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:47.403966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:47.403966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:47.403966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:47.403966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:47.405105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:47.405105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:47.405105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:47.405105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:47.405105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:47.405105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:47.405105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:47.405105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:47.405105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:47.405105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:47.405105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:47.405105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:47.405105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:47.405105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:47.405105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:47.405105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:47.405924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:47.405924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:47.405924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:47.405924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:47.405924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:47.405924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:47.405924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:47.405924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:47.405924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:47.405924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:47.405924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:12:47.405924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:47.406566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 280/551] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 02:12:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:47.407128 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb974b23-3d4e-4132-8b7c-fefd6507b67b None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:47.484163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21142c83-2965-4c15-a48c-ced9c1cf069b None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:47.489272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:47.509315 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:47.516978 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb974b23-3d4e-4132-8b7c-fefd6507b67b None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:47.520041 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85065c7-f970-4143-b1d9-b382f2940de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:47.520648 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85065c7-f970-4143-b1d9-b382f2940de0 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:47.520928 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85065c7-f970-4143-b1d9-b382f2940de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:47.521198 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85065c7-f970-4143-b1d9-b382f2940de0 None admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:47.521836 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85065c7-f970-4143-b1d9-b382f2940de0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:47.522139 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85065c7-f970-4143-b1d9-b382f2940de0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:47.523551 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85065c7-f970-4143-b1d9-b382f2940de0 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:47.535431 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 272/552] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:47.536247 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85065c7-f970-4143-b1d9-b382f2940de0 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:47.565104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71a298-3f1f-4dc1-8c03-25b78af28aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:47.566051 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71a298-3f1f-4dc1-8c03-25b78af28aaf None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:47.566528 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71a298-3f1f-4dc1-8c03-25b78af28aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:47.566802 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71a298-3f1f-4dc1-8c03-25b78af28aaf None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:47.567481 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71a298-3f1f-4dc1-8c03-25b78af28aaf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:47.568933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71a298-3f1f-4dc1-8c03-25b78af28aaf None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:47.638132 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85065c7-f970-4143-b1d9-b382f2940de0 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:47.655001 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 281/553] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 02:12:47 2022] POST /identity/v3/services => generated 240 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:12:47.655001 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71a298-3f1f-4dc1-8c03-25b78af28aaf None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:47.691030 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f94b0-076d-41c0-86e5-ace512a54817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:47.692231 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f94b0-076d-41c0-86e5-ace512a54817 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:47.692509 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f94b0-076d-41c0-86e5-ace512a54817 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:47.692775 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f94b0-076d-41c0-86e5-ace512a54817 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:47.706245 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f94b0-076d-41c0-86e5-ace512a54817 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:47.707869 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f94b0-076d-41c0-86e5-ace512a54817 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:47.725112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-6a7f94b0-076d-41c0-86e5-ace512a54817 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:47.725112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:47.725112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:47.725112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:47.725112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:47.725112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:47.725112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:47.725112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:47.725112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:47.725112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:47.725112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:47.725112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:47.725112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:47.725112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:47.725112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:47.725112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:47.726138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:47.726138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:47.726138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:47.726138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:47.726138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:47.726138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:47.726138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:47.726138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:47.726138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:47.726138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:47.726138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:47.726138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:47.726138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:47.726138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:47.726138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:47.726138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:47.726138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:47.727455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:47.727455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:47.727455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:47.727455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 273/554] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:47.727455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f94b0-076d-41c0-86e5-ace512a54817 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:47.762371 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:47.806352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71a298-3f1f-4dc1-8c03-25b78af28aaf None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:47.848376 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f8639-64f1-4f98-a224-fc1cdcc130de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:47.848990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f8639-64f1-4f98-a224-fc1cdcc130de None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:47.849261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f8639-64f1-4f98-a224-fc1cdcc130de None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:47.849526 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f8639-64f1-4f98-a224-fc1cdcc130de None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:47.850192 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f8639-64f1-4f98-a224-fc1cdcc130de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:47.850489 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f8639-64f1-4f98-a224-fc1cdcc130de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:47.852204 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f8639-64f1-4f98-a224-fc1cdcc130de None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:47.853448 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:47.857944 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f94b0-076d-41c0-86e5-ace512a54817 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:47.864189 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 282/555] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:12:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:47.867670 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f8639-64f1-4f98-a224-fc1cdcc130de None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:47.907282 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7b376-fccd-41d6-9753-80b24a43cbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:47.908032 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7b376-fccd-41d6-9753-80b24a43cbfc None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:47.908394 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7b376-fccd-41d6-9753-80b24a43cbfc None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:47.908705 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7b376-fccd-41d6-9753-80b24a43cbfc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:47.918195 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7b376-fccd-41d6-9753-80b24a43cbfc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:47.920184 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7b376-fccd-41d6-9753-80b24a43cbfc None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:47.936656 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-3bf7b376-fccd-41d6-9753-80b24a43cbfc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 02:12:47.936656 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:47.936656 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:47.936656 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:47.936656 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:47.936656 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:47.936656 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:47.936656 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:47.936656 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:47.936656 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:47.936656 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:47.936656 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:47.936656 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 02:12:47.936656 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 02:12:47.936656 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 02:12:47.936656 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 02:12:47.937826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:47.937826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:47.937826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:12:47.937826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:47.937826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:12:47.937826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:47.937826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:47.937826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:47.937826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:47.937826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:47.937826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:47.937826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:47.937826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:47.937826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:47.937826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:47.937826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:47.937826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:47.937826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:47.940227 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:47.940227 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:47.940227 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 02:12:47.940227 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 02:12:47.940227 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 02:12:47.940227 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 02:12:47.940227 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 02:12:47.940227 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 02:12:47.940227 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 02:12:47.940227 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:47.942909 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 274/556] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 19 02:12:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:47.943856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7b376-fccd-41d6-9753-80b24a43cbfc None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:47.985620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f8639-64f1-4f98-a224-fc1cdcc130de None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:48.022341 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b052d9-7e15-4bbf-9329-8f9985eab479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:48.023063 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b052d9-7e15-4bbf-9329-8f9985eab479 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:48.023437 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b052d9-7e15-4bbf-9329-8f9985eab479 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:48.023800 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b052d9-7e15-4bbf-9329-8f9985eab479 None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:48.024550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b052d9-7e15-4bbf-9329-8f9985eab479 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:48.024947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b052d9-7e15-4bbf-9329-8f9985eab479 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:48.026395 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b052d9-7e15-4bbf-9329-8f9985eab479 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:48.042624 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 283/557] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:48.043678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b052d9-7e15-4bbf-9329-8f9985eab479 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:48.046426 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:48.056606 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7b376-fccd-41d6-9753-80b24a43cbfc None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:48.104429 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:48.106246 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828443e-5493-474d-957f-bec9cc1d7042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:48.107141 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828443e-5493-474d-957f-bec9cc1d7042 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:48.107587 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828443e-5493-474d-957f-bec9cc1d7042 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:48.108014 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828443e-5493-474d-957f-bec9cc1d7042 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:48.119595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828443e-5493-474d-957f-bec9cc1d7042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:48.121279 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828443e-5493-474d-957f-bec9cc1d7042 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:48.138846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-3828443e-5493-474d-957f-bec9cc1d7042 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:48.138846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:48.138846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:48.138846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:48.138846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:48.138846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:48.138846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:48.138846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:48.138846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:48.138846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:48.138846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:48.138846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:48.138846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:48.138846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:48.138846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:48.138846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:48.140017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:48.140017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:48.140017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:48.140017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:48.140017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:48.140017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:48.140017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:48.140017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:48.140017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:48.140017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:48.140017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:48.140017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:48.140017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:48.140017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:48.140017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:48.140017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:48.140017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:48.141118 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:48.141118 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:48.141118 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:48.143779 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 275/558] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:48.144745 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828443e-5493-474d-957f-bec9cc1d7042 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:48.153579 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b052d9-7e15-4bbf-9329-8f9985eab479 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:48.190651 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56779d8-dca8-4862-af50-28b13a441341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:48.191462 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56779d8-dca8-4862-af50-28b13a441341 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:48.191830 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56779d8-dca8-4862-af50-28b13a441341 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:48.192200 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56779d8-dca8-4862-af50-28b13a441341 None admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:48.193030 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56779d8-dca8-4862-af50-28b13a441341 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:48.193432 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56779d8-dca8-4862-af50-28b13a441341 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:48.194982 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56779d8-dca8-4862-af50-28b13a441341 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:48.217852 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 284/559] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Oct 19 02:12:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:48.218853 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56779d8-dca8-4862-af50-28b13a441341 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:48.263861 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828443e-5493-474d-957f-bec9cc1d7042 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:48.304127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70fd65-dfee-4c08-811e-848a8f18ad8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:48.305110 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70fd65-dfee-4c08-811e-848a8f18ad8e None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:48.305666 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70fd65-dfee-4c08-811e-848a8f18ad8e None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:48.306122 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70fd65-dfee-4c08-811e-848a8f18ad8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:48.314557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70fd65-dfee-4c08-811e-848a8f18ad8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:48.316319 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70fd65-dfee-4c08-811e-848a8f18ad8e None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:48.324178 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56779d8-dca8-4862-af50-28b13a441341 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:48.329830 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-2b70fd65-dfee-4c08-811e-848a8f18ad8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:48.329830 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:48.329830 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:48.329830 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:48.329830 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:48.329830 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:48.329830 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:48.329830 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:48.329830 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:48.329830 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:48.329830 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:48.329830 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:48.329830 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 02:12:48.329830 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 02:12:48.329830 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 02:12:48.330895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 02:12:48.330895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:48.330895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:48.330895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:48.330895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:48.330895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:48.330895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:48.330895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:48.330895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:48.330895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:48.330895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:48.330895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:48.330895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:48.330895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:48.330895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:48.330895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:48.330895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:48.331993 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 02:12:48.331993 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 02:12:48.331993 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 02:12:48.331993 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 02:12:48.331993 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 02:12:48.331993 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 02:12:48.331993 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:48.331993 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:48.333939 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 276/560] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:12:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:48.334904 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70fd65-dfee-4c08-811e-848a8f18ad8e None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:48.339369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:48.347519 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:48.368409 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1291860-e305-4ff4-9450-eeeb1d27e8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:48.369124 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1291860-e305-4ff4-9450-eeeb1d27e8a4 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:48.369506 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1291860-e305-4ff4-9450-eeeb1d27e8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:48.369862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1291860-e305-4ff4-9450-eeeb1d27e8a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:48.370579 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1291860-e305-4ff4-9450-eeeb1d27e8a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:48.371004 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1291860-e305-4ff4-9450-eeeb1d27e8a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:48.372449 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1291860-e305-4ff4-9450-eeeb1d27e8a4 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:48.385224 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 285/561] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:48.386309 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1291860-e305-4ff4-9450-eeeb1d27e8a4 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:48.454021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70fd65-dfee-4c08-811e-848a8f18ad8e None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:48.489383 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1291860-e305-4ff4-9450-eeeb1d27e8a4 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:48.494157 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cad179-11de-4a7f-87ec-6f5aaf32fcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:48.494801 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cad179-11de-4a7f-87ec-6f5aaf32fcb7 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:48.495358 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cad179-11de-4a7f-87ec-6f5aaf32fcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:48.495634 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cad179-11de-4a7f-87ec-6f5aaf32fcb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:48.507536 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cad179-11de-4a7f-87ec-6f5aaf32fcb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:48.508992 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cad179-11de-4a7f-87ec-6f5aaf32fcb7 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:48.524027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-37cad179-11de-4a7f-87ec-6f5aaf32fcb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:48.524027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:48.524027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:48.524027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:48.524027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:48.524027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:48.524027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:48.524027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:48.524027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:48.524027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:48.524027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:48.524027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:48.524027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:48.524027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:48.524027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:48.524027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:48.525081 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:48.525081 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:48.525081 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:48.525081 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:48.525081 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:48.525081 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:48.525081 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:48.525081 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:48.525081 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:48.525081 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:48.525081 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:48.525081 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:48.525081 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:48.525081 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:48.525081 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:48.525081 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:48.525081 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:48.526033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:48.526033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:48.526033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:48.526033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 277/562] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:48.526033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cad179-11de-4a7f-87ec-6f5aaf32fcb7 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:48.531155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b1518-59e5-45e2-89f3-9c57a10a4fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:48.531839 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b1518-59e5-45e2-89f3-9c57a10a4fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:48.532735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b1518-59e5-45e2-89f3-9c57a10a4fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:48.533094 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b1518-59e5-45e2-89f3-9c57a10a4fb4 None admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:48.533862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b1518-59e5-45e2-89f3-9c57a10a4fb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:48.534231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b1518-59e5-45e2-89f3-9c57a10a4fb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:48.535774 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b1518-59e5-45e2-89f3-9c57a10a4fb4 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:48.553457 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 286/563] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 02:12:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:48.554506 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b1518-59e5-45e2-89f3-9c57a10a4fb4 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:48.586223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:48.598846 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:48.635222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cad179-11de-4a7f-87ec-6f5aaf32fcb7 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:48.660068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b1518-59e5-45e2-89f3-9c57a10a4fb4 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:48.675193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c40fa1-30f6-44e9-8358-2867287c669e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:48.676069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c40fa1-30f6-44e9-8358-2867287c669e None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:48.676498 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c40fa1-30f6-44e9-8358-2867287c669e None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:48.676934 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c40fa1-30f6-44e9-8358-2867287c669e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:48.685291 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c40fa1-30f6-44e9-8358-2867287c669e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:48.686928 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c40fa1-30f6-44e9-8358-2867287c669e None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:48.696050 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5877f-8793-4adc-85c9-2fe5428e5874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:48.696649 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5877f-8793-4adc-85c9-2fe5428e5874 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:48.696925 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5877f-8793-4adc-85c9-2fe5428e5874 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:48.697195 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5877f-8793-4adc-85c9-2fe5428e5874 None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:48.697831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5877f-8793-4adc-85c9-2fe5428e5874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:48.698131 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5877f-8793-4adc-85c9-2fe5428e5874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:48.699517 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5877f-8793-4adc-85c9-2fe5428e5874 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:48.700669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-10c40fa1-30f6-44e9-8358-2867287c669e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 19 02:12:48.700669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:48.700669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:48.700669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:48.700669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:48.700669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:48.700669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:48.700669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:48.700669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:48.700669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:48.700669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:48.700669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:48.700669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 02:12:48.700669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 02:12:48.700669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 02:12:48.700669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 02:12:48.701613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:48.701613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:48.701613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:12:48.701613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:48.701613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:12:48.701613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:48.701613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:48.701613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:48.701613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:48.701613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:48.701613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:48.701613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:48.701613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:48.701613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:48.701613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:48.701613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:48.701613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:48.701613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:48.702548 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:48.702548 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:48.702548 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 02:12:48.702548 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 02:12:48.702548 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 02:12:48.702548 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 02:12:48.702548 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 02:12:48.702548 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 02:12:48.702548 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 19 02:12:48.702548 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:48.704820 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 278/564] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 02:12:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:48.705819 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c40fa1-30f6-44e9-8358-2867287c669e None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:48.715764 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 287/565] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:48.716583 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5877f-8793-4adc-85c9-2fe5428e5874 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:48.814914 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c40fa1-30f6-44e9-8358-2867287c669e None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:48.819014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5877f-8793-4adc-85c9-2fe5428e5874 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:48.831153 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:48.832888 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:48.851529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033d1f4-3a35-444e-bf74-eab54b5d6854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:48.852376 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033d1f4-3a35-444e-bf74-eab54b5d6854 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:48.852808 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033d1f4-3a35-444e-bf74-eab54b5d6854 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:48.853225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033d1f4-3a35-444e-bf74-eab54b5d6854 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:48.854204 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033d1f4-3a35-444e-bf74-eab54b5d6854 None admin] RBAC: Adding query filter params (role.id=e2e7c80d19c141bc9f9bfc13c2ec2a12, scope.project.id=91449401454c493cbf423888db8b8454, user.id=58a78f75a63e4d258a4afbeb748e59f6) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:48.854686 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033d1f4-3a35-444e-bf74-eab54b5d6854 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:48.855555 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76cf1f-fc31-4c91-b078-fa823aa49b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:48.856163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033d1f4-3a35-444e-bf74-eab54b5d6854 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:48.856583 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76cf1f-fc31-4c91-b078-fa823aa49b54 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:48.857052 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76cf1f-fc31-4c91-b078-fa823aa49b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:48.857539 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76cf1f-fc31-4c91-b078-fa823aa49b54 None admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:48.858467 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76cf1f-fc31-4c91-b078-fa823aa49b54 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:48.858998 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76cf1f-fc31-4c91-b078-fa823aa49b54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:48.861341 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76cf1f-fc31-4c91-b078-fa823aa49b54 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:48.863002 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 279/566] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 02:12:48 2022] GET /identity/v3/role_assignments?user.id=58a78f75a63e4d258a4afbeb748e59f6&scope.project.id=91449401454c493cbf423888db8b8454&role.id=e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:48.863892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033d1f4-3a35-444e-bf74-eab54b5d6854 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:48.881299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 288/567] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Oct 19 02:12:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:48.887090 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76cf1f-fc31-4c91-b078-fa823aa49b54 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:48.997855 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033d1f4-3a35-444e-bf74-eab54b5d6854 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:49.050419 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76cf1f-fc31-4c91-b078-fa823aa49b54 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:49.071752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaec8b6-c553-4362-bfef-34629df45110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:49.072322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaec8b6-c553-4362-bfef-34629df45110 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:49.072601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaec8b6-c553-4362-bfef-34629df45110 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:49.072870 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaec8b6-c553-4362-bfef-34629df45110 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:49.089918 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaec8b6-c553-4362-bfef-34629df45110 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:49.091485 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaec8b6-c553-4362-bfef-34629df45110 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:49.126155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-deaec8b6-c553-4362-bfef-34629df45110 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:49.126155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:49.126155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:49.126155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:49.126155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:49.126155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:49.126155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:49.126155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:49.126155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:49.126155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:49.126155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:49.126155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:49.126155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 02:12:49.126155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 02:12:49.126155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 02:12:49.127229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 02:12:49.127229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:49.127229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:49.127229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:49.127229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:49.127229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:49.127229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:49.127229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:49.127229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:49.127229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:49.127229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:49.127229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:49.127229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:49.127229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:49.127229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:49.127229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:49.127229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:49.128132 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 02:12:49.128132 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 02:12:49.128132 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 02:12:49.128132 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 02:12:49.128132 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 02:12:49.128132 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 02:12:49.128132 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:49.128132 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:49.135997 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 280/568] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:12:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:49.142744 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaec8b6-c553-4362-bfef-34629df45110 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:49.187688 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd56b5-347d-4a4e-9ab2-0160a962c43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:49.189867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd56b5-347d-4a4e-9ab2-0160a962c43f None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:49.190347 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd56b5-347d-4a4e-9ab2-0160a962c43f None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:49.190872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd56b5-347d-4a4e-9ab2-0160a962c43f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:49.225506 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd56b5-347d-4a4e-9ab2-0160a962c43f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:49.228431 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd56b5-347d-4a4e-9ab2-0160a962c43f None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:49.245453 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:49.261975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-16bd56b5-347d-4a4e-9ab2-0160a962c43f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:49.261975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:49.261975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:49.261975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:49.261975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:49.261975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:49.261975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:49.261975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:49.261975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:49.261975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:49.261975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:49.261975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:49.261975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:49.261975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:49.261975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:49.261975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:49.273147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:49.273147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:49.273147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:49.273147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:49.273147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:49.273147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:49.273147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:49.273147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:49.273147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:49.273147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:49.273147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:49.273147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:49.273147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:49.273147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:49.273147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:49.273147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:49.273147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:49.274007 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:49.274007 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:49.274007 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:49.274007 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 289/569] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:12:49.274007 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd56b5-347d-4a4e-9ab2-0160a962c43f None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:49.277688 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:49.398850 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd56b5-347d-4a4e-9ab2-0160a962c43f None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:49.474848 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8003e5-d5ae-4dcd-919c-8856fbb811ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:49.475083 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaec8b6-c553-4362-bfef-34629df45110 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:49.475517 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8003e5-d5ae-4dcd-919c-8856fbb811ce None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:49.475517 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8003e5-d5ae-4dcd-919c-8856fbb811ce None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:49.475517 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8003e5-d5ae-4dcd-919c-8856fbb811ce None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:49.475517 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8003e5-d5ae-4dcd-919c-8856fbb811ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:49.475517 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8003e5-d5ae-4dcd-919c-8856fbb811ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:49.476935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8003e5-d5ae-4dcd-919c-8856fbb811ce None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:49.522860 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 290/570] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:49.525245 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8003e5-d5ae-4dcd-919c-8856fbb811ce None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:49.615597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d726b-b214-4d82-86a6-f979d476374a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:49.616236 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d726b-b214-4d82-86a6-f979d476374a None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:49.616516 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d726b-b214-4d82-86a6-f979d476374a None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:49.616785 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d726b-b214-4d82-86a6-f979d476374a None admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:49.617496 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d726b-b214-4d82-86a6-f979d476374a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:49.617870 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d726b-b214-4d82-86a6-f979d476374a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:49.619433 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d726b-b214-4d82-86a6-f979d476374a None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:49.642004 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 281/571] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 02:12:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 500 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:49.647661 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:49.651867 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d726b-b214-4d82-86a6-f979d476374a None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:49.693632 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8003e5-d5ae-4dcd-919c-8856fbb811ce None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:49.738241 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d799f-5d07-47c7-9a88-089bae2f7906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:49.738925 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d799f-5d07-47c7-9a88-089bae2f7906 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:49.739205 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d799f-5d07-47c7-9a88-089bae2f7906 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:49.739478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d799f-5d07-47c7-9a88-089bae2f7906 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:49.748666 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d799f-5d07-47c7-9a88-089bae2f7906 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:49.750128 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d799f-5d07-47c7-9a88-089bae2f7906 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:49.764751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-875d799f-5d07-47c7-9a88-089bae2f7906 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:49.764751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:49.764751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:49.764751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:49.764751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:49.764751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:49.764751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:49.764751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:49.764751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:49.764751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:49.764751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:49.764751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:49.764751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 02:12:49.764751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 02:12:49.764751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 02:12:49.767550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 02:12:49.767550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:49.767550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:49.767550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:49.767550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:49.767550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:49.767550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:49.767550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:49.767550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:49.767550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:49.767550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:49.767550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:49.767550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:49.767550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:49.767550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:49.767550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:49.767550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:49.769734 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 02:12:49.769734 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 02:12:49.769734 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 02:12:49.769734 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 02:12:49.769734 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 02:12:49.769734 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 02:12:49.769734 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:49.769734 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:49.769734 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 291/572] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:12:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:49.769734 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19522e7-110a-4f59-9c43-266ae0490bed None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:49.769734 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19522e7-110a-4f59-9c43-266ae0490bed None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:49.771132 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19522e7-110a-4f59-9c43-266ae0490bed None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:49.778837 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 292/573] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:49.778837 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19522e7-110a-4f59-9c43-266ae0490bed None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:49.792723 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:49.796234 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d726b-b214-4d82-86a6-f979d476374a None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:49.837159 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48764b6-ad9c-4e2a-a2d1-d25472aa974e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:49.838153 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48764b6-ad9c-4e2a-a2d1-d25472aa974e None admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:49.838621 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48764b6-ad9c-4e2a-a2d1-d25472aa974e None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:49.839047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48764b6-ad9c-4e2a-a2d1-d25472aa974e None admin] PATH_INFO: `/v3/projects/91449401454c493cbf423888db8b8454/users/e58cdf090af44b508767e821be2f379f/roles/abb44cb94d7c46d3955fd92860aff94d` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:49.856317 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48764b6-ad9c-4e2a-a2d1-d25472aa974e None admin] RBAC: Authorizing `identity:create_grant(project_id=91449401454c493cbf423888db8b8454, user_id=e58cdf090af44b508767e821be2f379f, role_id=abb44cb94d7c46d3955fd92860aff94d)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:49.858276 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48764b6-ad9c-4e2a-a2d1-d25472aa974e None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:49.898314 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19522e7-110a-4f59-9c43-266ae0490bed None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:49.931034 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 282/574] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 02:12:49 2022] PUT /identity/v3/projects/91449401454c493cbf423888db8b8454/users/e58cdf090af44b508767e821be2f379f/roles/abb44cb94d7c46d3955fd92860aff94d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:12:49.931575 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:49.933840 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c1547-484e-4002-bc28-89ad06a803dd None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:49.934327 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c1547-484e-4002-bc28-89ad06a803dd None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:49.943213 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c1547-484e-4002-bc28-89ad06a803dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:49.945558 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b28d2c-6365-4cf0-a5a1-1dae3543480f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:49.946550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b28d2c-6365-4cf0-a5a1-1dae3543480f None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:49.947067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b28d2c-6365-4cf0-a5a1-1dae3543480f None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:49.947674 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b28d2c-6365-4cf0-a5a1-1dae3543480f None admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:49.948752 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b28d2c-6365-4cf0-a5a1-1dae3543480f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:49.949296 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b28d2c-6365-4cf0-a5a1-1dae3543480f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:49.951190 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b28d2c-6365-4cf0-a5a1-1dae3543480f None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:49.966608 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 293/575] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 02:12:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:49.974979 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b28d2c-6365-4cf0-a5a1-1dae3543480f None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:49.987060 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-7b6c1547-484e-4002-bc28-89ad06a803dd None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:49.988280 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-7b6c1547-484e-4002-bc28-89ad06a803dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:50.085418 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 283/576] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:12:50.086796 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c494ab-f855-4ab7-a850-502d56b4944c None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:50.087119 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c494ab-f855-4ab7-a850-502d56b4944c None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:50.087388 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c494ab-f855-4ab7-a850-502d56b4944c None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:50.088951 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 284/577] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:50.095481 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762626c0-acb7-47ea-ba71-f498928a12f9 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:50.095757 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762626c0-acb7-47ea-ba71-f498928a12f9 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:50.096007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762626c0-acb7-47ea-ba71-f498928a12f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:50.111846 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b28d2c-6365-4cf0-a5a1-1dae3543480f None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:50.120130 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-762626c0-acb7-47ea-ba71-f498928a12f9 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:50.122266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-762626c0-acb7-47ea-ba71-f498928a12f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:50.165014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c92ede-7f7f-4d2d-a801-5ec4146a71e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:50.165943 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c92ede-7f7f-4d2d-a801-5ec4146a71e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:50.166392 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c92ede-7f7f-4d2d-a801-5ec4146a71e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:50.166844 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c92ede-7f7f-4d2d-a801-5ec4146a71e2 None admin] PATH_INFO: `/v3/projects/91449401454c493cbf423888db8b8454/users/f906e9835f5c4e709915c6553b41aeff/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:50.170521 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c92ede-7f7f-4d2d-a801-5ec4146a71e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=91449401454c493cbf423888db8b8454, user_id=f906e9835f5c4e709915c6553b41aeff, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:50.172145 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c92ede-7f7f-4d2d-a801-5ec4146a71e2 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:50.222897 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 285/578] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 02:12:50.279124 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 294/579] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 02:12:49 2022] PUT /identity/v3/projects/91449401454c493cbf423888db8b8454/users/f906e9835f5c4e709915c6553b41aeff/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:12:50.407976 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762626c0-acb7-47ea-ba71-f498928a12f9 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:50.421107 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:50.535803 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762626c0-acb7-47ea-ba71-f498928a12f9 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:50.567709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c92ede-7f7f-4d2d-a801-5ec4146a71e2 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:50.572288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3372748-94ec-4258-88dc-bbf494039b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:50.572920 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3372748-94ec-4258-88dc-bbf494039b14 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:50.573195 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3372748-94ec-4258-88dc-bbf494039b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:50.573462 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3372748-94ec-4258-88dc-bbf494039b14 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:50.574039 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3372748-94ec-4258-88dc-bbf494039b14 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:50.575428 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3372748-94ec-4258-88dc-bbf494039b14 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:50.587884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-c3372748-94ec-4258-88dc-bbf494039b14 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 02:12:50.587884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:50.587884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:12:50.587884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:12:50.587884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:12:50.587884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:12:50.587884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:12:50.587884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:12:50.587884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 02:12:50.587884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:50.587884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:12:50.587884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:50.587884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:50.587884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:50.587884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:50.587884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:50.587884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:50.588987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:50.588987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:50.588987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:50.588987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:50.588987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:50.588987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:50.588987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:12:50.588987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:12:50.588987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:12:50.588987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:12:50.588987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:50.588987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:50.588987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:50.588987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:50.588987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:50.588987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:50.590079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:50.590079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:50.590079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:50.590079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:50.590079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:50.590079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:50.590079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:50.590079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:50.590079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:50.590079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:50.590079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:12:50.590079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:12:50.590079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 02:12:50.590079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:50.590079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 286/580] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Oct 19 02:12:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:50.595615 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3372748-94ec-4258-88dc-bbf494039b14 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:50.639180 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:50.730903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:50.733196 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c92ede-7f7f-4d2d-a801-5ec4146a71e2 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:50.784434 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3372748-94ec-4258-88dc-bbf494039b14 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:50.799160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b853d2-035d-4776-8a98-848e1db2f6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:50.799728 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b853d2-035d-4776-8a98-848e1db2f6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:50.800006 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b853d2-035d-4776-8a98-848e1db2f6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:50.800276 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b853d2-035d-4776-8a98-848e1db2f6b9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:50.800871 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b853d2-035d-4776-8a98-848e1db2f6b9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:50.802231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b853d2-035d-4776-8a98-848e1db2f6b9 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:50.818770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-c1b853d2-035d-4776-8a98-848e1db2f6b9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 02:12:50.818770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:50.818770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:12:50.818770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:12:50.818770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:12:50.818770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:12:50.818770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:12:50.818770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:12:50.818770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 02:12:50.818770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:50.818770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:12:50.818770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:50.818770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:50.818770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:50.818770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:50.818770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:50.818770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:50.819917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:50.819917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:50.819917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:50.819917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:50.819917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:50.819917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:50.819917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:12:50.819917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:12:50.819917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:12:50.819917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:12:50.819917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:50.819917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:50.819917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:50.819917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:50.819917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:50.819917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:50.820805 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:50.820805 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:50.820805 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:50.820805 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:50.820805 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:50.820805 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:50.820805 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:50.820805 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:50.820805 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:50.820805 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:50.820805 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:12:50.820805 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:12:50.820805 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 02:12:50.820805 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:50.821545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 295/581] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:12:50 2022] GET /identity/v3/services/network => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:50.835843 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b853d2-035d-4776-8a98-848e1db2f6b9 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:50.854212 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1a867-e2d5-4c26-98bd-ad303e72a251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:50.855483 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1a867-e2d5-4c26-98bd-ad303e72a251 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:50.855940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1a867-e2d5-4c26-98bd-ad303e72a251 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:50.856381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1a867-e2d5-4c26-98bd-ad303e72a251 None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:50.857199 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1a867-e2d5-4c26-98bd-ad303e72a251 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:50.857689 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1a867-e2d5-4c26-98bd-ad303e72a251 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:50.859246 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1a867-e2d5-4c26-98bd-ad303e72a251 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:50.865404 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 287/582] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Oct 19 02:12:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:50.871295 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1a867-e2d5-4c26-98bd-ad303e72a251 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:50.991979 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1a867-e2d5-4c26-98bd-ad303e72a251 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:51.033077 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd7052-9a38-4f7a-a429-2ceee2b8e545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:51.034029 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd7052-9a38-4f7a-a429-2ceee2b8e545 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:51.034801 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd7052-9a38-4f7a-a429-2ceee2b8e545 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:51.035413 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd7052-9a38-4f7a-a429-2ceee2b8e545 None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:51.036343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd7052-9a38-4f7a-a429-2ceee2b8e545 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:51.036842 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd7052-9a38-4f7a-a429-2ceee2b8e545 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:51.038478 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd7052-9a38-4f7a-a429-2ceee2b8e545 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:51.038588 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b853d2-035d-4776-8a98-848e1db2f6b9 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:51.045446 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 288/583] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Oct 19 02:12:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:51.053527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd7052-9a38-4f7a-a429-2ceee2b8e545 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:51.056636 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:51.067233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:51.115456 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55000f-5a30-41c9-9314-32ec1720e78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:51.116064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55000f-5a30-41c9-9314-32ec1720e78d None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:51.116342 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55000f-5a30-41c9-9314-32ec1720e78d None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:51.116613 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55000f-5a30-41c9-9314-32ec1720e78d None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:51.117257 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55000f-5a30-41c9-9314-32ec1720e78d None admin] RBAC: Adding query filter params (name=network) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:51.117540 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55000f-5a30-41c9-9314-32ec1720e78d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:51.118931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55000f-5a30-41c9-9314-32ec1720e78d None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:51.140803 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 296/584] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 02:12:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:51.144535 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55000f-5a30-41c9-9314-32ec1720e78d None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:51.182134 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd7052-9a38-4f7a-a429-2ceee2b8e545 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:51.227269 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9320ec6-ede9-48ca-aea0-47e87345c7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:51.228256 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9320ec6-ede9-48ca-aea0-47e87345c7ad None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:51.228730 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9320ec6-ede9-48ca-aea0-47e87345c7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:51.229212 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9320ec6-ede9-48ca-aea0-47e87345c7ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:51.230129 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9320ec6-ede9-48ca-aea0-47e87345c7ad None admin] RBAC: Adding query filter params (interface=public, service_id=2455d8e5ab8540eda703c0fe2bc434fc, region_id=RegionOne) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:51.230755 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9320ec6-ede9-48ca-aea0-47e87345c7ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:51.233082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9320ec6-ede9-48ca-aea0-47e87345c7ad None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:51.244125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 289/585] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 19 02:12:51 2022] GET /identity/v3/endpoints?service_id=2455d8e5ab8540eda703c0fe2bc434fc&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:51.250454 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9320ec6-ede9-48ca-aea0-47e87345c7ad None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:51.353245 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55000f-5a30-41c9-9314-32ec1720e78d None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:51.359612 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:51.403214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9320ec6-ede9-48ca-aea0-47e87345c7ad None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:51.427211 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99870d48-bc13-4f70-afc2-2ed9144fa040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:51.427828 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99870d48-bc13-4f70-afc2-2ed9144fa040 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:51.428111 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99870d48-bc13-4f70-afc2-2ed9144fa040 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:51.428387 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99870d48-bc13-4f70-afc2-2ed9144fa040 None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:51.429237 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99870d48-bc13-4f70-afc2-2ed9144fa040 None admin] RBAC: Adding query filter params (type=network) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:51.429429 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99870d48-bc13-4f70-afc2-2ed9144fa040 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:51.430912 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99870d48-bc13-4f70-afc2-2ed9144fa040 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:51.446239 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49b1c5-c586-4786-b3ac-e8bee3461019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:51.447283 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49b1c5-c586-4786-b3ac-e8bee3461019 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:51.447707 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49b1c5-c586-4786-b3ac-e8bee3461019 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:51.448120 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49b1c5-c586-4786-b3ac-e8bee3461019 None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:51.448941 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49b1c5-c586-4786-b3ac-e8bee3461019 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:51.449279 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 297/586] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 02:12:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:51.454733 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49b1c5-c586-4786-b3ac-e8bee3461019 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:51.461039 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 290/587] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 19 02:12:51 2022] GET /identity/v3/services => generated 772 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:51.470088 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99870d48-bc13-4f70-afc2-2ed9144fa040 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:51.530868 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:51.638156 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99870d48-bc13-4f70-afc2-2ed9144fa040 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:51.689579 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd52f7-c133-4387-81fa-ee5c75d48e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:51.690502 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd52f7-c133-4387-81fa-ee5c75d48e4d None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:51.691043 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd52f7-c133-4387-81fa-ee5c75d48e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:51.691457 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd52f7-c133-4387-81fa-ee5c75d48e4d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:51.692344 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd52f7-c133-4387-81fa-ee5c75d48e4d None admin] RBAC: Adding query filter params (interface=public, service_id=721093cf64024e99a119ecef9dccb6df, region_id=RegionOne) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:51.692831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd52f7-c133-4387-81fa-ee5c75d48e4d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:51.694453 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd52f7-c133-4387-81fa-ee5c75d48e4d None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:51.704072 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 298/588] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 19 02:12:51 2022] GET /identity/v3/endpoints?service_id=721093cf64024e99a119ecef9dccb6df&interface=public®ion_id=RegionOne => generated 194 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:51.710965 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49b1c5-c586-4786-b3ac-e8bee3461019 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:51.813054 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e7bd1-eab1-455b-a7a7-6a33eda8bccb None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:51.813351 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e7bd1-eab1-455b-a7a7-6a33eda8bccb None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:51.813628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e7bd1-eab1-455b-a7a7-6a33eda8bccb None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:51.815254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 299/589] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:51.819518 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49b1c5-c586-4786-b3ac-e8bee3461019 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:51.820233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43530dea-5bf8-4cf3-9aeb-56ce5a4932dd None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:51.820520 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43530dea-5bf8-4cf3-9aeb-56ce5a4932dd None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:51.820801 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43530dea-5bf8-4cf3-9aeb-56ce5a4932dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:51.843177 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-43530dea-5bf8-4cf3-9aeb-56ce5a4932dd None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:51.844832 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-43530dea-5bf8-4cf3-9aeb-56ce5a4932dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:51.857897 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:51.865752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977eeffb-b238-4934-8490-f06938bcaceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:51.866370 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977eeffb-b238-4934-8490-f06938bcaceb None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:51.866649 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977eeffb-b238-4934-8490-f06938bcaceb None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:51.866977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977eeffb-b238-4934-8490-f06938bcaceb None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:51.867814 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977eeffb-b238-4934-8490-f06938bcaceb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:51.869614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977eeffb-b238-4934-8490-f06938bcaceb None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:51.877029 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 291/590] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 19 02:12:51 2022] GET /identity/v3/services => generated 772 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:51.932447 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 300/591] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 02:12:52.226986 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977eeffb-b238-4934-8490-f06938bcaceb None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:52.356714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977eeffb-b238-4934-8490-f06938bcaceb None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:52.408177 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd541db-cc03-4c5a-b930-71dc954f34db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:52.409176 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd541db-cc03-4c5a-b930-71dc954f34db None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:52.409675 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd541db-cc03-4c5a-b930-71dc954f34db None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:52.410148 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd541db-cc03-4c5a-b930-71dc954f34db None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:52.410978 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd541db-cc03-4c5a-b930-71dc954f34db None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:52.412559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd541db-cc03-4c5a-b930-71dc954f34db None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:52.427173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-efd541db-cc03-4c5a-b930-71dc954f34db None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 02:12:52.427173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:52.427173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:12:52.427173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:12:52.427173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:12:52.427173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:12:52.427173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:12:52.427173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:12:52.427173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 02:12:52.427173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:52.427173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:12:52.427173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:52.427173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:52.427173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:52.427173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:52.427173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:52.428194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:52.428194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:52.428194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:52.428194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:52.428194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:52.428194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:52.428194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:52.428194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:12:52.428194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:12:52.428194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:12:52.428194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:12:52.428194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:52.428194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:52.428194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:52.428194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:52.428194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:52.428194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:52.429058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:52.429058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:52.429058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:52.429058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:52.429058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:52.429058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:52.429058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:52.429058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:52.429058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:52.429058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:52.429058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:12:52.429058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:12:52.429058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 02:12:52.429058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:52.434908 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 292/592] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Oct 19 02:12:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:52.439987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43530dea-5bf8-4cf3-9aeb-56ce5a4932dd None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:52.499349 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:52.608327 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d42889-6374-401f-b343-11149d0b1ef1 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:52.608673 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d42889-6374-401f-b343-11149d0b1ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:52.608875 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d42889-6374-401f-b343-11149d0b1ef1 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:52.611242 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 293/593] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:52.616245 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ea8f5-ed31-4774-9242-b18dd023effa None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:52.616530 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ea8f5-ed31-4774-9242-b18dd023effa None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:52.616805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ea8f5-ed31-4774-9242-b18dd023effa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:52.635588 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-5d1ea8f5-ed31-4774-9242-b18dd023effa None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:52.636888 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-5d1ea8f5-ed31-4774-9242-b18dd023effa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:52.654563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43530dea-5bf8-4cf3-9aeb-56ce5a4932dd None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:52.717762 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:52.721448 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cd991-c9d5-4743-a2a2-2e6a165b5065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:52.722070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cd991-c9d5-4743-a2a2-2e6a165b5065 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:52.722343 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cd991-c9d5-4743-a2a2-2e6a165b5065 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:52.722622 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cd991-c9d5-4743-a2a2-2e6a165b5065 None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:52.723288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cd991-c9d5-4743-a2a2-2e6a165b5065 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:52.723587 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cd991-c9d5-4743-a2a2-2e6a165b5065 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:52.724960 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cd991-c9d5-4743-a2a2-2e6a165b5065 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:52.734545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 301/594] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 19 02:12:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:52.740662 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cd991-c9d5-4743-a2a2-2e6a165b5065 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:52.747264 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 294/595] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:12:52.843080 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:52.850060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cd991-c9d5-4743-a2a2-2e6a165b5065 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:52.885474 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006f3d2-a64c-4adb-a4e4-48453e3b28a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:52.886079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006f3d2-a64c-4adb-a4e4-48453e3b28a9 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:52.886357 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006f3d2-a64c-4adb-a4e4-48453e3b28a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:52.886628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006f3d2-a64c-4adb-a4e4-48453e3b28a9 None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:52.887342 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006f3d2-a64c-4adb-a4e4-48453e3b28a9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:52.887644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006f3d2-a64c-4adb-a4e4-48453e3b28a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:52.889073 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006f3d2-a64c-4adb-a4e4-48453e3b28a9 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:52.894054 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 302/596] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 19 02:12:52 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:53.079809 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5139d-6ef3-4b4f-9ea7-416737117388 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:53.080192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5139d-6ef3-4b4f-9ea7-416737117388 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:53.080396 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5139d-6ef3-4b4f-9ea7-416737117388 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:53.082032 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 295/597] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:53.088048 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963f340-e820-4cb5-97a9-9db600417d8c None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:53.088353 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963f340-e820-4cb5-97a9-9db600417d8c None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:53.088593 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963f340-e820-4cb5-97a9-9db600417d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:53.113624 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-7963f340-e820-4cb5-97a9-9db600417d8c None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:53.114966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5139d-6ef3-4b4f-9ea7-416737117388 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:53.115149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-7963f340-e820-4cb5-97a9-9db600417d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:53.230333 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 303/598] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 02:12:53.267691 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5139d-6ef3-4b4f-9ea7-416737117388 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:53.309052 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fcfe29-33db-4bbc-ae63-9619309ebc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:53.310293 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcfe29-33db-4bbc-ae63-9619309ebc7f None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:53.310760 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcfe29-33db-4bbc-ae63-9619309ebc7f None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:53.311230 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcfe29-33db-4bbc-ae63-9619309ebc7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:53.324404 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fcfe29-33db-4bbc-ae63-9619309ebc7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:53.330893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-22fcfe29-33db-4bbc-ae63-9619309ebc7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:12:53.330893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:53.330893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:53.330893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:53.330893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:53.330893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:53.330893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:53.330893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:53.330893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:53.330893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:53.330893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:53.330893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:53.330893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:53.330893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:53.330893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:53.330893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:53.331859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:53.331859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:53.331859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:53.331859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:53.331859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:53.331859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:53.331859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:53.331859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:53.331859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:53.331859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:53.331859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:53.331859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:53.331859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:53.331859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:53.331859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:53.331859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:53.332699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:53.332699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:53.332699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:53.332699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:53.332699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:53.332699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:53.332699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:53.332699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:53.332699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:53.332699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:53.332699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:12:53.332699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:53.335250 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 296/599] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 02:12:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:53.342868 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963f340-e820-4cb5-97a9-9db600417d8c None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:53.445981 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:53.458596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963f340-e820-4cb5-97a9-9db600417d8c None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:53.494759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316f9a8-1804-4c75-b6a1-a2b4433c0a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:53.495424 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316f9a8-1804-4c75-b6a1-a2b4433c0a2f None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:53.495681 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316f9a8-1804-4c75-b6a1-a2b4433c0a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:53.495959 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316f9a8-1804-4c75-b6a1-a2b4433c0a2f None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:53.496625 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316f9a8-1804-4c75-b6a1-a2b4433c0a2f None admin] RBAC: Adding query filter params (name=service) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:53.496926 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316f9a8-1804-4c75-b6a1-a2b4433c0a2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:53.498297 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316f9a8-1804-4c75-b6a1-a2b4433c0a2f None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:53.506998 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 304/600] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 02:12:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:53.512444 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fcfe29-33db-4bbc-ae63-9619309ebc7f None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:53.567303 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316f9a8-1804-4c75-b6a1-a2b4433c0a2f None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:53.604048 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:53.694885 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fcfe29-33db-4bbc-ae63-9619309ebc7f None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:53.767161 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e3549-fe9e-4439-ba28-0064abaaca5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:53.767783 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e3549-fe9e-4439-ba28-0064abaaca5a None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:53.767997 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e3549-fe9e-4439-ba28-0064abaaca5a None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:53.769855 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e3549-fe9e-4439-ba28-0064abaaca5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:53.784010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e3549-fe9e-4439-ba28-0064abaaca5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:53.785606 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e3549-fe9e-4439-ba28-0064abaaca5a None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:53.793934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316f9a8-1804-4c75-b6a1-a2b4433c0a2f None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:53.818553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-e71e3549-fe9e-4439-ba28-0064abaaca5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:53.818553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:53.818553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:53.818553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:53.818553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:53.818553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:53.818553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:53.818553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:53.818553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:53.818553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:53.818553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:53.818553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:53.818553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:53.818553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:53.818553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:53.818553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:53.819561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:53.819561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:53.819561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:53.819561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:53.819561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:53.819561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:53.819561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:53.819561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:53.819561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:53.819561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:53.819561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:53.819561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:53.819561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:53.819561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:53.819561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:53.819561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:53.819561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:53.820442 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:53.820442 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:53.820442 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:53.822436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 297/601] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:53.826696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e3549-fe9e-4439-ba28-0064abaaca5a None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:53.877524 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce7210-5fce-4ab2-acfc-2681f3a618d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:53.878349 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce7210-5fce-4ab2-acfc-2681f3a618d3 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:53.878777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce7210-5fce-4ab2-acfc-2681f3a618d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:53.879433 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce7210-5fce-4ab2-acfc-2681f3a618d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:53.906251 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce7210-5fce-4ab2-acfc-2681f3a618d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:53.915242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-55ce7210-5fce-4ab2-acfc-2681f3a618d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:12:53.915242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:53.915242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:53.915242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:53.915242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:53.915242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:53.915242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:53.915242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:53.915242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:53.915242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:53.915242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:53.915242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:53.915242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:53.915242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:53.915242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:53.915242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:53.916198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:53.916198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:53.916198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:53.916198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:53.916198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:53.916198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:53.916198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:53.916198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:53.916198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:53.916198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:53.916198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:53.916198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:53.916198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:53.916198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:53.916198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:53.916198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:53.917027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:53.917027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:53.917027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:53.917027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:53.917027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:53.917027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:53.917027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:53.917027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:53.917027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:53.917027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:53.917027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:12:53.917027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:53.917027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 305/602] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 02:12:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:12:53.924204 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce7210-5fce-4ab2-acfc-2681f3a618d3 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:53.952818 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:54.022088 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:54.028456 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e3549-fe9e-4439-ba28-0064abaaca5a None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:54.094158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce7210-5fce-4ab2-acfc-2681f3a618d3 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:54.115581 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb3e92-5f8a-4baa-8268-7e239754f2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:54.116207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb3e92-5f8a-4baa-8268-7e239754f2cb None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:54.116490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb3e92-5f8a-4baa-8268-7e239754f2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:54.116763 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb3e92-5f8a-4baa-8268-7e239754f2cb None admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:54.117419 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb3e92-5f8a-4baa-8268-7e239754f2cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:54.117721 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb3e92-5f8a-4baa-8268-7e239754f2cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:54.119127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb3e92-5f8a-4baa-8268-7e239754f2cb None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:54.137475 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392c15b-3087-443a-a72e-d7ae622a5014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:54.138738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392c15b-3087-443a-a72e-d7ae622a5014 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:54.139231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392c15b-3087-443a-a72e-d7ae622a5014 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:54.139643 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392c15b-3087-443a-a72e-d7ae622a5014 None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:54.141029 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392c15b-3087-443a-a72e-d7ae622a5014 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:54.142658 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392c15b-3087-443a-a72e-d7ae622a5014 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:54.144635 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392c15b-3087-443a-a72e-d7ae622a5014 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:54.146139 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 298/603] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:54.151373 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb3e92-5f8a-4baa-8268-7e239754f2cb None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:54.154775 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 306/604] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:12:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:54.164224 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392c15b-3087-443a-a72e-d7ae622a5014 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:54.299245 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:54.350625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb3e92-5f8a-4baa-8268-7e239754f2cb None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:54.363630 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392c15b-3087-443a-a72e-d7ae622a5014 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:54.416191 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c4452-af2f-42d8-a5d7-acf1c8861c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:54.416840 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c4452-af2f-42d8-a5d7-acf1c8861c1c None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:54.417115 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c4452-af2f-42d8-a5d7-acf1c8861c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:54.417389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c4452-af2f-42d8-a5d7-acf1c8861c1c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:54.422482 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879d686-1f70-4f44-abd7-2d3cbff0db41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:54.423143 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879d686-1f70-4f44-abd7-2d3cbff0db41 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:54.423420 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879d686-1f70-4f44-abd7-2d3cbff0db41 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:54.423688 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879d686-1f70-4f44-abd7-2d3cbff0db41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:54.431973 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c4452-af2f-42d8-a5d7-acf1c8861c1c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:54.433429 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c4452-af2f-42d8-a5d7-acf1c8861c1c None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:54.448331 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879d686-1f70-4f44-abd7-2d3cbff0db41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:54.449798 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879d686-1f70-4f44-abd7-2d3cbff0db41 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:54.455608 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-787c4452-af2f-42d8-a5d7-acf1c8861c1c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 02:12:54.455608 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:54.455608 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:54.455608 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:54.455608 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:54.455608 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:54.455608 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:54.455608 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:54.455608 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:54.455608 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:54.455608 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:54.455608 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:54.455608 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 02:12:54.455608 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 02:12:54.455608 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 02:12:54.455608 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 02:12:54.456576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:54.456576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:54.456576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:12:54.456576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:54.456576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:12:54.456576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:54.456576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:54.456576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:54.456576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:54.456576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:54.456576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:54.456576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:54.456576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:54.456576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:54.456576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:54.456576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:54.456576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:54.456576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:54.457550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:54.457550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:54.457550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 02:12:54.457550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 02:12:54.457550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 02:12:54.457550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 02:12:54.457550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 02:12:54.457550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 02:12:54.457550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 02:12:54.457550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:54.457550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 299/605] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 19 02:12:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:12:54.458626 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1af27-71ab-4683-8593-dbf611476045 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:54.458626 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1af27-71ab-4683-8593-dbf611476045 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:54.458937 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1af27-71ab-4683-8593-dbf611476045 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:54.464748 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 300/606] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:54.465476 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1af27-71ab-4683-8593-dbf611476045 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:54.471724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-2879d686-1f70-4f44-abd7-2d3cbff0db41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:54.471724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:54.471724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:54.471724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:54.471724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:54.471724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:54.471724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:54.471724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:54.471724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:54.471724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:54.471724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:54.471724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:54.471724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:54.471724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:54.471724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:54.471724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:54.473924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:54.473924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:54.473924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:54.473924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:54.473924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:54.473924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:54.473924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:54.473924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:54.473924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:54.473924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:54.473924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:54.473924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:54.473924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:54.473924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:54.473924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:54.473924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:54.473924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:54.476113 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:54.476113 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:54.476113 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:54.476113 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 307/607] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:54.476113 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af1c03-6d24-4509-b4a8-2687f0da7a19 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:54.476113 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af1c03-6d24-4509-b4a8-2687f0da7a19 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:54.476113 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af1c03-6d24-4509-b4a8-2687f0da7a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:54.493700 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-c3af1c03-6d24-4509-b4a8-2687f0da7a19 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:54.494934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-c3af1c03-6d24-4509-b4a8-2687f0da7a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:54.498425 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:54.583168 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 308/608] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:12:54.584118 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af1c03-6d24-4509-b4a8-2687f0da7a19 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:54.608216 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1af27-71ab-4683-8593-dbf611476045 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:54.652285 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51109d61-434d-4a25-9d5f-e14a74ef21e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:54.652891 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51109d61-434d-4a25-9d5f-e14a74ef21e2 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:54.653166 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51109d61-434d-4a25-9d5f-e14a74ef21e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:54.653432 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51109d61-434d-4a25-9d5f-e14a74ef21e2 None admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:54.654149 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51109d61-434d-4a25-9d5f-e14a74ef21e2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:54.654451 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51109d61-434d-4a25-9d5f-e14a74ef21e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:54.656447 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51109d61-434d-4a25-9d5f-e14a74ef21e2 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:54.672251 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:54.681773 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 301/609] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Oct 19 02:12:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:54.683574 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf7b22-f63f-4431-b1bd-db5feffcd0e2 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:54.684742 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf7b22-f63f-4431-b1bd-db5feffcd0e2 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:54.687736 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf7b22-f63f-4431-b1bd-db5feffcd0e2 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:54.687736 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 302/610] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:54.689974 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf7b22-f63f-4431-b1bd-db5feffcd0e2 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:54.721157 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af1c03-6d24-4509-b4a8-2687f0da7a19 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:54.762506 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2c17d-8ddd-4437-b30a-502553b2ed64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:54.763149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2c17d-8ddd-4437-b30a-502553b2ed64 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:54.763434 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2c17d-8ddd-4437-b30a-502553b2ed64 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:54.763762 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2c17d-8ddd-4437-b30a-502553b2ed64 None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:54.764467 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2c17d-8ddd-4437-b30a-502553b2ed64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:54.764775 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2c17d-8ddd-4437-b30a-502553b2ed64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:54.766307 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2c17d-8ddd-4437-b30a-502553b2ed64 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:54.778481 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 309/611] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:54.779839 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba318c-10ba-4b1c-ac92-e335abadfe92 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:54.780771 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba318c-10ba-4b1c-ac92-e335abadfe92 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:54.780771 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba318c-10ba-4b1c-ac92-e335abadfe92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:54.789873 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:54.799896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-b4ba318c-10ba-4b1c-ac92-e335abadfe92 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:54.801146 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-b4ba318c-10ba-4b1c-ac92-e335abadfe92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:54.815371 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf7b22-f63f-4431-b1bd-db5feffcd0e2 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:54.852283 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fe446-44cc-4321-a6bc-584dd2326d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:54.853177 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fe446-44cc-4321-a6bc-584dd2326d16 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:54.853629 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fe446-44cc-4321-a6bc-584dd2326d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:54.854070 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fe446-44cc-4321-a6bc-584dd2326d16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:54.875215 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 310/612] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:12:54.876594 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba318c-10ba-4b1c-ac92-e335abadfe92 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:54.926522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fe446-44cc-4321-a6bc-584dd2326d16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:54.927192 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:54.928960 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fe446-44cc-4321-a6bc-584dd2326d16 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:54.985307 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba318c-10ba-4b1c-ac92-e335abadfe92 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:55.011628 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:55.022380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0e535-ca8d-4dea-9a2b-df381768a7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:55.023111 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0e535-ca8d-4dea-9a2b-df381768a7b4 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:55.023394 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0e535-ca8d-4dea-9a2b-df381768a7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:55.023669 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0e535-ca8d-4dea-9a2b-df381768a7b4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:55.031612 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0e535-ca8d-4dea-9a2b-df381768a7b4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:55.033533 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0e535-ca8d-4dea-9a2b-df381768a7b4 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:55.038386 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 303/613] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:12:54 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 02:12:55.039548 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fe446-44cc-4321-a6bc-584dd2326d16 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:55.046261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-43f0e535-ca8d-4dea-9a2b-df381768a7b4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 19 02:12:55.046261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:55.046261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:55.046261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:55.046261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:55.046261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:55.046261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:55.046261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:55.046261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:55.046261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:55.046261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:55.046261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:55.046261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 02:12:55.046261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 02:12:55.046261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 02:12:55.046261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 02:12:55.047980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:55.047980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:55.047980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:12:55.047980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:55.047980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:12:55.047980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:12:55.047980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:55.047980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:55.047980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:55.047980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:55.047980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:55.047980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:55.047980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:55.047980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:55.047980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:55.047980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:55.047980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:55.047980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:55.049461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:55.049461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:55.049461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 02:12:55.049461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 02:12:55.049461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 02:12:55.049461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 02:12:55.049461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 02:12:55.049461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 02:12:55.049461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 19 02:12:55.049461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:55.049461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 311/614] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 02:12:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:55.049461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0e535-ca8d-4dea-9a2b-df381768a7b4 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:55.149919 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fe446-44cc-4321-a6bc-584dd2326d16 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:55.166208 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0e535-ca8d-4dea-9a2b-df381768a7b4 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:55.168678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:55.189914 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924355f-db70-4820-97f3-e766da15b04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:55.190544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924355f-db70-4820-97f3-e766da15b04e None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:55.193446 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924355f-db70-4820-97f3-e766da15b04e None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:55.193446 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924355f-db70-4820-97f3-e766da15b04e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:55.193446 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924355f-db70-4820-97f3-e766da15b04e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:55.193446 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924355f-db70-4820-97f3-e766da15b04e None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:55.202115 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81faa9af-27a1-42d8-adf2-4cef340e6b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:55.202505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-3924355f-db70-4820-97f3-e766da15b04e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 02:12:55.202505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:55.202505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:12:55.202505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:12:55.202505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:12:55.202505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:12:55.202505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:12:55.202505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:12:55.202505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 02:12:55.202505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:55.202505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:12:55.202505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:55.202505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:55.202505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:55.202505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:55.202505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:55.202505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:55.203558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:55.203558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:55.203558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:55.203558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:55.203558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:55.203558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:55.203558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:12:55.203558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:12:55.203558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:12:55.203558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:12:55.203558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:55.203558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:55.203558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:55.203558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:55.203558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:55.203558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:55.207820 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:55.207820 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:55.207820 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:55.207820 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:55.207820 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:55.207820 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:55.207820 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:55.207820 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:55.207820 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:55.207820 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:55.207820 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:12:55.207820 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:12:55.207820 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 02:12:55.207820 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:55.208561 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faa9af-27a1-42d8-adf2-4cef340e6b29 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:55.208561 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faa9af-27a1-42d8-adf2-4cef340e6b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:55.208561 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faa9af-27a1-42d8-adf2-4cef340e6b29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:55.208740 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 304/615] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Oct 19 02:12:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:55.208740 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924355f-db70-4820-97f3-e766da15b04e None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:55.222581 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81faa9af-27a1-42d8-adf2-4cef340e6b29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:55.224066 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81faa9af-27a1-42d8-adf2-4cef340e6b29 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:55.239905 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-81faa9af-27a1-42d8-adf2-4cef340e6b29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:55.239905 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:55.239905 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:55.239905 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:55.239905 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:55.239905 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:55.239905 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:55.239905 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:55.239905 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:55.239905 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:55.239905 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:55.239905 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:55.239905 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:55.239905 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:55.239905 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:55.239905 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:55.240893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:55.240893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:55.240893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:55.240893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:55.240893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:55.240893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:55.240893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:55.240893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:55.240893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:55.240893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:55.240893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:55.240893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:55.240893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:55.240893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:55.240893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:55.240893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:55.240893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:55.241768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:55.241768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:55.241768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:55.245615 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 312/616] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:55.246430 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81faa9af-27a1-42d8-adf2-4cef340e6b29 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:55.256881 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:55.318619 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924355f-db70-4820-97f3-e766da15b04e None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:55.353820 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81faa9af-27a1-42d8-adf2-4cef340e6b29 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:55.358073 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e495539-011e-493d-b42e-2a6603da7a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:55.358687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e495539-011e-493d-b42e-2a6603da7a27 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:55.358997 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e495539-011e-493d-b42e-2a6603da7a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:55.359266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e495539-011e-493d-b42e-2a6603da7a27 None admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:55.360028 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e495539-011e-493d-b42e-2a6603da7a27 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:55.360331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e495539-011e-493d-b42e-2a6603da7a27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:55.362192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e495539-011e-493d-b42e-2a6603da7a27 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:55.387781 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 305/617] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Oct 19 02:12:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:55.387781 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e495539-011e-493d-b42e-2a6603da7a27 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:55.396726 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913fc42b-16c9-485b-9cb3-496918517942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:55.397393 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fc42b-16c9-485b-9cb3-496918517942 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:55.397676 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fc42b-16c9-485b-9cb3-496918517942 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:55.397952 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fc42b-16c9-485b-9cb3-496918517942 None admin] PATH_INFO: `/v3/services/network` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:55.399279 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913fc42b-16c9-485b-9cb3-496918517942 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:55.401254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913fc42b-16c9-485b-9cb3-496918517942 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:55.411971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-913fc42b-16c9-485b-9cb3-496918517942 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 02:12:55.411971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:55.411971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:12:55.411971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:12:55.411971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:12:55.411971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:12:55.411971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:12:55.411971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:12:55.411971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 02:12:55.411971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:55.411971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:12:55.411971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:55.411971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:55.411971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:55.411971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:55.411971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:55.411971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:55.413019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:55.413019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:55.413019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:55.413019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:55.413019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:55.413019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:55.413019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:12:55.413019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:12:55.413019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:12:55.413019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:12:55.413019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:55.413019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:55.413019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:55.413019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:55.413019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:55.413019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:55.415976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:55.415976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:55.415976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:55.415976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:55.415976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:55.415976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:55.415976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:55.415976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:55.415976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:55.415976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:55.415976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:12:55.415976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:12:55.415976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 02:12:55.415976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:55.415976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 313/618] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:12:55 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:55.416776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913fc42b-16c9-485b-9cb3-496918517942 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:55.440912 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:55.500192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:55.504460 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e495539-011e-493d-b42e-2a6603da7a27 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:55.531708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913fc42b-16c9-485b-9cb3-496918517942 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:55.539469 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae9622-b993-425c-9322-43ddc943d8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:55.540069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae9622-b993-425c-9322-43ddc943d8bb None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:55.540341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae9622-b993-425c-9322-43ddc943d8bb None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:55.540606 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae9622-b993-425c-9322-43ddc943d8bb None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:55.541229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae9622-b993-425c-9322-43ddc943d8bb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:55.541557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae9622-b993-425c-9322-43ddc943d8bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:55.542947 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae9622-b993-425c-9322-43ddc943d8bb None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:55.547882 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 306/619] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Oct 19 02:12:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:55.549236 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae9622-b993-425c-9322-43ddc943d8bb None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:55.567567 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288b91f-d62d-4bb1-ace7-97af66536adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:55.568175 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288b91f-d62d-4bb1-ace7-97af66536adf None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:55.568454 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288b91f-d62d-4bb1-ace7-97af66536adf None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:55.568735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288b91f-d62d-4bb1-ace7-97af66536adf None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:55.569377 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288b91f-d62d-4bb1-ace7-97af66536adf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:55.569681 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288b91f-d62d-4bb1-ace7-97af66536adf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:55.571069 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288b91f-d62d-4bb1-ace7-97af66536adf None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:55.582273 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 314/620] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:55.583106 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288b91f-d62d-4bb1-ace7-97af66536adf None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:55.652101 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae9622-b993-425c-9322-43ddc943d8bb None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:55.661862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:55.681848 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288b91f-d62d-4bb1-ace7-97af66536adf None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:55.686941 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fefad-9ae0-474d-8f04-4b22c821059c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:55.687582 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fefad-9ae0-474d-8f04-4b22c821059c None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:55.687929 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fefad-9ae0-474d-8f04-4b22c821059c None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:55.688204 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fefad-9ae0-474d-8f04-4b22c821059c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:55.715639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe42448-d5a2-4d72-a820-b3ad26285999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:55.716234 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe42448-d5a2-4d72-a820-b3ad26285999 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:55.716510 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe42448-d5a2-4d72-a820-b3ad26285999 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:55.716777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe42448-d5a2-4d72-a820-b3ad26285999 None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:55.717398 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe42448-d5a2-4d72-a820-b3ad26285999 None admin] RBAC: Adding query filter params (name=network) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:55.717699 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe42448-d5a2-4d72-a820-b3ad26285999 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:55.718558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:55.719771 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe42448-d5a2-4d72-a820-b3ad26285999 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:55.724606 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 315/621] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 02:12:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:55.725779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afff336-9f52-4999-b6a4-281eb2a6d272 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:55.726064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afff336-9f52-4999-b6a4-281eb2a6d272 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:55.726345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afff336-9f52-4999-b6a4-281eb2a6d272 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:55.731408 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 316/622] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:55.731408 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afff336-9f52-4999-b6a4-281eb2a6d272 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:55.760486 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fefad-9ae0-474d-8f04-4b22c821059c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:55.761949 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fefad-9ae0-474d-8f04-4b22c821059c None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:55.829755 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afff336-9f52-4999-b6a4-281eb2a6d272 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:55.860241 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 307/623] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:12:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 02:12:55.861609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fefad-9ae0-474d-8f04-4b22c821059c None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:55.863335 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a8117-924f-4880-a2aa-7454187e5dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:55.863925 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a8117-924f-4880-a2aa-7454187e5dcb None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:55.864203 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a8117-924f-4880-a2aa-7454187e5dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:55.864475 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a8117-924f-4880-a2aa-7454187e5dcb None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:55.865390 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a8117-924f-4880-a2aa-7454187e5dcb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:55.865691 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a8117-924f-4880-a2aa-7454187e5dcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:55.867085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a8117-924f-4880-a2aa-7454187e5dcb None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:55.872114 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 317/624] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Oct 19 02:12:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:55.872727 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a8117-924f-4880-a2aa-7454187e5dcb None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:55.884405 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:55.926869 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:55.964732 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fefad-9ae0-474d-8f04-4b22c821059c None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:55.972773 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a8117-924f-4880-a2aa-7454187e5dcb None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:55.997865 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c191ce-5846-472a-a736-0b2fe987778a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:55.998484 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c191ce-5846-472a-a736-0b2fe987778a None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:55.998763 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c191ce-5846-472a-a736-0b2fe987778a None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:55.999059 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c191ce-5846-472a-a736-0b2fe987778a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:56.005731 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c191ce-5846-472a-a736-0b2fe987778a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:56.006294 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522493f0-c2a3-48e4-9d9b-0b2e80ec286c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:56.006922 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522493f0-c2a3-48e4-9d9b-0b2e80ec286c None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:56.007211 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522493f0-c2a3-48e4-9d9b-0b2e80ec286c None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:56.007302 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c191ce-5846-472a-a736-0b2fe987778a None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:56.007487 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522493f0-c2a3-48e4-9d9b-0b2e80ec286c None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:56.008117 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522493f0-c2a3-48e4-9d9b-0b2e80ec286c None admin] RBAC: Adding query filter params (type=network) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:56.008418 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522493f0-c2a3-48e4-9d9b-0b2e80ec286c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:56.009765 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522493f0-c2a3-48e4-9d9b-0b2e80ec286c None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:56.014472 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 318/625] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 02:12:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:56.015632 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b7f79-21bb-415b-9a0e-75844724f92b None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:56.015955 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b7f79-21bb-415b-9a0e-75844724f92b None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:56.016269 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b7f79-21bb-415b-9a0e-75844724f92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:56.018342 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-d4c191ce-5846-472a-a736-0b2fe987778a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:56.018342 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:56.018342 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:56.018342 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:56.018342 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:56.018342 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:56.018342 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:56.018342 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:56.018342 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:56.018342 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:56.018342 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:56.018342 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:56.018342 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 02:12:56.018342 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 02:12:56.018342 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 02:12:56.019837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 02:12:56.019837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:56.019837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:56.019837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:56.019837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:56.019837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:56.019837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:56.019837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:56.019837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:56.019837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:56.019837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:56.019837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:56.019837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:56.019837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:56.019837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:56.019837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:56.019837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:56.020945 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 02:12:56.020945 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 02:12:56.020945 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 02:12:56.020945 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 02:12:56.020945 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 02:12:56.020945 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 02:12:56.020945 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:56.020945 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:56.020945 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 308/626] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:12:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:56.020945 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c191ce-5846-472a-a736-0b2fe987778a None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:56.035563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-067b7f79-21bb-415b-9a0e-75844724f92b None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:56.036797 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-067b7f79-21bb-415b-9a0e-75844724f92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:56.102014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 319/627] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:12:56.102839 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b7f79-21bb-415b-9a0e-75844724f92b None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:56.105010 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:56.135086 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c191ce-5846-472a-a736-0b2fe987778a None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:56.160746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:56.171592 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ef6ad-354f-42bc-80b7-0be9e4ddc3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:56.172232 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ef6ad-354f-42bc-80b7-0be9e4ddc3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:56.173106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ef6ad-354f-42bc-80b7-0be9e4ddc3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:56.173386 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ef6ad-354f-42bc-80b7-0be9e4ddc3d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:56.184316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ef6ad-354f-42bc-80b7-0be9e4ddc3d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:56.186081 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ef6ad-354f-42bc-80b7-0be9e4ddc3d3 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:56.205441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-743ef6ad-354f-42bc-80b7-0be9e4ddc3d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:56.205441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:56.205441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:56.205441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:56.205441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:56.205441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:56.205441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:56.205441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:56.205441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:56.205441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:56.205441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:56.205441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:56.205441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:12:56.205441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:12:56.205441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:12:56.205441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:12:56.206449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:56.206449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:56.206449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:56.206449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:56.206449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:56.206449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:56.206449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:56.206449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:56.206449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:56.206449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:56.206449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:56.206449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:56.206449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:56.206449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:56.206449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:56.206449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:56.206449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:12:56.207732 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:12:56.207732 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:12:56.207732 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:56.207732 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 309/628] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:56.207732 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ef6ad-354f-42bc-80b7-0be9e4ddc3d3 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:56.214176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b7f79-21bb-415b-9a0e-75844724f92b None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:56.251104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb70b70-5bd6-416a-a36c-8ae6e3c50be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:56.251679 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb70b70-5bd6-416a-a36c-8ae6e3c50be8 None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:56.251959 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb70b70-5bd6-416a-a36c-8ae6e3c50be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:56.252234 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb70b70-5bd6-416a-a36c-8ae6e3c50be8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:56.252904 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb70b70-5bd6-416a-a36c-8ae6e3c50be8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:56.254737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb70b70-5bd6-416a-a36c-8ae6e3c50be8 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:56.314747 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ef6ad-354f-42bc-80b7-0be9e4ddc3d3 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:56.347260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6192d-3cb6-4cf3-b06f-782fa539b911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:56.347866 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6192d-3cb6-4cf3-b06f-782fa539b911 None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:56.348143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6192d-3cb6-4cf3-b06f-782fa539b911 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:56.348413 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6192d-3cb6-4cf3-b06f-782fa539b911 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:56.349067 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6192d-3cb6-4cf3-b06f-782fa539b911 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:56.350430 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6192d-3cb6-4cf3-b06f-782fa539b911 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:56.381920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 320/629] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:12:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:12:56.382752 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb70b70-5bd6-416a-a36c-8ae6e3c50be8 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:56.433225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 310/630] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:12:56 2022] POST /identity/v3/endpoints => generated 337 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:12:56.434099 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6192d-3cb6-4cf3-b06f-782fa539b911 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:56.465399 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:56.477804 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:56.544870 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb70b70-5bd6-416a-a36c-8ae6e3c50be8 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:56.575347 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6192d-3cb6-4cf3-b06f-782fa539b911 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:56.596380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a645340-0fc3-46a0-a86f-ab44df281936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:56.597753 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a645340-0fc3-46a0-a86f-ab44df281936 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:56.598546 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a645340-0fc3-46a0-a86f-ab44df281936 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:56.599012 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a645340-0fc3-46a0-a86f-ab44df281936 None admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:56.599955 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a645340-0fc3-46a0-a86f-ab44df281936 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:56.600418 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a645340-0fc3-46a0-a86f-ab44df281936 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:56.602062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a645340-0fc3-46a0-a86f-ab44df281936 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:56.618617 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 321/631] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 02:12:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:56.619724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a645340-0fc3-46a0-a86f-ab44df281936 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:56.621811 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38983d27-c121-427b-b222-f6ac0d42bf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:56.622432 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38983d27-c121-427b-b222-f6ac0d42bf2f None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:56.622730 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38983d27-c121-427b-b222-f6ac0d42bf2f None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:56.623159 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38983d27-c121-427b-b222-f6ac0d42bf2f None admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:56.623763 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38983d27-c121-427b-b222-f6ac0d42bf2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:56.624068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38983d27-c121-427b-b222-f6ac0d42bf2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:56.626115 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38983d27-c121-427b-b222-f6ac0d42bf2f None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:56.640731 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 311/632] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:56.641930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38983d27-c121-427b-b222-f6ac0d42bf2f None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:56.751819 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:56.754396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a645340-0fc3-46a0-a86f-ab44df281936 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:56.768625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38983d27-c121-427b-b222-f6ac0d42bf2f None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:56.771665 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:56.793374 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd3c34-4cfa-46a7-bc5a-8a6ac4a0edd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:56.793980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd3c34-4cfa-46a7-bc5a-8a6ac4a0edd7 None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:56.794253 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd3c34-4cfa-46a7-bc5a-8a6ac4a0edd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:56.794522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd3c34-4cfa-46a7-bc5a-8a6ac4a0edd7 None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:56.795199 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd3c34-4cfa-46a7-bc5a-8a6ac4a0edd7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:56.796553 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd3c34-4cfa-46a7-bc5a-8a6ac4a0edd7 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:56.807476 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7a138-b542-40b7-a4d8-e2528b3544e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:56.808163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7a138-b542-40b7-a4d8-e2528b3544e8 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:56.808526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7a138-b542-40b7-a4d8-e2528b3544e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:56.808864 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7a138-b542-40b7-a4d8-e2528b3544e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:56.809911 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7a138-b542-40b7-a4d8-e2528b3544e8 None admin] RBAC: Adding query filter params (role.id=abb44cb94d7c46d3955fd92860aff94d, scope.project.id=91449401454c493cbf423888db8b8454, user.id=e58cdf090af44b508767e821be2f379f) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:56.810308 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7a138-b542-40b7-a4d8-e2528b3544e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:56.811913 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7a138-b542-40b7-a4d8-e2528b3544e8 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:56.817914 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 312/633] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 02:12:56 2022] GET /identity/v3/role_assignments?user.id=e58cdf090af44b508767e821be2f379f&scope.project.id=91449401454c493cbf423888db8b8454&role.id=abb44cb94d7c46d3955fd92860aff94d => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:56.818774 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7a138-b542-40b7-a4d8-e2528b3544e8 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:56.896320 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 322/634] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 02:12:56 2022] POST /identity/v3/services => generated 269 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:12:56.949021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7a138-b542-40b7-a4d8-e2528b3544e8 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:56.999548 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b6839-9327-4681-93d3-7842bc3cb66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:57.001125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b6839-9327-4681-93d3-7842bc3cb66e None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:57.001606 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b6839-9327-4681-93d3-7842bc3cb66e None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:57.002116 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b6839-9327-4681-93d3-7842bc3cb66e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:57.010622 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b6839-9327-4681-93d3-7842bc3cb66e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:57.012482 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b6839-9327-4681-93d3-7842bc3cb66e None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:57.026395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-873b6839-9327-4681-93d3-7842bc3cb66e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:57.026395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:57.026395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:57.026395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:57.026395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:57.026395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:57.026395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:57.026395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:57.026395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:57.026395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:57.026395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:57.026395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:57.026395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 02:12:57.026395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 02:12:57.026395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 02:12:57.027537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 02:12:57.027537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:57.027537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:57.027537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:57.027537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:57.027537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:57.027537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:57.027537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:57.027537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:57.027537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:57.027537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:57.027537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:57.027537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:57.027537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:57.027537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:57.027537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:57.027537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:57.028631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 02:12:57.028631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 02:12:57.028631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 02:12:57.028631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 02:12:57.028631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 02:12:57.028631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 02:12:57.028631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:12:57.028631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:57.030419 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 313/635] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:12:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:57.037337 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd3c34-4cfa-46a7-bc5a-8a6ac4a0edd7 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:57.160703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd3c34-4cfa-46a7-bc5a-8a6ac4a0edd7 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:57.198352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763844b0-70c4-4731-b597-e5b29ccb945e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:57.199002 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763844b0-70c4-4731-b597-e5b29ccb945e None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:57.199277 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763844b0-70c4-4731-b597-e5b29ccb945e None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:57.199545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763844b0-70c4-4731-b597-e5b29ccb945e None admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:57.200236 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763844b0-70c4-4731-b597-e5b29ccb945e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:57.200533 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763844b0-70c4-4731-b597-e5b29ccb945e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:57.201963 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763844b0-70c4-4731-b597-e5b29ccb945e None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:57.221341 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 323/636] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 02:12:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:57.227529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b6839-9327-4681-93d3-7842bc3cb66e None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:57.243225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:57.335004 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b6839-9327-4681-93d3-7842bc3cb66e None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:57.373975 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37767011-6805-4f25-b7d3-ae3466f4aab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:57.374970 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37767011-6805-4f25-b7d3-ae3466f4aab7 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:57.375514 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37767011-6805-4f25-b7d3-ae3466f4aab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:57.376011 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37767011-6805-4f25-b7d3-ae3466f4aab7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:57.377004 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37767011-6805-4f25-b7d3-ae3466f4aab7 None admin] RBAC: Adding query filter params (role.id=e2e7c80d19c141bc9f9bfc13c2ec2a12, scope.project.id=91449401454c493cbf423888db8b8454, user.id=f906e9835f5c4e709915c6553b41aeff) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:57.377514 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37767011-6805-4f25-b7d3-ae3466f4aab7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:57.379195 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37767011-6805-4f25-b7d3-ae3466f4aab7 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:57.390984 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 314/637] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 02:12:57 2022] GET /identity/v3/role_assignments?user.id=f906e9835f5c4e709915c6553b41aeff&scope.project.id=91449401454c493cbf423888db8b8454&role.id=e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:58.641318 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb8e8d-3a08-4bcc-8bed-9f78bdcec980 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:58.642030 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb8e8d-3a08-4bcc-8bed-9f78bdcec980 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:58.642333 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb8e8d-3a08-4bcc-8bed-9f78bdcec980 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:58.643962 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 324/638] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:58.649414 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1321d6-6619-46a5-934a-cd5c6d0eb6a8 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:58.649843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1321d6-6619-46a5-934a-cd5c6d0eb6a8 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:58.650014 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1321d6-6619-46a5-934a-cd5c6d0eb6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:58.669144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-8e1321d6-6619-46a5-934a-cd5c6d0eb6a8 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:58.670326 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-8e1321d6-6619-46a5-934a-cd5c6d0eb6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:58.747765 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 315/639] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:58 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:12:59.025756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb8e8d-3a08-4bcc-8bed-9f78bdcec980 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:59.070722 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:59.149520 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb8e8d-3a08-4bcc-8bed-9f78bdcec980 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:59.167170 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851bcc4-d404-48bd-822b-dd139fa01be2 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:59.167475 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851bcc4-d404-48bd-822b-dd139fa01be2 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:59.167726 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851bcc4-d404-48bd-822b-dd139fa01be2 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:59.170885 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 316/640] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:59.175191 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd03180-c89c-44aa-9250-7d71c4d50a54 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:59.175477 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd03180-c89c-44aa-9250-7d71c4d50a54 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:59.175750 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd03180-c89c-44aa-9250-7d71c4d50a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:59.182545 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:59.192849 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c6227-3967-4a3f-889c-850c264a71f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:59.193486 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c6227-3967-4a3f-889c-850c264a71f2 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:59.193762 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c6227-3967-4a3f-889c-850c264a71f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:59.194031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c6227-3967-4a3f-889c-850c264a71f2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:59.194692 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c6227-3967-4a3f-889c-850c264a71f2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:59.196156 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c6227-3967-4a3f-889c-850c264a71f2 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:59.197201 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-9cd03180-c89c-44aa-9250-7d71c4d50a54 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:59.198388 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-9cd03180-c89c-44aa-9250-7d71c4d50a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:59.206322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-166c6227-3967-4a3f-889c-850c264a71f2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 02:12:59.206322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:59.206322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:12:59.206322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:12:59.206322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:12:59.206322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:12:59.206322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:12:59.206322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:12:59.206322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 02:12:59.206322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:59.206322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:12:59.206322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:59.206322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:59.206322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:59.206322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:59.206322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:59.206322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:59.207566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:59.207566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:59.207566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:59.207566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:59.207566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:59.207566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:59.207566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:12:59.207566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:12:59.207566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:12:59.207566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:12:59.207566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:59.207566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:59.207566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:59.207566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:59.207566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:59.207566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:59.208406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:59.208406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:59.208406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:59.208406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:59.208406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:59.208406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:59.208406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:59.208406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:59.208406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:59.208406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:59.208406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:12:59.208406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:12:59.208406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 02:12:59.208406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:59.208406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 325/641] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 02:12:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:59.209200 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b28e4a-5adb-488e-af36-d43de3d3a708 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:59.209433 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b28e4a-5adb-488e-af36-d43de3d3a708 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:59.209708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b28e4a-5adb-488e-af36-d43de3d3a708 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:59.211264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 326/642] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:59.217056 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b28e4a-5adb-488e-af36-d43de3d3a708 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:59.279357 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 317/643] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:59 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:12:59.280575 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03050e77-4577-48a7-ac77-8a0db10f6977 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:59.281079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03050e77-4577-48a7-ac77-8a0db10f6977 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:59.281271 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03050e77-4577-48a7-ac77-8a0db10f6977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:59.313760 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-03050e77-4577-48a7-ac77-8a0db10f6977 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:59.315285 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-03050e77-4577-48a7-ac77-8a0db10f6977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:59.329849 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:59.335168 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b28e4a-5adb-488e-af36-d43de3d3a708 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:59.371311 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678c176-b4c8-4340-8050-c9963f669054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:59.372035 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678c176-b4c8-4340-8050-c9963f669054 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:59.372315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678c176-b4c8-4340-8050-c9963f669054 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:59.372587 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678c176-b4c8-4340-8050-c9963f669054 None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:59.373234 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678c176-b4c8-4340-8050-c9963f669054 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:59.374596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678c176-b4c8-4340-8050-c9963f669054 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:59.376282 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678c176-b4c8-4340-8050-c9963f669054 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:59.381567 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 327/644] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 02:12:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:59.386764 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678c176-b4c8-4340-8050-c9963f669054 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:59.411131 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 318/645] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:59 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:12:59.492042 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678c176-b4c8-4340-8050-c9963f669054 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:59.532052 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b86b6f-88af-4168-985b-ec492192d552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:59.532588 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b86b6f-88af-4168-985b-ec492192d552 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:59.532866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b86b6f-88af-4168-985b-ec492192d552 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:59.533141 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b86b6f-88af-4168-985b-ec492192d552 None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:59.533784 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b86b6f-88af-4168-985b-ec492192d552 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:59.534089 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b86b6f-88af-4168-985b-ec492192d552 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:59.535488 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b86b6f-88af-4168-985b-ec492192d552 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:59.541092 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 328/646] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 02:12:59 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:12:59.551385 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03050e77-4577-48a7-ac77-8a0db10f6977 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:59.625425 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457deb1-f12d-4a47-a461-71b2baa1eade None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:59.626301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457deb1-f12d-4a47-a461-71b2baa1eade None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:59.626393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:59.626472 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457deb1-f12d-4a47-a461-71b2baa1eade None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:59.627605 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 329/647] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:12:59.633216 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341f0ca-4328-4963-a599-47a2fd2afff3 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:59.633499 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341f0ca-4328-4963-a599-47a2fd2afff3 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:59.633780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341f0ca-4328-4963-a599-47a2fd2afff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:59.657738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-a341f0ca-4328-4963-a599-47a2fd2afff3 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:12:59.659127 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-a341f0ca-4328-4963-a599-47a2fd2afff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:12:59.684252 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:59.685937 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03050e77-4577-48a7-ac77-8a0db10f6977 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:59.736597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b9bd8-1056-4f2f-8971-daec1cbc2056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:59.738015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b9bd8-1056-4f2f-8971-daec1cbc2056 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:59.738015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b9bd8-1056-4f2f-8971-daec1cbc2056 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:59.738015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b9bd8-1056-4f2f-8971-daec1cbc2056 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:59.745388 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 330/648] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:12:59 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 02:12:59.746066 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341f0ca-4328-4963-a599-47a2fd2afff3 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:59.754262 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b9bd8-1056-4f2f-8971-daec1cbc2056 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:12:59.759923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-af5b9bd8-1056-4f2f-8971-daec1cbc2056 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 02:12:59.759923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:59.759923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:59.759923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:59.759923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:59.759923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:59.759923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:59.759923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:59.759923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:59.759923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:59.759923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:59.759923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:59.759923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:12:59.759923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:12:59.759923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:12:59.759923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:12:59.760856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:12:59.760856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:12:59.760856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:12:59.760856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:12:59.760856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:59.760856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:59.760856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:59.760856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:59.760856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:59.760856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:59.760856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:59.760856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:59.760856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:59.760856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:59.760856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:59.760856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:59.761687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:59.761687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:59.761687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:59.761687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:59.761687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:12:59.761687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:12:59.761687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:12:59.761687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:12:59.761687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:12:59.761687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:12:59.761687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 02:12:59.761687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:12:59.764518 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 319/649] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 19 02:12:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:59.770878 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b9bd8-1056-4f2f-8971-daec1cbc2056 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:59.857668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341f0ca-4328-4963-a599-47a2fd2afff3 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:59.901309 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bb5d9-39b2-4ee3-b5ee-71bc83984e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:59.902033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bb5d9-39b2-4ee3-b5ee-71bc83984e1d None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:59.902322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b9bd8-1056-4f2f-8971-daec1cbc2056 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:12:59.902437 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bb5d9-39b2-4ee3-b5ee-71bc83984e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:59.902725 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bb5d9-39b2-4ee3-b5ee-71bc83984e1d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:59.903401 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bb5d9-39b2-4ee3-b5ee-71bc83984e1d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:59.905980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bb5d9-39b2-4ee3-b5ee-71bc83984e1d None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:59.918254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-4c8bb5d9-39b2-4ee3-b5ee-71bc83984e1d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 02:12:59.918254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:59.918254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:12:59.918254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:12:59.918254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:12:59.918254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:12:59.918254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:12:59.918254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:12:59.918254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 02:12:59.918254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:59.918254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:12:59.918254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:59.918254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:12:59.918254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:12:59.918254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:12:59.918254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:12:59.919285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:12:59.919285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:12:59.919285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:12:59.919285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:12:59.919285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:12:59.919285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:12:59.919285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:12:59.919285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:12:59.919285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:12:59.919285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:12:59.919285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:12:59.919285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:12:59.919285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:12:59.919285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:12:59.919285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:12:59.919285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:12:59.919285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:12:59.920172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:12:59.920172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:12:59.920172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:12:59.920172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:12:59.920172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:12:59.920172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:12:59.920172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:12:59.920172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:12:59.920172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:12:59.920172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:12:59.920172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:12:59.920172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:12:59.920172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 02:12:59.920172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:12:59.922907 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 331/650] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Oct 19 02:12:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:12:59.926041 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bb5d9-39b2-4ee3-b5ee-71bc83984e1d None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:12:59.933617 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:59.951942 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d1d49-7f1c-406c-9a78-9e02438c9bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:12:59.953266 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:59.954373 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d1d49-7f1c-406c-9a78-9e02438c9bdf None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:12:59.965601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d1d49-7f1c-406c-9a78-9e02438c9bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:12:59.965601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d1d49-7f1c-406c-9a78-9e02438c9bdf None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:12:59.965601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d1d49-7f1c-406c-9a78-9e02438c9bdf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:12:59.965601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d1d49-7f1c-406c-9a78-9e02438c9bdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:12:59.965601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d1d49-7f1c-406c-9a78-9e02438c9bdf None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:12:59.970272 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 320/651] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Oct 19 02:12:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:12:59.975987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d1d49-7f1c-406c-9a78-9e02438c9bdf None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:00.049505 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bb5d9-39b2-4ee3-b5ee-71bc83984e1d None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:00.088530 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65717e27-51a0-4b5f-be0d-081258809b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:00.089136 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65717e27-51a0-4b5f-be0d-081258809b2c None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:00.089414 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65717e27-51a0-4b5f-be0d-081258809b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:00.089686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65717e27-51a0-4b5f-be0d-081258809b2c None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:00.090312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65717e27-51a0-4b5f-be0d-081258809b2c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:00.090695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65717e27-51a0-4b5f-be0d-081258809b2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:00.090880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d1d49-7f1c-406c-9a78-9e02438c9bdf None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:00.092095 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65717e27-51a0-4b5f-be0d-081258809b2c None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:00.102153 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 332/652] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 19 02:12:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:13:00.102153 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65717e27-51a0-4b5f-be0d-081258809b2c None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:00.134777 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f511a75-dba5-46be-91d3-b98fc2a94b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:00.135362 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f511a75-dba5-46be-91d3-b98fc2a94b52 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:00.135636 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f511a75-dba5-46be-91d3-b98fc2a94b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:00.135904 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f511a75-dba5-46be-91d3-b98fc2a94b52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:00.147846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f511a75-dba5-46be-91d3-b98fc2a94b52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:00.149297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f511a75-dba5-46be-91d3-b98fc2a94b52 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:00.164193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-6f511a75-dba5-46be-91d3-b98fc2a94b52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:13:00.164193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:00.164193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:00.164193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:00.164193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:00.164193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:00.164193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:00.164193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:00.164193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:00.164193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:00.164193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:00.164193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:00.164193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:13:00.164193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:13:00.164193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:13:00.164193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:13:00.165148 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:00.165148 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:00.165148 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:00.165148 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:00.165148 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:00.165148 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:00.165148 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:00.165148 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:00.165148 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:00.165148 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:00.165148 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:00.165148 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:00.165148 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:00.165148 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:00.165148 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:00.165148 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:00.165148 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:13:00.166021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:13:00.166021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:13:00.166021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:00.166021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 321/653] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:13:00.166021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f511a75-dba5-46be-91d3-b98fc2a94b52 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:00.200221 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:00.206191 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:00.224820 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65717e27-51a0-4b5f-be0d-081258809b2c None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:00.263059 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fb787-8583-485a-85eb-8136dd55075a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:00.264242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fb787-8583-485a-85eb-8136dd55075a None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:00.264902 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fb787-8583-485a-85eb-8136dd55075a None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:00.265393 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fb787-8583-485a-85eb-8136dd55075a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:00.266996 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4fb787-8583-485a-85eb-8136dd55075a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:00.268919 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4fb787-8583-485a-85eb-8136dd55075a None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:00.274782 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f511a75-dba5-46be-91d3-b98fc2a94b52 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:00.280975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-7c4fb787-8583-485a-85eb-8136dd55075a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 02:13:00.280975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:00.280975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:13:00.280975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:13:00.280975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:13:00.280975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:13:00.280975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:13:00.280975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:00.280975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 02:13:00.280975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:00.280975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:13:00.280975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:00.280975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:00.280975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:00.280975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:00.280975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:00.280975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:00.287288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:00.287288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:00.287288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:00.287288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:00.287288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:00.287288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:00.287288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:13:00.287288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:13:00.287288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:13:00.287288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:13:00.287288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:00.287288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:00.287288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:00.287288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:00.287288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:00.287288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:00.288131 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:00.288131 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:00.288131 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:00.288131 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:00.288131 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:00.288131 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:00.288131 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:00.288131 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:00.288131 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:00.288131 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:00.288131 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:13:00.288131 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:00.288131 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 02:13:00.288131 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:00.288131 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 333/654] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 19 02:13:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:00.289072 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fb787-8583-485a-85eb-8136dd55075a None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:00.314515 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f0fd4-b7ba-48cd-bf8e-500413385df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:00.315533 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f0fd4-b7ba-48cd-bf8e-500413385df0 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:00.315945 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f0fd4-b7ba-48cd-bf8e-500413385df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:00.316411 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f0fd4-b7ba-48cd-bf8e-500413385df0 None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:00.317339 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f0fd4-b7ba-48cd-bf8e-500413385df0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:00.317845 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f0fd4-b7ba-48cd-bf8e-500413385df0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:00.319714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f0fd4-b7ba-48cd-bf8e-500413385df0 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:00.331649 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 322/655] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 19 02:13:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:00.331649 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f0fd4-b7ba-48cd-bf8e-500413385df0 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:00.405726 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fb787-8583-485a-85eb-8136dd55075a None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:00.434328 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:00.438673 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f0fd4-b7ba-48cd-bf8e-500413385df0 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:00.444798 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f76ce-86d3-426a-83f2-e1ea2f807b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:00.445425 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f76ce-86d3-426a-83f2-e1ea2f807b76 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:00.445704 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f76ce-86d3-426a-83f2-e1ea2f807b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:00.454267 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f76ce-86d3-426a-83f2-e1ea2f807b76 None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:00.454267 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f76ce-86d3-426a-83f2-e1ea2f807b76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:00.454267 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f76ce-86d3-426a-83f2-e1ea2f807b76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:00.454267 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f76ce-86d3-426a-83f2-e1ea2f807b76 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:00.462563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 334/656] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:00.463289 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f76ce-86d3-426a-83f2-e1ea2f807b76 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:00.476429 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:00.487158 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a41de-a3b8-467c-8480-5674035e9bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:00.487764 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a41de-a3b8-467c-8480-5674035e9bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:00.488038 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a41de-a3b8-467c-8480-5674035e9bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:00.488333 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a41de-a3b8-467c-8480-5674035e9bf4 None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:00.489342 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a41de-a3b8-467c-8480-5674035e9bf4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:00.489643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a41de-a3b8-467c-8480-5674035e9bf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:00.491518 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a41de-a3b8-467c-8480-5674035e9bf4 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:00.502170 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 323/657] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 19 02:13:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:00.502170 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a41de-a3b8-467c-8480-5674035e9bf4 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:00.574346 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f76ce-86d3-426a-83f2-e1ea2f807b76 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:00.609171 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a41de-a3b8-467c-8480-5674035e9bf4 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:00.611706 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fff92-dc72-4aa5-88aa-1512c20b1888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:00.612328 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fff92-dc72-4aa5-88aa-1512c20b1888 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:00.612601 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fff92-dc72-4aa5-88aa-1512c20b1888 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:00.612869 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fff92-dc72-4aa5-88aa-1512c20b1888 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:00.613567 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fff92-dc72-4aa5-88aa-1512c20b1888 None admin] RBAC: Adding query filter params (interface=public, service_id=852da86549784a768ff14217d98ae7b3, region_id=RegionOne) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:00.613876 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fff92-dc72-4aa5-88aa-1512c20b1888 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:00.615268 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fff92-dc72-4aa5-88aa-1512c20b1888 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:00.620444 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 335/658] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 19 02:13:00 2022] GET /identity/v3/endpoints?service_id=852da86549784a768ff14217d98ae7b3&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:00.621218 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fff92-dc72-4aa5-88aa-1512c20b1888 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:00.652173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2cfb6-c7a5-47e1-b3a3-ac3eaa4f98fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:00.652839 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2cfb6-c7a5-47e1-b3a3-ac3eaa4f98fb None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:00.653122 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2cfb6-c7a5-47e1-b3a3-ac3eaa4f98fb None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:00.653391 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2cfb6-c7a5-47e1-b3a3-ac3eaa4f98fb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:00.661366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2cfb6-c7a5-47e1-b3a3-ac3eaa4f98fb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:00.662756 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2cfb6-c7a5-47e1-b3a3-ac3eaa4f98fb None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:00.674714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-9ba2cfb6-c7a5-47e1-b3a3-ac3eaa4f98fb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 02:13:00.674714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:00.674714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:00.674714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:00.674714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:00.674714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:00.674714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:00.674714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:00.674714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:00.674714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:00.674714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:00.674714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:00.674714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 02:13:00.674714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 02:13:00.674714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 02:13:00.674714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 02:13:00.675701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:00.675701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:00.675701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:13:00.675701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:13:00.675701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:13:00.675701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:13:00.675701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:00.675701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:00.675701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:00.675701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:00.675701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:00.675701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:00.675701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:00.675701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:00.675701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:00.675701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:00.675701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:00.675701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:00.676643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:00.676643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:00.676643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 02:13:00.676643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 02:13:00.676643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 02:13:00.676643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 02:13:00.676643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 02:13:00.676643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 02:13:00.676643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 02:13:00.676643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:00.676643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 324/659] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 19 02:13:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:00.676643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2cfb6-c7a5-47e1-b3a3-ac3eaa4f98fb None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:00.706435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:00.709030 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:00.737580 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fff92-dc72-4aa5-88aa-1512c20b1888 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:00.773645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4f6dc-2594-45cf-ba29-483c64c28ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:00.774257 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4f6dc-2594-45cf-ba29-483c64c28ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:00.774535 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4f6dc-2594-45cf-ba29-483c64c28ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:00.774808 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4f6dc-2594-45cf-ba29-483c64c28ee8 None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:00.775464 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4f6dc-2594-45cf-ba29-483c64c28ee8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:00.775770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4f6dc-2594-45cf-ba29-483c64c28ee8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:00.777133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4f6dc-2594-45cf-ba29-483c64c28ee8 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:00.781990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 336/660] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 19 02:13:00 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:00.782793 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4f6dc-2594-45cf-ba29-483c64c28ee8 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:00.797718 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2cfb6-c7a5-47e1-b3a3-ac3eaa4f98fb None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:00.855764 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf8e13-9452-4528-8d81-45374334d7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:00.856657 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf8e13-9452-4528-8d81-45374334d7ad None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:00.857829 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf8e13-9452-4528-8d81-45374334d7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:00.858266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf8e13-9452-4528-8d81-45374334d7ad None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:00.859371 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf8e13-9452-4528-8d81-45374334d7ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:00.862763 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf8e13-9452-4528-8d81-45374334d7ad None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:00.871538 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 325/661] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 19 02:13:00 2022] GET /identity/v3/services => generated 1029 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:13:00.918857 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4f6dc-2594-45cf-ba29-483c64c28ee8 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:00.965195 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1649d85-d8dc-4c59-a5af-e7e76952263c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:00.965827 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1649d85-d8dc-4c59-a5af-e7e76952263c None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:00.966107 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1649d85-d8dc-4c59-a5af-e7e76952263c None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:00.966378 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1649d85-d8dc-4c59-a5af-e7e76952263c None admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:00.967172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1649d85-d8dc-4c59-a5af-e7e76952263c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:00.967477 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1649d85-d8dc-4c59-a5af-e7e76952263c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:00.969212 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1649d85-d8dc-4c59-a5af-e7e76952263c None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:00.972652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:00.991218 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 337/662] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Oct 19 02:13:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:00.996822 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf8e13-9452-4528-8d81-45374334d7ad None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:01.103828 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:01.116414 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf8e13-9452-4528-8d81-45374334d7ad None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:01.154130 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8431e71-43a0-4f5c-93d2-49894cc41a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:01.154764 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8431e71-43a0-4f5c-93d2-49894cc41a09 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:01.155073 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8431e71-43a0-4f5c-93d2-49894cc41a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:01.155348 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8431e71-43a0-4f5c-93d2-49894cc41a09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:01.166242 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8431e71-43a0-4f5c-93d2-49894cc41a09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:01.167778 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8431e71-43a0-4f5c-93d2-49894cc41a09 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:01.183544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-d8431e71-43a0-4f5c-93d2-49894cc41a09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:13:01.183544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:01.183544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:01.183544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:01.183544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:01.183544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:01.183544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:01.183544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:01.183544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:01.183544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:01.183544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:01.183544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:01.183544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:13:01.183544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:13:01.183544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:13:01.183544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:13:01.184977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:01.184977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:01.184977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:01.184977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:01.184977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:01.184977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:01.184977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:01.184977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:01.184977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:01.184977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:01.184977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:01.184977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:01.184977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:01.184977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:01.184977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:01.184977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:01.184977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:13:01.186065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:13:01.186065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:13:01.186065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:01.190050 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 326/663] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:13:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:01.191514 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1649d85-d8dc-4c59-a5af-e7e76952263c None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:01.299176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1649d85-d8dc-4c59-a5af-e7e76952263c None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:01.335777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf15a28-9f8b-4080-81e0-c7d68febb0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:01.336400 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf15a28-9f8b-4080-81e0-c7d68febb0de None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:01.336684 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf15a28-9f8b-4080-81e0-c7d68febb0de None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:01.336963 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf15a28-9f8b-4080-81e0-c7d68febb0de None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:01.337615 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf15a28-9f8b-4080-81e0-c7d68febb0de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:01.337923 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf15a28-9f8b-4080-81e0-c7d68febb0de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:01.339480 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf15a28-9f8b-4080-81e0-c7d68febb0de None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:01.357189 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 338/664] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:01.358523 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8431e71-43a0-4f5c-93d2-49894cc41a09 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:01.466198 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8431e71-43a0-4f5c-93d2-49894cc41a09 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:01.502549 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572706a8-4467-41a1-925f-6842d4bf6f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:01.503207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572706a8-4467-41a1-925f-6842d4bf6f78 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:01.503533 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572706a8-4467-41a1-925f-6842d4bf6f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:01.503808 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572706a8-4467-41a1-925f-6842d4bf6f78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:01.510932 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572706a8-4467-41a1-925f-6842d4bf6f78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:01.512391 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572706a8-4467-41a1-925f-6842d4bf6f78 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:01.514984 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:01.524601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-572706a8-4467-41a1-925f-6842d4bf6f78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:13:01.524601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:01.524601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:01.524601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:01.524601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:01.524601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:01.524601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:01.524601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:01.524601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:01.524601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:01.524601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:01.524601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:01.524601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 02:13:01.524601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 02:13:01.524601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 02:13:01.525554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 02:13:01.525554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:01.525554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:01.525554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:01.525554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:01.525554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:01.525554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:01.525554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:01.525554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:01.525554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:01.525554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:01.525554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:01.525554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:01.525554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:01.525554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:01.525554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:01.525554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:01.526440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 02:13:01.526440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 02:13:01.526440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 02:13:01.526440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 02:13:01.526440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 02:13:01.526440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 02:13:01.526440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:13:01.526440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:01.530521 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 327/665] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:13:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:01.531998 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf15a28-9f8b-4080-81e0-c7d68febb0de None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:01.608131 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:01.641898 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf15a28-9f8b-4080-81e0-c7d68febb0de None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:01.681845 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b8649-c642-44ed-a10b-b5abfa462035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:01.682513 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b8649-c642-44ed-a10b-b5abfa462035 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:01.682793 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b8649-c642-44ed-a10b-b5abfa462035 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:01.683102 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b8649-c642-44ed-a10b-b5abfa462035 None admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:01.683814 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b8649-c642-44ed-a10b-b5abfa462035 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:01.684120 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b8649-c642-44ed-a10b-b5abfa462035 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:01.685863 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b8649-c642-44ed-a10b-b5abfa462035 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:01.699803 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 339/666] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 02:13:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:01.706674 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572706a8-4467-41a1-925f-6842d4bf6f78 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:01.784601 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182937e5-6819-45d6-a919-f04f35e4d52c None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:01.784601 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182937e5-6819-45d6-a919-f04f35e4d52c None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:01.784601 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182937e5-6819-45d6-a919-f04f35e4d52c None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:01.785251 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 340/667] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:01.790111 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5758b-f75a-442e-8c03-1bf9a2a1ffb4 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:01.790396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5758b-f75a-442e-8c03-1bf9a2a1ffb4 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:01.790673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5758b-f75a-442e-8c03-1bf9a2a1ffb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:01.811697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-74f5758b-f75a-442e-8c03-1bf9a2a1ffb4 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:01.812966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-74f5758b-f75a-442e-8c03-1bf9a2a1ffb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:01.823725 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572706a8-4467-41a1-925f-6842d4bf6f78 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:01.865118 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca880d0-19f5-4c88-9d77-33d3b90fa005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:01.866874 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca880d0-19f5-4c88-9d77-33d3b90fa005 None admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:01.867385 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca880d0-19f5-4c88-9d77-33d3b90fa005 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:01.868161 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca880d0-19f5-4c88-9d77-33d3b90fa005 None admin] PATH_INFO: `/v3/projects/91449401454c493cbf423888db8b8454/users/e58cdf090af44b508767e821be2f379f/roles/2d76ac736d7141f285d30dcda647e0f4` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:01.871336 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca880d0-19f5-4c88-9d77-33d3b90fa005 None admin] RBAC: Authorizing `identity:create_grant(project_id=91449401454c493cbf423888db8b8454, user_id=e58cdf090af44b508767e821be2f379f, role_id=2d76ac736d7141f285d30dcda647e0f4)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:01.873123 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca880d0-19f5-4c88-9d77-33d3b90fa005 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:01.889220 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 341/668] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:01 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 02:13:01.970923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 328/669] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 02:13:01 2022] PUT /identity/v3/projects/91449401454c493cbf423888db8b8454/users/e58cdf090af44b508767e821be2f379f/roles/2d76ac736d7141f285d30dcda647e0f4 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:13:02.170044 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5758b-f75a-442e-8c03-1bf9a2a1ffb4 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:02.221473 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:02.279535 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5758b-f75a-442e-8c03-1bf9a2a1ffb4 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:02.316137 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5415b-190d-4eeb-b9bb-5ca2509cee04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:02.317073 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5415b-190d-4eeb-b9bb-5ca2509cee04 None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:02.317521 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5415b-190d-4eeb-b9bb-5ca2509cee04 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:02.318701 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5415b-190d-4eeb-b9bb-5ca2509cee04 None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:02.318701 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5415b-190d-4eeb-b9bb-5ca2509cee04 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:02.320360 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5415b-190d-4eeb-b9bb-5ca2509cee04 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:02.433433 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 342/670] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 02:13:02 2022] POST /identity/v3/services => generated 251 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:13:03.061693 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccdacf-99b7-4741-9829-e41ac6a642fc None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:03.062233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccdacf-99b7-4741-9829-e41ac6a642fc None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:03.062233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccdacf-99b7-4741-9829-e41ac6a642fc None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:03.064627 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 329/671] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:03.070524 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b4cb7-39ef-47f0-9aeb-61c11085ebf6 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:03.071076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b4cb7-39ef-47f0-9aeb-61c11085ebf6 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:03.071153 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b4cb7-39ef-47f0-9aeb-61c11085ebf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:03.091508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-956b4cb7-39ef-47f0-9aeb-61c11085ebf6 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:03.092725 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-956b4cb7-39ef-47f0-9aeb-61c11085ebf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:03.168487 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 343/672] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:13:03.188123 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496facd-b1f2-4a9e-b183-ba8149a884ba None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:03.188447 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496facd-b1f2-4a9e-b183-ba8149a884ba None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:03.188673 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496facd-b1f2-4a9e-b183-ba8149a884ba None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:03.190261 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 330/673] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:03.195494 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33439d87-8867-47f2-a9e8-2bd78c4d5d52 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:03.195780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33439d87-8867-47f2-a9e8-2bd78c4d5d52 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:03.196050 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33439d87-8867-47f2-a9e8-2bd78c4d5d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:03.217469 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-33439d87-8867-47f2-a9e8-2bd78c4d5d52 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:03.217469 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-33439d87-8867-47f2-a9e8-2bd78c4d5d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:03.244088 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:03.289458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 344/674] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:13:03.461758 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496facd-b1f2-4a9e-b183-ba8149a884ba None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:03.523235 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:03.563625 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33439d87-8867-47f2-a9e8-2bd78c4d5d52 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:03.568795 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496facd-b1f2-4a9e-b183-ba8149a884ba None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:03.615357 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffe915-f1b8-4e66-a89d-0e9ee6aaf8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:03.616229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffe915-f1b8-4e66-a89d-0e9ee6aaf8a3 None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:03.616514 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffe915-f1b8-4e66-a89d-0e9ee6aaf8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:03.616815 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffe915-f1b8-4e66-a89d-0e9ee6aaf8a3 None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:03.617817 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ffe915-f1b8-4e66-a89d-0e9ee6aaf8a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:03.619222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ffe915-f1b8-4e66-a89d-0e9ee6aaf8a3 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:03.669735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33439d87-8867-47f2-a9e8-2bd78c4d5d52 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:03.702553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 331/675] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 02:13:03 2022] POST /identity/v3/services => generated 241 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:13:03.721887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc247fe-56a1-4a05-a7e0-ccbcb6829fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:03.722795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc247fe-56a1-4a05-a7e0-ccbcb6829fef None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:03.723247 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc247fe-56a1-4a05-a7e0-ccbcb6829fef None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:03.723738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc247fe-56a1-4a05-a7e0-ccbcb6829fef None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:03.724594 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc247fe-56a1-4a05-a7e0-ccbcb6829fef None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:03.726353 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc247fe-56a1-4a05-a7e0-ccbcb6829fef None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:03.737663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-9bc247fe-56a1-4a05-a7e0-ccbcb6829fef None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 02:13:03.737663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:03.737663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:13:03.737663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:13:03.737663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:13:03.737663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:13:03.737663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:13:03.737663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:03.737663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 02:13:03.737663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:03.737663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:13:03.737663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:03.737663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:03.737663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:03.737663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:03.737663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:03.738990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:03.738990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:03.738990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:03.738990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:03.738990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:03.738990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:03.738990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:03.738990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:13:03.738990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:13:03.738990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:13:03.738990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:13:03.738990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:03.738990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:03.738990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:03.738990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:03.738990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:03.738990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:03.740133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:03.740133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:03.740133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:03.740133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:03.740133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:03.740133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:03.740133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:03.740133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:03.740133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:03.740133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:03.740133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:13:03.740133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:03.740133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 02:13:03.740133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:03.742773 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 345/676] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Oct 19 02:13:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:13:03.752008 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffe915-f1b8-4e66-a89d-0e9ee6aaf8a3 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:03.871448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffe915-f1b8-4e66-a89d-0e9ee6aaf8a3 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:03.895720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:03.909059 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b2943-89a4-48f1-b2a3-6432b96e4112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:03.909680 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b2943-89a4-48f1-b2a3-6432b96e4112 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:03.913036 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b2943-89a4-48f1-b2a3-6432b96e4112 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:03.913036 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b2943-89a4-48f1-b2a3-6432b96e4112 None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:03.913036 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b2943-89a4-48f1-b2a3-6432b96e4112 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:03.913036 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b2943-89a4-48f1-b2a3-6432b96e4112 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:03.913036 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b2943-89a4-48f1-b2a3-6432b96e4112 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:03.917835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 332/677] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 19 02:13:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:03.923769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc247fe-56a1-4a05-a7e0-ccbcb6829fef None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:03.949520 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:04.030939 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc247fe-56a1-4a05-a7e0-ccbcb6829fef None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:04.070050 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1498b-c12b-4e94-ad3b-4c4f9581b909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:04.070791 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1498b-c12b-4e94-ad3b-4c4f9581b909 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:04.071355 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1498b-c12b-4e94-ad3b-4c4f9581b909 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:04.071442 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1498b-c12b-4e94-ad3b-4c4f9581b909 None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:04.072327 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1498b-c12b-4e94-ad3b-4c4f9581b909 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:04.072595 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1498b-c12b-4e94-ad3b-4c4f9581b909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:04.074106 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1498b-c12b-4e94-ad3b-4c4f9581b909 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:04.080420 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 346/678] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 19 02:13:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:13:04.088214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b2943-89a4-48f1-b2a3-6432b96e4112 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:04.176810 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9c157-6e48-44dd-bfdf-2c012a568340 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:04.177437 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9c157-6e48-44dd-bfdf-2c012a568340 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:04.177932 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9c157-6e48-44dd-bfdf-2c012a568340 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:04.179891 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 347/679] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 02:13:04.184989 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ea8d1-a43a-48f5-8339-26d12871d109 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:04.185476 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ea8d1-a43a-48f5-8339-26d12871d109 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:04.185584 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ea8d1-a43a-48f5-8339-26d12871d109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:04.195390 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b2943-89a4-48f1-b2a3-6432b96e4112 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:04.205153 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-848ea8d1-a43a-48f5-8339-26d12871d109 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:04.206467 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-848ea8d1-a43a-48f5-8339-26d12871d109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:04.241106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ba4d2-c2c0-4e45-a5ba-f8d9cb1a5101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:04.241719 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ba4d2-c2c0-4e45-a5ba-f8d9cb1a5101 None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:04.242122 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ba4d2-c2c0-4e45-a5ba-f8d9cb1a5101 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:04.242393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ba4d2-c2c0-4e45-a5ba-f8d9cb1a5101 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:04.243089 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ba4d2-c2c0-4e45-a5ba-f8d9cb1a5101 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:04.244490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ba4d2-c2c0-4e45-a5ba-f8d9cb1a5101 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:04.285543 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 348/680] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 02:13:04.334581 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 333/681] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:13:04 2022] POST /identity/v3/endpoints => generated 347 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:13:04.583486 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ea8d1-a43a-48f5-8339-26d12871d109 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:04.601518 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:04.701309 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ea8d1-a43a-48f5-8339-26d12871d109 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:04.746172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc1242-3dd8-42eb-b44b-60b50670abf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:04.746808 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc1242-3dd8-42eb-b44b-60b50670abf1 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:04.747105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc1242-3dd8-42eb-b44b-60b50670abf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:04.747378 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc1242-3dd8-42eb-b44b-60b50670abf1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:04.757700 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc1242-3dd8-42eb-b44b-60b50670abf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:13:04.762672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-95fc1242-3dd8-42eb-b44b-60b50670abf1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 02:13:04.762672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:04.762672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:04.762672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:04.762672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:04.762672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:04.762672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:04.762672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:04.762672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:04.762672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:04.762672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:04.762672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:04.762672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:13:04.762672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:13:04.762672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:13:04.762672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:13:04.763641 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:13:04.763641 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:13:04.763641 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:13:04.763641 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:13:04.763641 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:04.763641 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:04.763641 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:04.763641 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:04.763641 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:04.763641 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:04.763641 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:04.763641 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:04.763641 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:04.763641 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:04.763641 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:04.763641 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:04.764894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:04.764894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:04.764894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:04.764894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:04.764894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:13:04.764894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:13:04.764894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:13:04.764894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:13:04.764894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:13:04.764894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:13:04.764894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 02:13:04.764894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:04.764894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 349/682] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 19 02:13:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:04.772998 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ba4d2-c2c0-4e45-a5ba-f8d9cb1a5101 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:04.820197 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8ae57-5d5b-46a5-8b03-9cde4088eb6a None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:04.820523 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8ae57-5d5b-46a5-8b03-9cde4088eb6a None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:04.820744 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8ae57-5d5b-46a5-8b03-9cde4088eb6a None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:04.821066 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:04.822298 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 350/683] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:04.828628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee73017-ffd7-43db-a52c-c04b6df00ebd None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:04.829476 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee73017-ffd7-43db-a52c-c04b6df00ebd None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:04.829476 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee73017-ffd7-43db-a52c-c04b6df00ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:04.849583 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-5ee73017-ffd7-43db-a52c-c04b6df00ebd None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:04.850738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-5ee73017-ffd7-43db-a52c-c04b6df00ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:04.890325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ba4d2-c2c0-4e45-a5ba-f8d9cb1a5101 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:04.929021 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:04.938977 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 351/684] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 02:13:04.944429 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ffaf2-171a-4592-8551-98c7077f107b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:04.945043 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ffaf2-171a-4592-8551-98c7077f107b None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:04.945315 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ffaf2-171a-4592-8551-98c7077f107b None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:04.945585 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ffaf2-171a-4592-8551-98c7077f107b None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:04.946243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ffaf2-171a-4592-8551-98c7077f107b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:04.946537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ffaf2-171a-4592-8551-98c7077f107b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:04.947923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ffaf2-171a-4592-8551-98c7077f107b None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:04.961842 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 334/685] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Oct 19 02:13:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:04.963254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee73017-ffd7-43db-a52c-c04b6df00ebd None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:05.068816 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee73017-ffd7-43db-a52c-c04b6df00ebd None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:05.105220 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fbf40-4997-4a4b-b428-54dc9af4fe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:05.105918 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fbf40-4997-4a4b-b428-54dc9af4fe48 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:05.106455 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fbf40-4997-4a4b-b428-54dc9af4fe48 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:05.106798 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fbf40-4997-4a4b-b428-54dc9af4fe48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:05.118036 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fbf40-4997-4a4b-b428-54dc9af4fe48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:05.119593 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fbf40-4997-4a4b-b428-54dc9af4fe48 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:05.134717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-309fbf40-4997-4a4b-b428-54dc9af4fe48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:13:05.134717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:05.134717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:05.134717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:05.134717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:05.134717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:05.134717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:05.134717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:05.134717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:05.134717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:05.134717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:05.134717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:05.134717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:13:05.134717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:13:05.134717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:13:05.134717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:13:05.135859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:05.135859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:05.135859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:05.135859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:05.135859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:05.135859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:05.135859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:05.135859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:05.135859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:05.135859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:05.135859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:05.135859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:05.135859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:05.135859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:05.135859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:05.135859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:05.135859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:13:05.136948 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:13:05.136948 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:13:05.136948 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:05.142392 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 352/686] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:13:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:05.143830 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ffaf2-171a-4592-8551-98c7077f107b None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:05.222134 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fbf40-4997-4a4b-b428-54dc9af4fe48 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:05.263789 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ffaf2-171a-4592-8551-98c7077f107b None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:05.266978 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:05.288576 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:05.302830 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1d8c5-4470-4034-bea2-8dd9f2310714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:05.303449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1d8c5-4470-4034-bea2-8dd9f2310714 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:05.303724 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1d8c5-4470-4034-bea2-8dd9f2310714 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:05.303986 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1d8c5-4470-4034-bea2-8dd9f2310714 None admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:05.304677 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c1d8c5-4470-4034-bea2-8dd9f2310714 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:05.304972 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c1d8c5-4470-4034-bea2-8dd9f2310714 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:05.306372 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c1d8c5-4470-4034-bea2-8dd9f2310714 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:05.320105 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 335/687] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:05.325841 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1d8c5-4470-4034-bea2-8dd9f2310714 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:05.343969 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fbf40-4997-4a4b-b428-54dc9af4fe48 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:05.384600 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3bc0d-ad8b-451f-93f5-539092d8377e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:05.385624 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3bc0d-ad8b-451f-93f5-539092d8377e None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:05.386034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3bc0d-ad8b-451f-93f5-539092d8377e None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:05.386418 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3bc0d-ad8b-451f-93f5-539092d8377e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:05.387176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3bc0d-ad8b-451f-93f5-539092d8377e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:05.388643 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3bc0d-ad8b-451f-93f5-539092d8377e None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:05.401312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-29a3bc0d-ad8b-451f-93f5-539092d8377e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 02:13:05.401312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:05.401312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:13:05.401312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:13:05.401312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:13:05.401312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:13:05.401312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:13:05.401312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:05.401312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 02:13:05.401312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:05.401312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:13:05.401312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:05.401312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:05.401312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:05.401312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:05.401312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:05.401312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:05.402544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:05.402544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:05.402544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:05.402544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:05.402544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:05.402544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:05.402544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:13:05.402544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:13:05.402544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:13:05.402544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:13:05.402544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:05.402544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:05.402544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:05.402544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:05.402544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:05.402544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:05.403620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:05.403620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:05.403620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:05.403620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:05.403620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:05.403620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:05.403620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:05.403620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:05.403620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:05.403620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:05.403620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:13:05.403620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:05.403620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 02:13:05.403620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:05.410611 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 353/688] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 02:13:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:13:05.412225 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3bc0d-ad8b-451f-93f5-539092d8377e None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:05.469037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1d8c5-4470-4034-bea2-8dd9f2310714 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:05.505828 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e70e01-7ead-4bf0-9f4e-329b3ef860f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:05.506463 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e70e01-7ead-4bf0-9f4e-329b3ef860f8 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:05.506886 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e70e01-7ead-4bf0-9f4e-329b3ef860f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:05.507160 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e70e01-7ead-4bf0-9f4e-329b3ef860f8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:05.515204 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e70e01-7ead-4bf0-9f4e-329b3ef860f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:05.517971 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e70e01-7ead-4bf0-9f4e-329b3ef860f8 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:05.526772 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3bc0d-ad8b-451f-93f5-539092d8377e None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:05.530106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-99e70e01-7ead-4bf0-9f4e-329b3ef860f8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 02:13:05.530106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:05.530106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:05.530106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:05.530106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:05.530106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:05.530106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:05.530106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:05.530106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:05.530106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:05.530106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:05.530106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:05.530106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 02:13:05.530106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 02:13:05.530106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 02:13:05.530106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 02:13:05.531335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:05.531335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:05.531335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:13:05.531335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:13:05.531335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:13:05.531335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:13:05.531335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:05.531335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:05.531335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:05.531335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:05.531335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:05.531335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:05.531335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:05.531335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:05.531335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:05.531335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:05.531335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:05.531335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:05.532411 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:05.532411 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:05.532411 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 02:13:05.532411 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 02:13:05.532411 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 02:13:05.532411 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 02:13:05.532411 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 02:13:05.532411 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 02:13:05.532411 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 02:13:05.532411 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:05.532411 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 336/689] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 19 02:13:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:05.538688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e70e01-7ead-4bf0-9f4e-329b3ef860f8 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:05.545943 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:05.564843 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3ba2d-225a-47bd-bdcf-b919257ccd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:05.565453 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3ba2d-225a-47bd-bdcf-b919257ccd2d None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:05.565740 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3ba2d-225a-47bd-bdcf-b919257ccd2d None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:05.566009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3ba2d-225a-47bd-bdcf-b919257ccd2d None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:05.566639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3ba2d-225a-47bd-bdcf-b919257ccd2d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:05.566961 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3ba2d-225a-47bd-bdcf-b919257ccd2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:05.568386 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3ba2d-225a-47bd-bdcf-b919257ccd2d None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:05.569536 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:05.578512 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 354/690] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 02:13:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:05.580121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3ba2d-225a-47bd-bdcf-b919257ccd2d None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:05.665568 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e70e01-7ead-4bf0-9f4e-329b3ef860f8 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:05.692976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3ba2d-225a-47bd-bdcf-b919257ccd2d None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:05.715745 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84500f18-711c-4b69-a3d5-77b3d9a3caa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:05.716357 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84500f18-711c-4b69-a3d5-77b3d9a3caa6 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:05.716632 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84500f18-711c-4b69-a3d5-77b3d9a3caa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:05.716902 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84500f18-711c-4b69-a3d5-77b3d9a3caa6 None admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:05.717632 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84500f18-711c-4b69-a3d5-77b3d9a3caa6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:05.718040 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84500f18-711c-4b69-a3d5-77b3d9a3caa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:05.720636 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84500f18-711c-4b69-a3d5-77b3d9a3caa6 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:05.733653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc56b4-bccf-44c7-8f2c-78e05beefb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:05.734314 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc56b4-bccf-44c7-8f2c-78e05beefb21 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:05.734599 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc56b4-bccf-44c7-8f2c-78e05beefb21 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:05.734893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc56b4-bccf-44c7-8f2c-78e05beefb21 None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:05.735530 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc56b4-bccf-44c7-8f2c-78e05beefb21 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:05.735830 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc56b4-bccf-44c7-8f2c-78e05beefb21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:05.737344 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc56b4-bccf-44c7-8f2c-78e05beefb21 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:05.740549 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 337/691] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Oct 19 02:13:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:13:05.742521 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 355/692] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 02:13:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:05.748472 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc56b4-bccf-44c7-8f2c-78e05beefb21 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:05.748607 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84500f18-711c-4b69-a3d5-77b3d9a3caa6 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:05.800845 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:05.838194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:05.865747 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84500f18-711c-4b69-a3d5-77b3d9a3caa6 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:05.876642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc56b4-bccf-44c7-8f2c-78e05beefb21 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:05.918805 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addf8bd-4b0d-4c1b-912a-d36793740c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:05.919151 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8978ef0-71a6-4246-911e-61c9242fab25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:05.919851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addf8bd-4b0d-4c1b-912a-d36793740c5e None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:05.919997 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8978ef0-71a6-4246-911e-61c9242fab25 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:05.920316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8978ef0-71a6-4246-911e-61c9242fab25 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:05.920587 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addf8bd-4b0d-4c1b-912a-d36793740c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:05.920750 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8978ef0-71a6-4246-911e-61c9242fab25 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:05.921133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addf8bd-4b0d-4c1b-912a-d36793740c5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:05.921639 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8978ef0-71a6-4246-911e-61c9242fab25 None admin] RBAC: Adding query filter params (interface=public, service_id=4b14c3ccebcc40ebbfce5b637c794ab4, region_id=RegionOne) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:05.922722 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8978ef0-71a6-4246-911e-61c9242fab25 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:05.924209 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8978ef0-71a6-4246-911e-61c9242fab25 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:05.934982 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 338/693] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 19 02:13:05 2022] GET /identity/v3/endpoints?service_id=4b14c3ccebcc40ebbfce5b637c794ab4&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:05.938315 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8978ef0-71a6-4246-911e-61c9242fab25 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:06.017076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2addf8bd-4b0d-4c1b-912a-d36793740c5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:06.018635 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2addf8bd-4b0d-4c1b-912a-d36793740c5e None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:06.051904 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8978ef0-71a6-4246-911e-61c9242fab25 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:06.071691 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:06.088539 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6d7a2-62e1-4811-9b66-ab7d0a009968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:06.089151 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6d7a2-62e1-4811-9b66-ab7d0a009968 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:06.089430 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6d7a2-62e1-4811-9b66-ab7d0a009968 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:06.089701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6d7a2-62e1-4811-9b66-ab7d0a009968 None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:06.090299 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6d7a2-62e1-4811-9b66-ab7d0a009968 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:06.091694 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6d7a2-62e1-4811-9b66-ab7d0a009968 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:06.097987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 339/694] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 19 02:13:05 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:13:06.099240 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52addba9-2001-4569-93a1-5394ad882532 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:06.099489 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52addba9-2001-4569-93a1-5394ad882532 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:06.099761 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52addba9-2001-4569-93a1-5394ad882532 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:06.101302 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 340/695] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:06.113308 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd95a2c-dab7-46b3-8dea-8664d25f833a None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:06.113688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd95a2c-dab7-46b3-8dea-8664d25f833a None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:06.114095 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd95a2c-dab7-46b3-8dea-8664d25f833a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:06.138041 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 356/696] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:13:05 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 02:13:06.141133 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-ebd95a2c-dab7-46b3-8dea-8664d25f833a None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:06.142367 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ebd95a2c-dab7-46b3-8dea-8664d25f833a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:06.144315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addf8bd-4b0d-4c1b-912a-d36793740c5e None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:06.144652 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:06.251407 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 341/697] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:13:06.280702 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addf8bd-4b0d-4c1b-912a-d36793740c5e None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:06.320202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd21d2-cff6-4133-ac5b-4604acb2e0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:06.320839 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd21d2-cff6-4133-ac5b-4604acb2e0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:06.321115 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd21d2-cff6-4133-ac5b-4604acb2e0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:06.321387 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd21d2-cff6-4133-ac5b-4604acb2e0f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:06.332858 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd21d2-cff6-4133-ac5b-4604acb2e0f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:06.334298 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd21d2-cff6-4133-ac5b-4604acb2e0f6 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:06.337203 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:06.350473 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-39bd21d2-cff6-4133-ac5b-4604acb2e0f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:13:06.350473 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:06.350473 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:06.350473 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:06.350473 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:06.350473 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:06.350473 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:06.350473 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:06.350473 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:06.350473 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:06.350473 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:06.350473 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:06.350473 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:13:06.350473 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:13:06.350473 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:13:06.350473 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:13:06.351708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:06.351708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:06.351708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:06.351708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:06.351708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:06.351708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:06.351708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:06.351708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:06.351708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:06.351708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:06.351708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:06.351708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:06.351708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:06.351708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:06.351708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:06.351708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:06.351708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:13:06.352591 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:13:06.352591 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:13:06.352591 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:06.352591 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 357/698] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:06.357566 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd95a2c-dab7-46b3-8dea-8664d25f833a None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:06.464303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd95a2c-dab7-46b3-8dea-8664d25f833a None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:06.501210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec6567-3898-4727-9b3a-cc3552e22423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:06.502155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec6567-3898-4727-9b3a-cc3552e22423 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:06.502625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec6567-3898-4727-9b3a-cc3552e22423 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:06.503144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec6567-3898-4727-9b3a-cc3552e22423 None admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:06.503976 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec6567-3898-4727-9b3a-cc3552e22423 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:06.504530 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec6567-3898-4727-9b3a-cc3552e22423 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:06.506082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec6567-3898-4727-9b3a-cc3552e22423 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:06.513080 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:06.520210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 342/699] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:06.529097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd21d2-cff6-4133-ac5b-4604acb2e0f6 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:06.580060 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec6567-3898-4727-9b3a-cc3552e22423 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:06.649824 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd21d2-cff6-4133-ac5b-4604acb2e0f6 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:06.689461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b67b53-35d0-46b7-b3ba-97c37fe27d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:06.690099 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b67b53-35d0-46b7-b3ba-97c37fe27d6b None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:06.690362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b67b53-35d0-46b7-b3ba-97c37fe27d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:06.690631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b67b53-35d0-46b7-b3ba-97c37fe27d6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:06.695807 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec6567-3898-4727-9b3a-cc3552e22423 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:06.697353 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b67b53-35d0-46b7-b3ba-97c37fe27d6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:06.698825 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b67b53-35d0-46b7-b3ba-97c37fe27d6b None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:06.710863 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-17b67b53-35d0-46b7-b3ba-97c37fe27d6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:13:06.710863 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:06.710863 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:06.710863 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:06.710863 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:06.710863 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:06.710863 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:06.710863 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:06.710863 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:06.710863 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:06.710863 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:06.710863 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:06.710863 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 02:13:06.710863 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 02:13:06.710863 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 02:13:06.711947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 02:13:06.711947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:06.711947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:06.711947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:06.711947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:06.711947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:06.711947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:06.711947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:06.711947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:06.711947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:06.711947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:06.711947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:06.711947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:06.711947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:06.711947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:06.711947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:06.711947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:06.713392 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 02:13:06.713392 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 02:13:06.713392 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 02:13:06.713392 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 02:13:06.713392 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 02:13:06.713392 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 02:13:06.713392 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:13:06.713392 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:06.713392 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 358/700] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:13:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:06.716092 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b1af6-2ef0-4eff-9c72-b568fd3b61f1 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:06.716451 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b1af6-2ef0-4eff-9c72-b568fd3b61f1 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:06.716739 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b1af6-2ef0-4eff-9c72-b568fd3b61f1 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:06.717980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 359/701] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:06.719594 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b1af6-2ef0-4eff-9c72-b568fd3b61f1 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:06.739379 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8ca99-d973-4efb-802a-07a9b791bcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:06.740239 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8ca99-d973-4efb-802a-07a9b791bcad None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:06.740513 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8ca99-d973-4efb-802a-07a9b791bcad None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:06.740777 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8ca99-d973-4efb-802a-07a9b791bcad None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:06.741351 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8ca99-d973-4efb-802a-07a9b791bcad None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:06.742697 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8ca99-d973-4efb-802a-07a9b791bcad None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:06.752395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-eac8ca99-d973-4efb-802a-07a9b791bcad None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 02:13:06.752395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:06.752395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:13:06.752395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:13:06.752395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:13:06.752395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:13:06.752395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:13:06.752395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:06.752395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 02:13:06.752395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:06.752395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:13:06.752395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:06.752395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:06.752395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:06.752395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:06.752395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:06.752395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:06.753455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:06.753455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:06.753455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:06.753455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:06.753455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:06.753455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:06.753455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:13:06.753455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:13:06.753455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:13:06.753455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:13:06.753455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:06.753455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:06.753455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:06.753455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:06.753455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:06.753455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:06.754331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:06.754331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:06.754331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:06.754331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:06.754331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:06.754331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:06.754331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:06.754331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:06.754331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:06.754331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:06.754331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:13:06.754331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:06.754331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 02:13:06.754331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:06.754331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 343/702] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 19 02:13:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:13:06.756008 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60557f3-02f8-41a2-a880-bd7caab73ab1 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:06.756284 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60557f3-02f8-41a2-a880-bd7caab73ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:06.756554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60557f3-02f8-41a2-a880-bd7caab73ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:06.775746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-a60557f3-02f8-41a2-a880-bd7caab73ab1 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:06.776927 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-a60557f3-02f8-41a2-a880-bd7caab73ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:06.792296 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:06.838432 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:06.844452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b1af6-2ef0-4eff-9c72-b568fd3b61f1 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:06.855032 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 344/703] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:13:06.855032 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60557f3-02f8-41a2-a880-bd7caab73ab1 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:06.897986 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ca822-b1f5-4b46-ba04-5cb8c2088718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:06.898596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ca822-b1f5-4b46-ba04-5cb8c2088718 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:06.898897 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ca822-b1f5-4b46-ba04-5cb8c2088718 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:06.899168 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ca822-b1f5-4b46-ba04-5cb8c2088718 None admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:06.899928 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ca822-b1f5-4b46-ba04-5cb8c2088718 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:06.900200 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ca822-b1f5-4b46-ba04-5cb8c2088718 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:06.901626 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ca822-b1f5-4b46-ba04-5cb8c2088718 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:06.919186 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 360/704] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 02:13:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:06.921385 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ca822-b1f5-4b46-ba04-5cb8c2088718 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:06.992677 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60557f3-02f8-41a2-a880-bd7caab73ab1 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:07.031814 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3794bef-2bdf-4250-bbe3-e44bc07722ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:07.032489 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3794bef-2bdf-4250-bbe3-e44bc07722ea None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:07.032886 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3794bef-2bdf-4250-bbe3-e44bc07722ea None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:07.033228 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3794bef-2bdf-4250-bbe3-e44bc07722ea None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:07.033926 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3794bef-2bdf-4250-bbe3-e44bc07722ea None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:07.034320 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3794bef-2bdf-4250-bbe3-e44bc07722ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:07.035871 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3794bef-2bdf-4250-bbe3-e44bc07722ea None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:07.039596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ca822-b1f5-4b46-ba04-5cb8c2088718 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:07.041094 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 345/705] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 19 02:13:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:07.047556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3794bef-2bdf-4250-bbe3-e44bc07722ea None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:07.064725 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:07.084585 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f8624-7666-457b-8901-ed2eb658731d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:07.085366 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f8624-7666-457b-8901-ed2eb658731d None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:07.085738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f8624-7666-457b-8901-ed2eb658731d None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:07.086098 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f8624-7666-457b-8901-ed2eb658731d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:07.086970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f8624-7666-457b-8901-ed2eb658731d None admin] RBAC: Adding query filter params (role.id=2d76ac736d7141f285d30dcda647e0f4, scope.project.id=91449401454c493cbf423888db8b8454, user.id=e58cdf090af44b508767e821be2f379f) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:07.087456 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f8624-7666-457b-8901-ed2eb658731d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:07.089098 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f8624-7666-457b-8901-ed2eb658731d None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:07.100671 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 361/706] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 02:13:06 2022] GET /identity/v3/role_assignments?user.id=e58cdf090af44b508767e821be2f379f&scope.project.id=91449401454c493cbf423888db8b8454&role.id=2d76ac736d7141f285d30dcda647e0f4 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:13:07.120517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:07.139141 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f8624-7666-457b-8901-ed2eb658731d None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:07.181904 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3794bef-2bdf-4250-bbe3-e44bc07722ea None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:07.236760 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea518985-4c2a-4140-ab65-0881ca012caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:07.237752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea518985-4c2a-4140-ab65-0881ca012caf None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:07.238240 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea518985-4c2a-4140-ab65-0881ca012caf None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:07.238690 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea518985-4c2a-4140-ab65-0881ca012caf None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:07.239590 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea518985-4c2a-4140-ab65-0881ca012caf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:07.240075 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea518985-4c2a-4140-ab65-0881ca012caf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:07.241627 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea518985-4c2a-4140-ab65-0881ca012caf None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:07.247757 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 346/707] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 19 02:13:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:07.258854 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea518985-4c2a-4140-ab65-0881ca012caf None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:07.264106 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f8624-7666-457b-8901-ed2eb658731d None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:07.305384 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e7f34-f4ef-42cd-ab0c-7fddd6752392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:07.305942 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e7f34-f4ef-42cd-ab0c-7fddd6752392 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:07.306219 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e7f34-f4ef-42cd-ab0c-7fddd6752392 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:07.306487 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e7f34-f4ef-42cd-ab0c-7fddd6752392 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:07.307111 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e7f34-f4ef-42cd-ab0c-7fddd6752392 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:07.308468 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e7f34-f4ef-42cd-ab0c-7fddd6752392 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:07.319458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-372e7f34-f4ef-42cd-ab0c-7fddd6752392 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 02:13:07.319458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:07.319458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:13:07.319458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:13:07.319458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:13:07.319458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:13:07.319458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:13:07.319458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:07.319458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 02:13:07.319458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:07.319458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:13:07.319458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:07.319458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:07.319458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:07.319458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:07.319458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:07.319458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:07.320707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:07.320707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:07.320707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:07.320707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:07.320707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:07.320707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:07.320707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:13:07.320707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:13:07.320707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:13:07.320707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:13:07.320707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:07.320707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:07.320707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:07.320707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:07.320707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:07.320707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:07.321534 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:07.321534 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:07.321534 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:07.321534 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:07.321534 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:07.321534 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:07.321534 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:07.321534 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:07.321534 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:07.321534 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:07.321534 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:13:07.321534 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:07.321534 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 02:13:07.321534 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:07.325642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 362/708] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:13:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:13:07.326859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e7f34-f4ef-42cd-ab0c-7fddd6752392 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:07.387090 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea518985-4c2a-4140-ab65-0881ca012caf None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:07.390053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:07.406829 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:07.421059 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdc8bf-308f-43a9-90d0-abb9f3993501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:07.421885 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdc8bf-308f-43a9-90d0-abb9f3993501 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:07.422238 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdc8bf-308f-43a9-90d0-abb9f3993501 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:07.422588 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdc8bf-308f-43a9-90d0-abb9f3993501 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:07.423461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdc8bf-308f-43a9-90d0-abb9f3993501 None admin] RBAC: Adding query filter params (interface=public, service_id=fe67bf84dd8245558422ce97d84ca0d0, region_id=RegionOne) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:07.423844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdc8bf-308f-43a9-90d0-abb9f3993501 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:07.426543 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdc8bf-308f-43a9-90d0-abb9f3993501 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:07.432442 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 347/709] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 19 02:13:07 2022] GET /identity/v3/endpoints?service_id=fe67bf84dd8245558422ce97d84ca0d0&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:07.439310 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdc8bf-308f-43a9-90d0-abb9f3993501 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:07.465839 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e7f34-f4ef-42cd-ab0c-7fddd6752392 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:07.514773 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59683a9-6494-4a69-8c0c-5df2317d8d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:07.516017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59683a9-6494-4a69-8c0c-5df2317d8d96 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:07.516913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59683a9-6494-4a69-8c0c-5df2317d8d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:07.517194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59683a9-6494-4a69-8c0c-5df2317d8d96 None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:07.517829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59683a9-6494-4a69-8c0c-5df2317d8d96 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:07.518129 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59683a9-6494-4a69-8c0c-5df2317d8d96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:07.519532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59683a9-6494-4a69-8c0c-5df2317d8d96 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:07.530810 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 363/710] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 02:13:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:07.533541 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59683a9-6494-4a69-8c0c-5df2317d8d96 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:07.551972 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdc8bf-308f-43a9-90d0-abb9f3993501 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:07.589983 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8e714-ade3-45b5-90f1-648264f5d5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:07.591069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8e714-ade3-45b5-90f1-648264f5d5ad None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:07.591591 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8e714-ade3-45b5-90f1-648264f5d5ad None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:07.592054 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8e714-ade3-45b5-90f1-648264f5d5ad None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:07.592906 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8e714-ade3-45b5-90f1-648264f5d5ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:07.595411 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8e714-ade3-45b5-90f1-648264f5d5ad None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:07.607135 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 348/711] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 19 02:13:07 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:13:07.662121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59683a9-6494-4a69-8c0c-5df2317d8d96 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:07.677298 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:07.706648 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c79cc-7e14-4da5-8730-a1fc748ede55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:07.707296 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c79cc-7e14-4da5-8730-a1fc748ede55 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:07.707572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c79cc-7e14-4da5-8730-a1fc748ede55 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:07.707843 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c79cc-7e14-4da5-8730-a1fc748ede55 None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:07.708561 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c79cc-7e14-4da5-8730-a1fc748ede55 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:07.708864 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c79cc-7e14-4da5-8730-a1fc748ede55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:07.710258 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c79cc-7e14-4da5-8730-a1fc748ede55 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:07.715783 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 364/712] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 02:13:07 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:08.370255 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfec79-ef64-4901-9f46-d921377d2d08 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:08.370811 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfec79-ef64-4901-9f46-d921377d2d08 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:08.370811 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfec79-ef64-4901-9f46-d921377d2d08 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:08.372159 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 349/713] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:08.377450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab823ce-24db-4cc1-bdc9-c54978f8735e None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:08.377886 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab823ce-24db-4cc1-bdc9-c54978f8735e None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:08.378081 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab823ce-24db-4cc1-bdc9-c54978f8735e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:08.397743 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-8ab823ce-24db-4cc1-bdc9-c54978f8735e None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:08.398969 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-8ab823ce-24db-4cc1-bdc9-c54978f8735e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:08.471303 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 365/714] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:13:08.741690 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfec79-ef64-4901-9f46-d921377d2d08 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:08.796062 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:08.852473 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfec79-ef64-4901-9f46-d921377d2d08 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:08.889428 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4e01b-02c6-4936-ae73-190b7daf3bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:08.890720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4e01b-02c6-4936-ae73-190b7daf3bfa None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:08.891643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4e01b-02c6-4936-ae73-190b7daf3bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:08.892108 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4e01b-02c6-4936-ae73-190b7daf3bfa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:08.892877 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4e01b-02c6-4936-ae73-190b7daf3bfa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:08.894485 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4e01b-02c6-4936-ae73-190b7daf3bfa None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:08.903925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-3ea4e01b-02c6-4936-ae73-190b7daf3bfa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 02:13:08.903925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:08.903925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:13:08.903925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:13:08.903925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:13:08.903925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:13:08.903925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:13:08.903925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:08.903925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 02:13:08.903925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:08.903925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:13:08.903925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:08.903925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:08.903925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:08.903925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:08.903925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:08.903925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:08.904907 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:08.904907 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:08.904907 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:08.904907 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:08.904907 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:08.904907 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:08.904907 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:13:08.904907 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:13:08.904907 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:13:08.904907 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:13:08.904907 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:08.904907 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:08.904907 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:08.904907 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:08.904907 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:08.904907 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:08.905742 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:08.905742 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:08.905742 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:08.905742 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:08.905742 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:08.905742 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:08.905742 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:08.905742 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:08.905742 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:08.905742 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:08.905742 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:13:08.905742 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:08.905742 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 02:13:08.905742 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:08.909543 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 350/715] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 02:13:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:08.919943 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab823ce-24db-4cc1-bdc9-c54978f8735e None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:09.023575 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab823ce-24db-4cc1-bdc9-c54978f8735e None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:09.031299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:09.058855 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c053a49-3f42-4e64-8f05-ebb770d485ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:09.059721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c053a49-3f42-4e64-8f05-ebb770d485ee None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:09.059999 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c053a49-3f42-4e64-8f05-ebb770d485ee None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:09.060270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c053a49-3f42-4e64-8f05-ebb770d485ee None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:09.060900 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c053a49-3f42-4e64-8f05-ebb770d485ee None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:09.061198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c053a49-3f42-4e64-8f05-ebb770d485ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:09.062647 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c053a49-3f42-4e64-8f05-ebb770d485ee None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:09.067774 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 366/716] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 02:13:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:09.073484 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4e01b-02c6-4936-ae73-190b7daf3bfa None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:09.181120 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4e01b-02c6-4936-ae73-190b7daf3bfa None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:09.194886 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:09.217659 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348b38f-d896-44cc-ad8a-54f6492dcd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:09.220886 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348b38f-d896-44cc-ad8a-54f6492dcd61 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:09.220886 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348b38f-d896-44cc-ad8a-54f6492dcd61 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:09.220886 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348b38f-d896-44cc-ad8a-54f6492dcd61 None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:09.220886 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1348b38f-d896-44cc-ad8a-54f6492dcd61 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:09.220886 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1348b38f-d896-44cc-ad8a-54f6492dcd61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:09.222167 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1348b38f-d896-44cc-ad8a-54f6492dcd61 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:09.226992 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 351/717] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 19 02:13:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:09.232431 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c053a49-3f42-4e64-8f05-ebb770d485ee None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:09.342640 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c053a49-3f42-4e64-8f05-ebb770d485ee None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:09.382040 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111730e4-7eac-4bad-b552-fe0ad204b466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:09.382673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111730e4-7eac-4bad-b552-fe0ad204b466 None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:09.382995 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111730e4-7eac-4bad-b552-fe0ad204b466 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:09.383414 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111730e4-7eac-4bad-b552-fe0ad204b466 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:09.384157 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111730e4-7eac-4bad-b552-fe0ad204b466 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:09.385531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111730e4-7eac-4bad-b552-fe0ad204b466 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:09.469011 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ab320-40b3-40a7-b951-76e8fd5786f0 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:09.469011 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ab320-40b3-40a7-b951-76e8fd5786f0 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:09.469011 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ab320-40b3-40a7-b951-76e8fd5786f0 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:09.470150 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 352/718] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:09.471200 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 367/719] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:13:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:13:09.476645 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bef190-606f-4d58-9dd8-b7cfad0154b9 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:09.477236 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bef190-606f-4d58-9dd8-b7cfad0154b9 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:09.477711 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bef190-606f-4d58-9dd8-b7cfad0154b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:09.498228 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-27bef190-606f-4d58-9dd8-b7cfad0154b9 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:09.500841 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-27bef190-606f-4d58-9dd8-b7cfad0154b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:09.585546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 353/720] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:13:09.829272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07e10c-8f22-4c38-9fc9-3919184cc6c7 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:09.829667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07e10c-8f22-4c38-9fc9-3919184cc6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:09.829844 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07e10c-8f22-4c38-9fc9-3919184cc6c7 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:09.831438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 368/721] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:09.836880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a850e2-2737-42eb-9ede-9faf643f107b None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:09.837161 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a850e2-2737-42eb-9ede-9faf643f107b None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:09.837435 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a850e2-2737-42eb-9ede-9faf643f107b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:09.856611 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-97a850e2-2737-42eb-9ede-9faf643f107b None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:09.857838 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-97a850e2-2737-42eb-9ede-9faf643f107b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:09.867891 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07e10c-8f22-4c38-9fc9-3919184cc6c7 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:09.897878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:09.942607 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 354/722] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:13:09.979786 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fb89e-c035-4291-8c5b-a0174545c0c7 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:09.980094 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fb89e-c035-4291-8c5b-a0174545c0c7 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:09.980331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fb89e-c035-4291-8c5b-a0174545c0c7 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:09.981807 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 355/723] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 02:13:09.989161 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4f880-0c92-470b-8ef2-ab3b738a475f None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:09.989438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4f880-0c92-470b-8ef2-ab3b738a475f None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:09.989710 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4f880-0c92-470b-8ef2-ab3b738a475f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:09.999191 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07e10c-8f22-4c38-9fc9-3919184cc6c7 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:10.011137 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-aaf4f880-0c92-470b-8ef2-ab3b738a475f None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:10.012379 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-aaf4f880-0c92-470b-8ef2-ab3b738a475f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:10.040326 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:10.043826 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdc0ab-5a20-4a03-96bf-7d02e7b1fbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:10.044861 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdc0ab-5a20-4a03-96bf-7d02e7b1fbbf None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:10.045627 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdc0ab-5a20-4a03-96bf-7d02e7b1fbbf None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:10.046341 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdc0ab-5a20-4a03-96bf-7d02e7b1fbbf None admin] PATH_INFO: `/v3/services/image` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:10.047724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdc0ab-5a20-4a03-96bf-7d02e7b1fbbf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:10.049241 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdc0ab-5a20-4a03-96bf-7d02e7b1fbbf None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:10.060596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-b2bdc0ab-5a20-4a03-96bf-7d02e7b1fbbf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 02:13:10.060596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:10.060596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:13:10.060596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:13:10.060596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:13:10.060596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:13:10.060596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:13:10.060596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:10.060596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 02:13:10.060596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:10.060596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:13:10.060596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:10.060596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:10.060596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:10.060596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:10.060596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:10.060596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:10.061862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:10.061862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:10.061862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:10.061862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:10.061862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:10.061862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:10.061862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:13:10.061862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:13:10.061862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:13:10.061862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:13:10.061862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:10.061862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:10.061862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:10.061862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:10.061862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:10.061862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:10.063089 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:10.063089 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:10.063089 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:10.063089 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:10.063089 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:10.063089 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:10.063089 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:10.063089 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:10.063089 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:10.063089 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:10.063089 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:13:10.063089 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:10.063089 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 02:13:10.063089 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:10.067210 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 369/724] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Oct 19 02:13:09 2022] GET /identity/v3/services/image => generated 86 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:13:10.069608 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdc0ab-5a20-4a03-96bf-7d02e7b1fbbf None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:10.094808 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 356/725] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 02:13:10.173377 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:10.189596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdc0ab-5a20-4a03-96bf-7d02e7b1fbbf None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:10.217959 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4f880-0c92-470b-8ef2-ab3b738a475f None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:10.241652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d3841-b2d7-45b6-b4f9-c2e108cc62c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:10.242261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d3841-b2d7-45b6-b4f9-c2e108cc62c8 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:10.242533 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d3841-b2d7-45b6-b4f9-c2e108cc62c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:10.242800 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d3841-b2d7-45b6-b4f9-c2e108cc62c8 None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:10.243452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d3841-b2d7-45b6-b4f9-c2e108cc62c8 None admin] RBAC: Adding query filter params (name=image) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:10.243780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d3841-b2d7-45b6-b4f9-c2e108cc62c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:10.245137 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d3841-b2d7-45b6-b4f9-c2e108cc62c8 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:10.256137 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 370/726] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:13:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:10.260993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d3841-b2d7-45b6-b4f9-c2e108cc62c8 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:10.348312 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4f880-0c92-470b-8ef2-ab3b738a475f None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:10.384632 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa96e5-8b9d-4a52-8038-826ec4e6a880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:10.385621 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa96e5-8b9d-4a52-8038-826ec4e6a880 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:10.386100 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa96e5-8b9d-4a52-8038-826ec4e6a880 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:10.386569 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa96e5-8b9d-4a52-8038-826ec4e6a880 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:10.387378 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa96e5-8b9d-4a52-8038-826ec4e6a880 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:10.388979 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa96e5-8b9d-4a52-8038-826ec4e6a880 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:10.398584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-4ffa96e5-8b9d-4a52-8038-826ec4e6a880 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 02:13:10.398584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:10.398584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:13:10.398584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:13:10.398584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:13:10.398584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:13:10.398584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:13:10.398584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:10.398584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 02:13:10.398584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:10.398584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:13:10.398584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:10.398584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:10.398584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:10.398584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:10.398584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:10.398584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:10.399613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:10.399613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:10.399613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:10.399613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:10.399613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:10.399613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:10.399613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:13:10.399613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:13:10.399613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:13:10.399613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:13:10.399613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:10.399613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:10.399613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:10.399613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:10.399613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:10.399613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:10.400534 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:10.400534 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:10.400534 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:10.400534 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:10.400534 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:10.400534 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:10.400534 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:10.400534 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:10.400534 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:10.400534 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:10.400534 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:13:10.400534 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:10.400534 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 02:13:10.400534 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:10.400534 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 357/727] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 19 02:13:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:10.401313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa96e5-8b9d-4a52-8038-826ec4e6a880 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:10.406505 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d3841-b2d7-45b6-b4f9-c2e108cc62c8 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:10.435834 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:10.444740 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e05d2a-2884-4e74-a4b5-a5f4f112724c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:10.445349 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e05d2a-2884-4e74-a4b5-a5f4f112724c None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:10.445622 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e05d2a-2884-4e74-a4b5-a5f4f112724c None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:10.445890 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e05d2a-2884-4e74-a4b5-a5f4f112724c None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:10.446522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e05d2a-2884-4e74-a4b5-a5f4f112724c None admin] RBAC: Adding query filter params (type=image) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:10.446838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e05d2a-2884-4e74-a4b5-a5f4f112724c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:10.448206 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e05d2a-2884-4e74-a4b5-a5f4f112724c None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:10.454115 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 371/728] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:13:10 2022] GET /identity/v3/services?type=image => generated 122 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:13:10.455870 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e05d2a-2884-4e74-a4b5-a5f4f112724c None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:10.481711 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:10.524978 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa96e5-8b9d-4a52-8038-826ec4e6a880 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:10.569961 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef9242-1cf4-4739-99a7-87c0236d2051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:10.570686 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef9242-1cf4-4739-99a7-87c0236d2051 None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:10.571048 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef9242-1cf4-4739-99a7-87c0236d2051 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:10.571383 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef9242-1cf4-4739-99a7-87c0236d2051 None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:10.572122 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef9242-1cf4-4739-99a7-87c0236d2051 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:10.573696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef9242-1cf4-4739-99a7-87c0236d2051 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:10.598736 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e05d2a-2884-4e74-a4b5-a5f4f112724c None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:10.637543 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a36a6c-c753-40f7-97e0-24b300a30b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:10.638211 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a36a6c-c753-40f7-97e0-24b300a30b8b None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:10.638495 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a36a6c-c753-40f7-97e0-24b300a30b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:10.638761 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a36a6c-c753-40f7-97e0-24b300a30b8b None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:10.639417 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a36a6c-c753-40f7-97e0-24b300a30b8b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:10.639717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a36a6c-c753-40f7-97e0-24b300a30b8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:10.642374 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a36a6c-c753-40f7-97e0-24b300a30b8b None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:10.647679 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 372/729] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 19 02:13:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:10.653418 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a36a6c-c753-40f7-97e0-24b300a30b8b None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:10.662708 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 358/730] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 02:13:10 2022] POST /identity/v3/services => generated 242 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:13:10.754325 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:10.778481 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a36a6c-c753-40f7-97e0-24b300a30b8b None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:10.825174 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3601fe5-bd70-47bf-b240-42fd4afba7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:10.825795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3601fe5-bd70-47bf-b240-42fd4afba7a8 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:10.826080 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3601fe5-bd70-47bf-b240-42fd4afba7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:10.826350 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3601fe5-bd70-47bf-b240-42fd4afba7a8 None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:10.827032 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3601fe5-bd70-47bf-b240-42fd4afba7a8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:10.827336 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3601fe5-bd70-47bf-b240-42fd4afba7a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:10.828866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3601fe5-bd70-47bf-b240-42fd4afba7a8 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:10.835068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 373/731] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 19 02:13:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:13:10.840707 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef9242-1cf4-4739-99a7-87c0236d2051 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:10.935820 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:10.952270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef9242-1cf4-4739-99a7-87c0236d2051 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:10.988955 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f3828-7d16-475d-8ad9-bf7cb63da102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:10.989568 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f3828-7d16-475d-8ad9-bf7cb63da102 None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:10.989845 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f3828-7d16-475d-8ad9-bf7cb63da102 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:10.990124 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f3828-7d16-475d-8ad9-bf7cb63da102 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:10.990841 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f3828-7d16-475d-8ad9-bf7cb63da102 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:10.993218 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f3828-7d16-475d-8ad9-bf7cb63da102 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:11.065678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 359/732] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:13:10 2022] POST /identity/v3/endpoints => generated 349 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:13:11.741946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca9c82-4542-4ad4-9a58-6e84c72ba2ce None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:11.742489 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca9c82-4542-4ad4-9a58-6e84c72ba2ce None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:11.742489 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca9c82-4542-4ad4-9a58-6e84c72ba2ce None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:11.744104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 374/733] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:11.749238 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a56e52-a268-4818-a8d1-2a934bc22998 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:11.750290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a56e52-a268-4818-a8d1-2a934bc22998 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:11.750290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a56e52-a268-4818-a8d1-2a934bc22998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:11.768617 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-c5a56e52-a268-4818-a8d1-2a934bc22998 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:11.769786 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c5a56e52-a268-4818-a8d1-2a934bc22998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:11.845180 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 360/734] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:13:12.116777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca9c82-4542-4ad4-9a58-6e84c72ba2ce None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:12.228403 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca9c82-4542-4ad4-9a58-6e84c72ba2ce None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:12.263768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b880317-ca41-4765-8249-273b26739aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:12.264380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b880317-ca41-4765-8249-273b26739aed None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:12.264657 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b880317-ca41-4765-8249-273b26739aed None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:12.264930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b880317-ca41-4765-8249-273b26739aed None admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:12.266159 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b880317-ca41-4765-8249-273b26739aed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:12.267616 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b880317-ca41-4765-8249-273b26739aed None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:12.270296 dv-cinder-861491-4-smb devstack@keystone.service[81670]: WARNING keystone.server.flask.common [None req-4b880317-ca41-4765-8249-273b26739aed None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 19 02:13:12.279472 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:12.306757 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.sql.core [None req-4b880317-ca41-4765-8249-273b26739aed None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 19 02:13:12.306757 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 02:13:12.306757 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [parameters: {'id': '8eccc205011a465ab498b90c93487242', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 19 02:13:12.306757 dv-cinder-861491-4-smb devstack@keystone.service[81670]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81670) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 02:13:12.314811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-4b880317-ca41-4765-8249-273b26739aed None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8eccc205011a465ab498b90c93487242.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8eccc205011a465ab498b90c93487242. Oct 19 02:13:12.314811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:12.314811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 02:13:12.314811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 02:13:12.314811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 02:13:12.314811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 02:13:12.314811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 02:13:12.314811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 02:13:12.314811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 02:13:12.314811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application conn.query(q) Oct 19 02:13:12.314811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 02:13:12.314811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 02:13:12.314811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 02:13:12.315636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application result.read() Oct 19 02:13:12.315636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 02:13:12.315636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 02:13:12.315636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 02:13:12.315636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 02:13:12.315636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 02:13:12.315636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 02:13:12.315636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 02:13:12.315636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 02:13:12.315636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 19 02:13:12.315636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:12.315636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 02:13:12.315636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:12.315636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:12.315636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 02:13:12.315636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 02:13:12.315636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 19 02:13:12.315636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 19 02:13:12.316572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 02:13:12.316572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application next(self.gen) Oct 19 02:13:12.316572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 02:13:12.316572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application yield resource Oct 19 02:13:12.316572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 02:13:12.316572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application next(self.gen) Oct 19 02:13:12.316572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 02:13:12.316572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 02:13:12.316572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 02:13:12.316572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 02:13:12.316572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 02:13:12.316572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise self.value Oct 19 02:13:12.316572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 02:13:12.316572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 02:13:12.316572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 02:13:12.316572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application session.commit() Oct 19 02:13:12.316572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 02:13:12.318034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 02:13:12.318034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 02:13:12.318034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 02:13:12.318034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 02:13:12.318034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self.session.flush() Oct 19 02:13:12.318034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 02:13:12.318034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 02:13:12.318034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 02:13:12.318034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 02:13:12.318034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 02:13:12.318034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application compat.raise_( Oct 19 02:13:12.318034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 02:13:12.318034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception Oct 19 02:13:12.318034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 02:13:12.318034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 02:13:12.318034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 02:13:12.318034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 02:13:12.319076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 02:13:12.319076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 02:13:12.319076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 02:13:12.319076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 02:13:12.319076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 19 02:13:12.319076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 19 02:13:12.319076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 02:13:12.319076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 02:13:12.319076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 02:13:12.319076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 02:13:12.319076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 02:13:12.319076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 02:13:12.319076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 02:13:12.319076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 02:13:12.319076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 02:13:12.319862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 02:13:12.319862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 02:13:12.319862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception Oct 19 02:13:12.319862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 02:13:12.319862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 02:13:12.319862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 02:13:12.319862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 02:13:12.319862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 02:13:12.319862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 02:13:12.319862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 02:13:12.319862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application conn.query(q) Oct 19 02:13:12.319862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 02:13:12.319862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 02:13:12.319862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 02:13:12.319862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application result.read() Oct 19 02:13:12.319862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 02:13:12.319862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 02:13:12.320724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 02:13:12.320724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 02:13:12.320724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 02:13:12.320724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 02:13:12.320724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 02:13:12.320724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 02:13:12.320724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 19 02:13:12.320724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 02:13:12.320724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [parameters: {'id': '8eccc205011a465ab498b90c93487242', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 19 02:13:12.320724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 02:13:12.320724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:12.320724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:13:12.320724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:12.320724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:12.320724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 19 02:13:12.326652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 19 02:13:12.326652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 02:13:12.326652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 02:13:12.326652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 19 02:13:12.326652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:12.326652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:13:12.326652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:12.326652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:12.326652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:12.326652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:12.326652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:12.326652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:12.326652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:12.326652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:12.326652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:12.326652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:12.326652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:12.329537 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:12.329537 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 19 02:13:12.329537 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 19 02:13:12.329537 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:12.329537 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:12.329537 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 19 02:13:12.329537 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 19 02:13:12.329537 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8eccc205011a465ab498b90c93487242. Oct 19 02:13:12.329537 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:12.329537 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 375/735] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Oct 19 02:13:12 2022] POST /identity/v3/projects => generated 262 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:12.335147 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a56e52-a268-4818-a8d1-2a934bc22998 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:12.403343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:12.444094 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a56e52-a268-4818-a8d1-2a934bc22998 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:12.481205 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13ec61-7814-4bda-ae82-9acefb3b1522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:12.482439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13ec61-7814-4bda-ae82-9acefb3b1522 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:12.483096 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13ec61-7814-4bda-ae82-9acefb3b1522 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:12.483610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13ec61-7814-4bda-ae82-9acefb3b1522 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:12.492379 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13ec61-7814-4bda-ae82-9acefb3b1522 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:12.494126 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13ec61-7814-4bda-ae82-9acefb3b1522 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:12.505719 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-0d13ec61-7814-4bda-ae82-9acefb3b1522 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:13:12.505719 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:12.505719 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:12.505719 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:12.505719 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:12.505719 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:12.505719 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:12.505719 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:12.505719 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:12.505719 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:12.505719 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:12.505719 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:12.505719 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 02:13:12.505719 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 02:13:12.505719 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 02:13:12.506631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 02:13:12.506631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:12.506631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:12.506631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:12.506631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:12.506631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:12.506631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:12.506631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:12.506631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:12.506631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:12.506631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:12.506631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:12.506631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:12.506631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:12.506631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:12.506631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:12.506631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:12.507552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 02:13:12.507552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 02:13:12.507552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 02:13:12.507552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 02:13:12.507552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 02:13:12.507552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 02:13:12.507552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:13:12.507552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:12.510050 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 361/736] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:13:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:12.516459 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b880317-ca41-4765-8249-273b26739aed None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:12.628425 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b880317-ca41-4765-8249-273b26739aed None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:12.665117 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402c644-4276-4a10-a745-fba91b459611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:12.666070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402c644-4276-4a10-a745-fba91b459611 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:12.666581 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402c644-4276-4a10-a745-fba91b459611 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:12.667072 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402c644-4276-4a10-a745-fba91b459611 None admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:12.667933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402c644-4276-4a10-a745-fba91b459611 None admin] RBAC: Adding query filter params (name=service) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:12.668430 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402c644-4276-4a10-a745-fba91b459611 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:12.670269 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402c644-4276-4a10-a745-fba91b459611 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:12.694718 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 376/737] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 02:13:12 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:13:12.813819 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c260a18-6abc-4649-95d2-fe54983669e7 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:12.814354 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c260a18-6abc-4649-95d2-fe54983669e7 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:12.814579 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c260a18-6abc-4649-95d2-fe54983669e7 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:12.816409 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 362/738] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:12.822763 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8b58b-386f-4c8f-934e-2e23eb413d19 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:12.823281 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8b58b-386f-4c8f-934e-2e23eb413d19 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:12.823355 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8b58b-386f-4c8f-934e-2e23eb413d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:12.844881 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-5df8b58b-386f-4c8f-934e-2e23eb413d19 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:12.846446 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-5df8b58b-386f-4c8f-934e-2e23eb413d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:12.908006 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:12.927360 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 377/739] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:13:12.973738 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9da80-9d97-47fa-b324-7733dfc93ad3 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:12.974056 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9da80-9d97-47fa-b324-7733dfc93ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:12.974346 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9da80-9d97-47fa-b324-7733dfc93ad3 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:12.975977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 363/740] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:12.981318 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabb210-8e72-44c9-818a-7ca9c2039b53 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:12.981789 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabb210-8e72-44c9-818a-7ca9c2039b53 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:12.982222 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabb210-8e72-44c9-818a-7ca9c2039b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:13.001585 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-0aabb210-8e72-44c9-818a-7ca9c2039b53 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:13.003089 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-0aabb210-8e72-44c9-818a-7ca9c2039b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:13.078931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 378/741] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:13:13.205883 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9da80-9d97-47fa-b324-7733dfc93ad3 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:13.311131 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700c85e-fb5e-4790-acb1-871f06929cc3 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:13.311785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700c85e-fb5e-4790-acb1-871f06929cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:13.312794 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700c85e-fb5e-4790-acb1-871f06929cc3 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:13.315006 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 379/742] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 02:13:13.320342 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93c552-1ca5-45ce-84a4-df2a76fe164a None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:13.320878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93c552-1ca5-45ce-84a4-df2a76fe164a None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:13.321346 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93c552-1ca5-45ce-84a4-df2a76fe164a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:13.330189 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9da80-9d97-47fa-b324-7733dfc93ad3 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:13.344008 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-9d93c552-1ca5-45ce-84a4-df2a76fe164a None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:13.345786 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-9d93c552-1ca5-45ce-84a4-df2a76fe164a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:13.359584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:13.367545 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154a457-1b76-4a40-b4ca-1b39c0b36239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:13.368151 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154a457-1b76-4a40-b4ca-1b39c0b36239 None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:13.368427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154a457-1b76-4a40-b4ca-1b39c0b36239 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:13.368696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154a457-1b76-4a40-b4ca-1b39c0b36239 None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:13.369338 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154a457-1b76-4a40-b4ca-1b39c0b36239 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:13.370755 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154a457-1b76-4a40-b4ca-1b39c0b36239 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:13.418004 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 380/743] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:13 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 02:13:13.419124 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93c552-1ca5-45ce-84a4-df2a76fe164a None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:13.455272 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 364/744] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 02:13:13 2022] POST /identity/v3/services => generated 242 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:13:13.482099 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:13.554706 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93c552-1ca5-45ce-84a4-df2a76fe164a None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:13.602323 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65605b01-44cb-4c23-9c24-649bacfcb29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:13.603459 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65605b01-44cb-4c23-9c24-649bacfcb29c None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:13.603938 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65605b01-44cb-4c23-9c24-649bacfcb29c None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:13.604406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65605b01-44cb-4c23-9c24-649bacfcb29c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:13.605196 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65605b01-44cb-4c23-9c24-649bacfcb29c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:13.606842 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65605b01-44cb-4c23-9c24-649bacfcb29c None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:13.617787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-65605b01-44cb-4c23-9c24-649bacfcb29c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 02:13:13.617787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:13.617787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:13:13.617787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:13:13.617787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:13:13.617787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:13:13.617787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:13:13.617787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:13.617787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 02:13:13.617787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:13.617787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:13:13.617787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:13.617787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:13.617787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:13.617787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:13.617787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:13.617787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:13.618877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:13.618877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:13.618877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:13.618877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:13.618877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:13.618877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:13.618877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:13:13.618877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:13:13.618877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:13:13.618877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:13:13.618877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:13.618877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:13.618877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:13.618877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:13.618877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:13.618877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:13.619735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:13.619735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:13.619735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:13.619735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:13.619735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:13.619735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:13.619735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:13.619735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:13.619735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:13.619735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:13.619735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:13:13.619735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:13.619735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 02:13:13.619735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:13.622604 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 381/745] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:13:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:13.629488 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154a457-1b76-4a40-b4ca-1b39c0b36239 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:13.691474 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65605b01-44cb-4c23-9c24-649bacfcb29c None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:13.741347 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154a457-1b76-4a40-b4ca-1b39c0b36239 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:13.779317 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec26014-4e6f-4197-883c-cbcf28348321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:13.779931 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec26014-4e6f-4197-883c-cbcf28348321 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:13.780205 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec26014-4e6f-4197-883c-cbcf28348321 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:13.780476 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec26014-4e6f-4197-883c-cbcf28348321 None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:13.781331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec26014-4e6f-4197-883c-cbcf28348321 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:13.781636 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec26014-4e6f-4197-883c-cbcf28348321 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:13.783028 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec26014-4e6f-4197-883c-cbcf28348321 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:13.788487 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 365/746] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 02:13:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:13.794065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec26014-4e6f-4197-883c-cbcf28348321 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:13.823588 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65605b01-44cb-4c23-9c24-649bacfcb29c None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:13.826003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:13.853163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:13.860439 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5893f-89f8-47d0-aa7a-5aea8521093c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:13.861074 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5893f-89f8-47d0-aa7a-5aea8521093c None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:13.861350 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5893f-89f8-47d0-aa7a-5aea8521093c None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:13.861623 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5893f-89f8-47d0-aa7a-5aea8521093c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:13.862208 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5893f-89f8-47d0-aa7a-5aea8521093c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:13.863679 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5893f-89f8-47d0-aa7a-5aea8521093c None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:13.873103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-7be5893f-89f8-47d0-aa7a-5aea8521093c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 02:13:13.873103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:13.873103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:13:13.873103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:13:13.873103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:13:13.873103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:13:13.873103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:13:13.873103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:13.873103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 02:13:13.873103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:13.873103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:13:13.873103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:13.873103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:13.873103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:13.873103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:13.873103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:13.873103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:13.874121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:13.874121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:13.874121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:13.874121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:13.874121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:13.874121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:13.874121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:13:13.874121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:13:13.874121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:13:13.874121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:13:13.874121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:13.874121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:13.874121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:13.874121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:13.874121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:13.874121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:13.876705 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:13.876705 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:13.876705 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:13.876705 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:13.876705 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:13.876705 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:13.876705 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:13.876705 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:13.876705 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:13.876705 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:13.876705 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:13:13.876705 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:13.876705 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 02:13:13.876705 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:13.882855 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 382/747] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 19 02:13:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:13:13.882855 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5893f-89f8-47d0-aa7a-5aea8521093c None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:13.907546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec26014-4e6f-4197-883c-cbcf28348321 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:13.945222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786a348-7bb7-4fb1-a80c-bfd6a2beccb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:13.945927 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786a348-7bb7-4fb1-a80c-bfd6a2beccb0 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:13.946209 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786a348-7bb7-4fb1-a80c-bfd6a2beccb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:13.946481 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786a348-7bb7-4fb1-a80c-bfd6a2beccb0 None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:13.947135 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786a348-7bb7-4fb1-a80c-bfd6a2beccb0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:13.947438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786a348-7bb7-4fb1-a80c-bfd6a2beccb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:13.949020 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786a348-7bb7-4fb1-a80c-bfd6a2beccb0 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:13.954658 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 366/748] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 02:13:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:13.964654 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786a348-7bb7-4fb1-a80c-bfd6a2beccb0 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:13.988232 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5893f-89f8-47d0-aa7a-5aea8521093c None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:14.025183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab9638-cc2a-406d-b200-e426e5df61ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:14.025825 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab9638-cc2a-406d-b200-e426e5df61ee None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:14.026154 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab9638-cc2a-406d-b200-e426e5df61ee None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:14.026431 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab9638-cc2a-406d-b200-e426e5df61ee None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:14.027143 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab9638-cc2a-406d-b200-e426e5df61ee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:14.027493 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab9638-cc2a-406d-b200-e426e5df61ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:14.028975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab9638-cc2a-406d-b200-e426e5df61ee None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:14.037090 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 383/749] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 19 02:13:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:13:14.042442 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab9638-cc2a-406d-b200-e426e5df61ee None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:14.080678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:14.094370 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786a348-7bb7-4fb1-a80c-bfd6a2beccb0 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:14.116107 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:14.139244 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3702f05-0961-4937-a159-82c3fe46b894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:14.140835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3702f05-0961-4937-a159-82c3fe46b894 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:14.141468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3702f05-0961-4937-a159-82c3fe46b894 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:14.141968 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3702f05-0961-4937-a159-82c3fe46b894 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:14.143388 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3702f05-0961-4937-a159-82c3fe46b894 None admin] RBAC: Adding query filter params (interface=public, service_id=771c62fa7d45409e80158d4fdc7d1000, region_id=RegionOne) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:14.143990 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3702f05-0961-4937-a159-82c3fe46b894 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:14.145704 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3702f05-0961-4937-a159-82c3fe46b894 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:14.157621 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 367/750] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 19 02:13:13 2022] GET /identity/v3/endpoints?service_id=771c62fa7d45409e80158d4fdc7d1000&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:14.159241 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3702f05-0961-4937-a159-82c3fe46b894 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:14.167474 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab9638-cc2a-406d-b200-e426e5df61ee None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:14.206128 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be9581-6f9e-411d-94ed-a7ba3d32ae19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:14.207128 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be9581-6f9e-411d-94ed-a7ba3d32ae19 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:14.207634 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be9581-6f9e-411d-94ed-a7ba3d32ae19 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:14.208103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be9581-6f9e-411d-94ed-a7ba3d32ae19 None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:14.208911 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be9581-6f9e-411d-94ed-a7ba3d32ae19 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:14.209560 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be9581-6f9e-411d-94ed-a7ba3d32ae19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:14.211861 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be9581-6f9e-411d-94ed-a7ba3d32ae19 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:14.218790 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 384/751] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 19 02:13:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:13:14.230384 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be9581-6f9e-411d-94ed-a7ba3d32ae19 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:14.291494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3702f05-0961-4937-a159-82c3fe46b894 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:14.336206 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:14.341188 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b9652-9870-44bf-96fd-e2236fdd4a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:14.342008 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b9652-9870-44bf-96fd-e2236fdd4a39 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:14.342436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b9652-9870-44bf-96fd-e2236fdd4a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:14.342970 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b9652-9870-44bf-96fd-e2236fdd4a39 None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:14.343987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be9581-6f9e-411d-94ed-a7ba3d32ae19 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:14.344455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b9652-9870-44bf-96fd-e2236fdd4a39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:14.346230 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b9652-9870-44bf-96fd-e2236fdd4a39 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:14.359391 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 368/752] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 19 02:13:14 2022] GET /identity/v3/services => generated 1957 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:13:14.390560 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1ec42-6cd3-4728-bc56-86a2114be4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:14.391295 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1ec42-6cd3-4728-bc56-86a2114be4ce None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:14.391601 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1ec42-6cd3-4728-bc56-86a2114be4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:14.391829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1ec42-6cd3-4728-bc56-86a2114be4ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:14.392662 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1ec42-6cd3-4728-bc56-86a2114be4ce None admin] RBAC: Adding query filter params (interface=admin, service_id=fe67bf84dd8245558422ce97d84ca0d0, region_id=RegionOne) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:14.392980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1ec42-6cd3-4728-bc56-86a2114be4ce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:14.394629 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1ec42-6cd3-4728-bc56-86a2114be4ce None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:14.401661 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 385/753] 10.222.0.16 () {56 vars in 1249 bytes} [Wed Oct 19 02:13:14 2022] GET /identity/v3/endpoints?service_id=fe67bf84dd8245558422ce97d84ca0d0&interface=admin®ion_id=RegionOne => generated 193 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:14.408117 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b9652-9870-44bf-96fd-e2236fdd4a39 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:14.463784 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:14.530551 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b9652-9870-44bf-96fd-e2236fdd4a39 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:14.573240 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7195d6-0765-41aa-82e1-47f708ccec70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:14.573776 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7195d6-0765-41aa-82e1-47f708ccec70 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:14.574053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7195d6-0765-41aa-82e1-47f708ccec70 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:14.574322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7195d6-0765-41aa-82e1-47f708ccec70 None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:14.574959 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7195d6-0765-41aa-82e1-47f708ccec70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:14.576337 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7195d6-0765-41aa-82e1-47f708ccec70 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:14.583972 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 369/754] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 19 02:13:14 2022] GET /identity/v3/services => generated 1957 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:13:15.061749 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43cf78-7685-4c77-915d-ee86499451ff None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:15.062370 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43cf78-7685-4c77-915d-ee86499451ff None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:15.062452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43cf78-7685-4c77-915d-ee86499451ff None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:15.064035 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 386/755] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:15.069483 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19026ee5-ac55-4980-a3ae-644abdda24fd None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:15.070323 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19026ee5-ac55-4980-a3ae-644abdda24fd None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:15.070810 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19026ee5-ac55-4980-a3ae-644abdda24fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:15.090327 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-19026ee5-ac55-4980-a3ae-644abdda24fd None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:15.091841 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-19026ee5-ac55-4980-a3ae-644abdda24fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:15.162929 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 370/756] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:15 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:13:15.433564 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43cf78-7685-4c77-915d-ee86499451ff None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:15.541760 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43cf78-7685-4c77-915d-ee86499451ff None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:15.578912 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373bf392-c9ba-47f6-a5b8-2e016e95fd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:15.579844 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bf392-c9ba-47f6-a5b8-2e016e95fd6d None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:15.580322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bf392-c9ba-47f6-a5b8-2e016e95fd6d None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:15.580829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bf392-c9ba-47f6-a5b8-2e016e95fd6d None admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:15.581672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373bf392-c9ba-47f6-a5b8-2e016e95fd6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:15.583328 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373bf392-c9ba-47f6-a5b8-2e016e95fd6d None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:15.631561 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.sql.core [None req-373bf392-c9ba-47f6-a5b8-2e016e95fd6d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 19 02:13:15.631561 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 19 02:13:15.631561 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [parameters: {'user_id': '777067b7b0744e2cb90ef75716787219', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 19 02:13:15.631561 dv-cinder-861491-4-smb devstack@keystone.service[81670]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81670) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 02:13:15.639631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-373bf392-c9ba-47f6-a5b8-2e016e95fd6d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 19 02:13:15.639631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:15.639631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 02:13:15.639631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 02:13:15.639631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 02:13:15.639631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 02:13:15.639631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 02:13:15.639631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 02:13:15.639631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 02:13:15.639631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application conn.query(q) Oct 19 02:13:15.639631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 02:13:15.639631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 02:13:15.639631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 02:13:15.639631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application result.read() Oct 19 02:13:15.639631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 02:13:15.640565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 02:13:15.640565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 02:13:15.640565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 02:13:15.640565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 02:13:15.640565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 02:13:15.640565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 02:13:15.640565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 02:13:15.640565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 19 02:13:15.640565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:15.640565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 02:13:15.640565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:15.640565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:15.640565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 02:13:15.640565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 02:13:15.640565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 19 02:13:15.640565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 19 02:13:15.640565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 02:13:15.640565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application next(self.gen) Oct 19 02:13:15.641498 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 02:13:15.641498 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application yield resource Oct 19 02:13:15.641498 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 02:13:15.641498 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application next(self.gen) Oct 19 02:13:15.641498 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 02:13:15.641498 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 02:13:15.641498 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 02:13:15.641498 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 02:13:15.641498 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 02:13:15.641498 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise self.value Oct 19 02:13:15.641498 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 02:13:15.641498 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 02:13:15.641498 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 02:13:15.641498 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application session.commit() Oct 19 02:13:15.641498 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 02:13:15.641498 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 02:13:15.641498 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 02:13:15.642435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 02:13:15.642435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 02:13:15.642435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self.session.flush() Oct 19 02:13:15.642435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 02:13:15.642435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 02:13:15.642435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 02:13:15.642435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 02:13:15.642435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 02:13:15.642435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application compat.raise_( Oct 19 02:13:15.642435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 02:13:15.642435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception Oct 19 02:13:15.642435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 02:13:15.642435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 02:13:15.642435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 02:13:15.642435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 02:13:15.642435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 02:13:15.642435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 02:13:15.643993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 02:13:15.643993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 02:13:15.643993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 19 02:13:15.643993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 19 02:13:15.643993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 02:13:15.643993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 02:13:15.643993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 02:13:15.643993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 02:13:15.643993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 02:13:15.643993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 02:13:15.643993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 02:13:15.643993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 02:13:15.643993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 02:13:15.643993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 02:13:15.643993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 02:13:15.643993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception Oct 19 02:13:15.644813 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 02:13:15.644813 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 02:13:15.644813 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 02:13:15.644813 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 02:13:15.644813 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 02:13:15.644813 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 02:13:15.644813 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 02:13:15.644813 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application conn.query(q) Oct 19 02:13:15.644813 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 02:13:15.644813 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 02:13:15.644813 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 02:13:15.644813 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application result.read() Oct 19 02:13:15.644813 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 02:13:15.644813 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 02:13:15.644813 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 02:13:15.644813 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 02:13:15.645628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 02:13:15.645628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 02:13:15.645628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 02:13:15.645628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 02:13:15.645628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 19 02:13:15.645628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 19 02:13:15.645628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [parameters: {'user_id': '777067b7b0744e2cb90ef75716787219', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 19 02:13:15.645628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 02:13:15.645628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:15.645628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:13:15.645628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:15.645628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:15.645628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:15.645628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:15.645628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:15.646428 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:15.646428 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:15.646428 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:15.646428 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:15.646428 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:15.646428 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:15.646428 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:15.646428 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 19 02:13:15.646428 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 19 02:13:15.646428 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:15.646428 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:15.646428 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:13:15.646428 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:13:15.646428 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:13:15.646428 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:13:15.646428 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 19 02:13:15.646428 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 19 02:13:15.649186 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 19 02:13:15.649186 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 19 02:13:15.649186 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 02:13:15.649186 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 02:13:15.649186 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 19 02:13:15.649186 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:15.651686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 387/757] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Oct 19 02:13:15 2022] POST /identity/v3/users => generated 160 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:15.658598 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19026ee5-ac55-4980-a3ae-644abdda24fd None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:15.706493 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:15.772474 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19026ee5-ac55-4980-a3ae-644abdda24fd None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:15.804770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2f190-9a4c-4106-a5d9-a8bfd5dac541 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:15.805233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2f190-9a4c-4106-a5d9-a8bfd5dac541 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:15.805817 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2f190-9a4c-4106-a5d9-a8bfd5dac541 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:15.808768 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e3a11-4e90-4b24-809a-e026a6f16895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:15.809654 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e3a11-4e90-4b24-809a-e026a6f16895 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:15.809931 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e3a11-4e90-4b24-809a-e026a6f16895 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:15.810204 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e3a11-4e90-4b24-809a-e026a6f16895 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:15.813354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 388/758] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:15 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 02:13:15.820579 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dc871-e6be-4916-ad95-9e020fe126d6 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:15.821279 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dc871-e6be-4916-ad95-9e020fe126d6 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:15.821653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dc871-e6be-4916-ad95-9e020fe126d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:15.821834 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e3a11-4e90-4b24-809a-e026a6f16895 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:15.823328 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e3a11-4e90-4b24-809a-e026a6f16895 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:15.836436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-614e3a11-4e90-4b24-809a-e026a6f16895 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 02:13:15.836436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:15.836436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:15.836436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:15.836436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:15.836436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:15.836436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:15.836436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:15.836436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:15.836436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:15.836436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:15.836436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:15.836436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 02:13:15.836436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 02:13:15.836436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 02:13:15.836436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 02:13:15.837596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:15.837596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:15.837596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:13:15.837596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:13:15.837596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:13:15.837596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:13:15.837596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:15.837596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:15.837596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:15.837596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:15.837596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:15.837596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:15.837596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:15.837596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:15.837596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:15.837596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:15.837596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:15.837596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:15.838550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:15.838550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:15.838550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 02:13:15.838550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 02:13:15.838550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 02:13:15.838550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 02:13:15.838550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 02:13:15.838550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 02:13:15.838550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 02:13:15.838550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:15.838550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 371/759] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:13:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:15.844013 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e3a11-4e90-4b24-809a-e026a6f16895 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:15.849719 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-f74dc871-e6be-4916-ad95-9e020fe126d6 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:15.851392 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-f74dc871-e6be-4916-ad95-9e020fe126d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:15.873071 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:15.944254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 389/760] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:15 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:13:15.954043 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:15.958646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e3a11-4e90-4b24-809a-e026a6f16895 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:15.995239 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfdd1d-7a50-4f07-bf74-14f0f77652ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:15.995854 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfdd1d-7a50-4f07-bf74-14f0f77652ca None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:15.996133 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfdd1d-7a50-4f07-bf74-14f0f77652ca None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:15.996404 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfdd1d-7a50-4f07-bf74-14f0f77652ca None admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:15.997100 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bfdd1d-7a50-4f07-bf74-14f0f77652ca None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:15.997462 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bfdd1d-7a50-4f07-bf74-14f0f77652ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:15.998975 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bfdd1d-7a50-4f07-bf74-14f0f77652ca None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:16.036086 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 372/761] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 19 02:13:15 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:13:16.227926 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dc871-e6be-4916-ad95-9e020fe126d6 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:16.340425 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dc871-e6be-4916-ad95-9e020fe126d6 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:16.377937 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e5d50-3771-49f6-bef8-83fb951aebd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:16.378580 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e5d50-3771-49f6-bef8-83fb951aebd6 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:16.378878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e5d50-3771-49f6-bef8-83fb951aebd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:16.379154 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e5d50-3771-49f6-bef8-83fb951aebd6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:16.379740 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e5d50-3771-49f6-bef8-83fb951aebd6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:16.381224 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e5d50-3771-49f6-bef8-83fb951aebd6 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:16.390642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-cf1e5d50-3771-49f6-bef8-83fb951aebd6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 02:13:16.390642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:16.390642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:13:16.390642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:13:16.390642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:13:16.390642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:13:16.390642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:13:16.390642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:16.390642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 02:13:16.390642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:16.390642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:13:16.390642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:16.390642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:16.390642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:16.390642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:16.390642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:16.390642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:16.391715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:16.391715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:16.391715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:16.391715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:16.391715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:16.391715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:16.391715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:13:16.391715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:13:16.391715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:13:16.391715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:13:16.391715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:16.391715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:16.391715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:16.391715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:16.391715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:16.391715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:16.395769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:16.395769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:16.395769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:16.395769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:16.395769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:16.395769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:16.395769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:16.395769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:16.395769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:16.395769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:16.395769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:13:16.395769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:16.395769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 02:13:16.395769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:16.395769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 390/762] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Oct 19 02:13:16 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:16.398284 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfdd1d-7a50-4f07-bf74-14f0f77652ca None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:16.514283 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfdd1d-7a50-4f07-bf74-14f0f77652ca None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:16.554344 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fa507-1e18-4f1a-aa60-df7016203233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:16.554978 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fa507-1e18-4f1a-aa60-df7016203233 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:16.555254 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fa507-1e18-4f1a-aa60-df7016203233 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:16.555519 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fa507-1e18-4f1a-aa60-df7016203233 None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:16.556143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fa507-1e18-4f1a-aa60-df7016203233 None admin] RBAC: Adding query filter params (name=image) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:16.556441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fa507-1e18-4f1a-aa60-df7016203233 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:16.557806 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fa507-1e18-4f1a-aa60-df7016203233 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:16.568250 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 373/763] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:13:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:16.569178 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e5d50-3771-49f6-bef8-83fb951aebd6 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:16.588915 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:16.630060 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9876a-7c76-4e38-a0c1-87a16f031c13 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:16.630289 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9876a-7c76-4e38-a0c1-87a16f031c13 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:16.630627 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9876a-7c76-4e38-a0c1-87a16f031c13 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:16.631946 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 374/764] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:16.636883 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493880d-ed52-48e2-a797-f0fabcc21739 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:16.637168 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493880d-ed52-48e2-a797-f0fabcc21739 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:16.637441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493880d-ed52-48e2-a797-f0fabcc21739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:16.656585 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-6493880d-ed52-48e2-a797-f0fabcc21739 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:16.657769 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-6493880d-ed52-48e2-a797-f0fabcc21739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:16.672335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:16.679792 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e5d50-3771-49f6-bef8-83fb951aebd6 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:16.720591 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2929d-5ce7-4837-b31d-97d258b9a9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:16.721882 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2929d-5ce7-4837-b31d-97d258b9a9fd None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:16.722185 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2929d-5ce7-4837-b31d-97d258b9a9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:16.722456 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2929d-5ce7-4837-b31d-97d258b9a9fd None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:16.723181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2929d-5ce7-4837-b31d-97d258b9a9fd None admin] RBAC: Adding query filter params (type=image) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:16.723484 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2929d-5ce7-4837-b31d-97d258b9a9fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:16.724897 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2929d-5ce7-4837-b31d-97d258b9a9fd None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:16.736140 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 391/765] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:13:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:13:16.737270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2929d-5ce7-4837-b31d-97d258b9a9fd None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:16.742858 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 375/766] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:16 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 02:13:16.821066 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60dbca-99b5-462d-b7ab-89eeb2f4e063 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:16.821239 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60dbca-99b5-462d-b7ab-89eeb2f4e063 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:16.821518 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60dbca-99b5-462d-b7ab-89eeb2f4e063 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:16.822867 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 376/767] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 02:13:16.823050 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:16.828487 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21218d51-82ac-46e4-9fa0-ded7231ed3a4 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:16.828944 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21218d51-82ac-46e4-9fa0-ded7231ed3a4 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:16.829217 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21218d51-82ac-46e4-9fa0-ded7231ed3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:16.841861 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2929d-5ce7-4837-b31d-97d258b9a9fd None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:16.880850 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ad741-fba0-455f-9202-1f8185c031b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:16.881476 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ad741-fba0-455f-9202-1f8185c031b2 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:16.881751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ad741-fba0-455f-9202-1f8185c031b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:16.882020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ad741-fba0-455f-9202-1f8185c031b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:16.882735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ad741-fba0-455f-9202-1f8185c031b2 None admin] RBAC: Adding query filter params (interface=public, service_id=cc0b59ddfadd4f11a20094d0669f5773, region_id=RegionOne) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:16.883066 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ad741-fba0-455f-9202-1f8185c031b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:16.884475 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ad741-fba0-455f-9202-1f8185c031b2 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:16.895880 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 392/768] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 19 02:13:16 2022] GET /identity/v3/endpoints?service_id=cc0b59ddfadd4f11a20094d0669f5773&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:13:16.897097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ad741-fba0-455f-9202-1f8185c031b2 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:16.962702 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-21218d51-82ac-46e4-9fa0-ded7231ed3a4 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:16.963927 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-21218d51-82ac-46e4-9fa0-ded7231ed3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:17.004474 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ad741-fba0-455f-9202-1f8185c031b2 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:17.034042 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 377/769] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:16 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 02:13:17.034910 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21218d51-82ac-46e4-9fa0-ded7231ed3a4 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:17.039270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2dfc7-f58a-4952-9cf7-d6ff22baabdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:17.039875 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2dfc7-f58a-4952-9cf7-d6ff22baabdd None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:17.040151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2dfc7-f58a-4952-9cf7-d6ff22baabdd None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:17.040420 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2dfc7-f58a-4952-9cf7-d6ff22baabdd None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:17.041020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2dfc7-f58a-4952-9cf7-d6ff22baabdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:17.042371 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2dfc7-f58a-4952-9cf7-d6ff22baabdd None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:17.049390 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 393/770] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 19 02:13:16 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:13:17.132140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:17.155415 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21218d51-82ac-46e4-9fa0-ded7231ed3a4 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:17.193017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6fb4c5-894b-4d15-9528-df6f00f022bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:17.193735 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fb4c5-894b-4d15-9528-df6f00f022bb None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:17.194011 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fb4c5-894b-4d15-9528-df6f00f022bb None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:17.194279 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fb4c5-894b-4d15-9528-df6f00f022bb None admin] PATH_INFO: `/v3/services/compute` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:17.194948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6fb4c5-894b-4d15-9528-df6f00f022bb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:17.196354 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6fb4c5-894b-4d15-9528-df6f00f022bb None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:17.206556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-5d6fb4c5-894b-4d15-9528-df6f00f022bb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 02:13:17.206556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:17.206556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:13:17.206556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:13:17.206556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:13:17.206556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:13:17.206556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:13:17.206556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:17.206556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 02:13:17.206556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:17.206556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:13:17.206556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:17.206556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:17.206556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:17.206556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:17.206556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:17.206556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:17.207966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:17.207966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:17.207966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:17.207966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:17.207966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:17.207966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:17.207966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:13:17.207966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:13:17.207966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:13:17.207966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:13:17.207966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:17.207966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:17.207966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:17.207966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:17.207966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:17.207966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:17.208998 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:17.208998 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:17.208998 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:17.208998 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:17.208998 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:17.208998 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:17.208998 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:17.208998 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:17.208998 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:17.208998 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:17.208998 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:13:17.208998 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:17.208998 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 02:13:17.208998 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:17.208998 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 378/771] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:13:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:17.216170 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2dfc7-f58a-4952-9cf7-d6ff22baabdd None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:17.228033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:17.314954 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6fb4c5-894b-4d15-9528-df6f00f022bb None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:17.327973 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2dfc7-f58a-4952-9cf7-d6ff22baabdd None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:17.364944 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf75be-9e9a-46c8-a01c-75c8fee40cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:17.365569 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf75be-9e9a-46c8-a01c-75c8fee40cdb None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:17.365829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf75be-9e9a-46c8-a01c-75c8fee40cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:17.366102 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf75be-9e9a-46c8-a01c-75c8fee40cdb None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:17.366733 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf75be-9e9a-46c8-a01c-75c8fee40cdb None admin] RBAC: Adding query filter params (name=compute) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:17.367062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf75be-9e9a-46c8-a01c-75c8fee40cdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:17.368421 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf75be-9e9a-46c8-a01c-75c8fee40cdb None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:17.373574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 394/772] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 02:13:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:17.379246 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf75be-9e9a-46c8-a01c-75c8fee40cdb None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:17.424466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6fb4c5-894b-4d15-9528-df6f00f022bb None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:17.454764 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:17.461380 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e52714-ad72-4aa0-bb28-4fcc11174bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:17.462010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e52714-ad72-4aa0-bb28-4fcc11174bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:17.462287 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e52714-ad72-4aa0-bb28-4fcc11174bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:17.462554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e52714-ad72-4aa0-bb28-4fcc11174bd9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:17.463163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e52714-ad72-4aa0-bb28-4fcc11174bd9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:17.464534 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e52714-ad72-4aa0-bb28-4fcc11174bd9 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:17.473440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-90e52714-ad72-4aa0-bb28-4fcc11174bd9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 02:13:17.473440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:17.473440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:13:17.473440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:13:17.473440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:13:17.473440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:13:17.473440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:13:17.473440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:17.473440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 02:13:17.473440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:17.473440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:13:17.473440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:17.473440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:17.473440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:17.473440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:17.473440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:17.473440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:17.474949 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:17.474949 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:17.474949 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:17.474949 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:17.474949 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:17.474949 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:17.474949 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:13:17.474949 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:13:17.474949 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:13:17.474949 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:13:17.474949 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:17.474949 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:17.474949 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:17.474949 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:17.474949 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:17.474949 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:17.475877 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:17.475877 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:17.475877 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:17.475877 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:17.475877 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:17.475877 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:17.475877 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:17.475877 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:17.475877 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:17.475877 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:17.475877 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:13:17.475877 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:17.475877 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 02:13:17.475877 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:17.475877 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 379/773] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 19 02:13:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:13:17.480240 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e52714-ad72-4aa0-bb28-4fcc11174bd9 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:17.489829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf75be-9e9a-46c8-a01c-75c8fee40cdb None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:17.491810 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:17.525962 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6711b-066b-40ab-ae84-9dc4e049bd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:17.526578 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6711b-066b-40ab-ae84-9dc4e049bd7a None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:17.526884 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6711b-066b-40ab-ae84-9dc4e049bd7a None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:17.527162 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6711b-066b-40ab-ae84-9dc4e049bd7a None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:17.527792 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6711b-066b-40ab-ae84-9dc4e049bd7a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:17.528095 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6711b-066b-40ab-ae84-9dc4e049bd7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:17.529452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6711b-066b-40ab-ae84-9dc4e049bd7a None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:17.535445 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 395/774] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 19 02:13:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:13:17.541159 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6711b-066b-40ab-ae84-9dc4e049bd7a None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:17.596183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e52714-ad72-4aa0-bb28-4fcc11174bd9 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:17.634982 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fba0d9-df17-4669-9663-78fac47874d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:17.635591 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fba0d9-df17-4669-9663-78fac47874d0 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:17.635865 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fba0d9-df17-4669-9663-78fac47874d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:17.636135 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fba0d9-df17-4669-9663-78fac47874d0 None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:17.636753 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fba0d9-df17-4669-9663-78fac47874d0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:17.637049 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fba0d9-df17-4669-9663-78fac47874d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:17.638617 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fba0d9-df17-4669-9663-78fac47874d0 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:17.649181 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 380/775] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 19 02:13:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:13:17.649356 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6711b-066b-40ab-ae84-9dc4e049bd7a None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:17.650151 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fba0d9-df17-4669-9663-78fac47874d0 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:17.685285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4f5fd-c1c8-41f7-bad6-a8c5cdf09173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:17.685816 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4f5fd-c1c8-41f7-bad6-a8c5cdf09173 None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:17.686091 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4f5fd-c1c8-41f7-bad6-a8c5cdf09173 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:17.686363 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4f5fd-c1c8-41f7-bad6-a8c5cdf09173 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:17.687806 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4f5fd-c1c8-41f7-bad6-a8c5cdf09173 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:17.688922 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4f5fd-c1c8-41f7-bad6-a8c5cdf09173 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:17.694570 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:17.733014 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:17.752638 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 396/776] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:13:17 2022] POST /identity/v3/endpoints => generated 334 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:13:17.764073 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fba0d9-df17-4669-9663-78fac47874d0 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:17.810605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c9eb2-f18c-47e9-919c-a2f83afa85aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:17.811265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c9eb2-f18c-47e9-919c-a2f83afa85aa None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:17.811542 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c9eb2-f18c-47e9-919c-a2f83afa85aa None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:17.811868 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c9eb2-f18c-47e9-919c-a2f83afa85aa None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:17.812522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c9eb2-f18c-47e9-919c-a2f83afa85aa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:17.812929 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c9eb2-f18c-47e9-919c-a2f83afa85aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:17.814357 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c9eb2-f18c-47e9-919c-a2f83afa85aa None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:17.820304 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 381/777] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 19 02:13:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:13:17.825996 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4f5fd-c1c8-41f7-bad6-a8c5cdf09173 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:17.938698 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4f5fd-c1c8-41f7-bad6-a8c5cdf09173 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:17.976347 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a0a72-7874-4197-88f5-48bbfaf09abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:17.976987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a0a72-7874-4197-88f5-48bbfaf09abd None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:17.977269 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a0a72-7874-4197-88f5-48bbfaf09abd None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:17.977542 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a0a72-7874-4197-88f5-48bbfaf09abd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:17.978237 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a0a72-7874-4197-88f5-48bbfaf09abd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:17.979738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a0a72-7874-4197-88f5-48bbfaf09abd None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:18.095066 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 397/778] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:13:17 2022] POST /identity/v3/endpoints => generated 325 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:13:19.267008 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c59dd-5a1d-41fd-802e-838a1469a69d None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:19.267542 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c59dd-5a1d-41fd-802e-838a1469a69d None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:19.267542 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c59dd-5a1d-41fd-802e-838a1469a69d None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:19.268916 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 382/779] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:19.274037 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b43d7-6371-418a-92b2-5944285745a2 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:19.274456 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b43d7-6371-418a-92b2-5944285745a2 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:19.276352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b43d7-6371-418a-92b2-5944285745a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:19.293381 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-ba1b43d7-6371-418a-92b2-5944285745a2 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:19.294554 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-ba1b43d7-6371-418a-92b2-5944285745a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:19.343761 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:19.369134 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 398/780] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:19 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:13:19.640709 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c59dd-5a1d-41fd-802e-838a1469a69d None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:19.743080 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c59dd-5a1d-41fd-802e-838a1469a69d None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:19.773346 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:19.778694 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583203c-e40c-43b5-bb6b-79cba893245f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:19.779346 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583203c-e40c-43b5-bb6b-79cba893245f None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:19.779624 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583203c-e40c-43b5-bb6b-79cba893245f None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:19.779890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583203c-e40c-43b5-bb6b-79cba893245f None admin] PATH_INFO: `/v3/services/image` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:19.781077 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583203c-e40c-43b5-bb6b-79cba893245f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:19.782465 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583203c-e40c-43b5-bb6b-79cba893245f None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:19.791065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-9583203c-e40c-43b5-bb6b-79cba893245f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 02:13:19.791065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:19.791065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:13:19.791065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:13:19.791065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:13:19.791065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:13:19.791065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:13:19.791065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:19.791065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 02:13:19.791065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:19.791065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:13:19.791065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:19.791065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:19.791065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:19.791065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:19.791065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:19.791065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:19.803316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:19.803316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:19.803316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:19.803316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:19.803316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:19.803316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:19.803316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:13:19.803316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:13:19.803316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:13:19.803316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:13:19.803316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:19.803316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:19.803316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:19.803316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:19.803316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:19.803316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:19.804163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:19.804163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:19.804163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:19.804163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:19.804163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:19.804163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:19.804163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:19.804163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:19.804163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:19.804163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:19.804163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:13:19.804163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:13:19.804163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 02:13:19.804163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:19.804163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 383/781] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Oct 19 02:13:19 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:19.804955 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b43d7-6371-418a-92b2-5944285745a2 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:19.905861 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b43d7-6371-418a-92b2-5944285745a2 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:19.945569 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079674b9-8257-4345-a32a-533de9eb4f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:19.946183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079674b9-8257-4345-a32a-533de9eb4f01 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:19.946458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079674b9-8257-4345-a32a-533de9eb4f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:19.946727 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079674b9-8257-4345-a32a-533de9eb4f01 None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:19.947388 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079674b9-8257-4345-a32a-533de9eb4f01 None admin] RBAC: Adding query filter params (name=image) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:19.947690 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079674b9-8257-4345-a32a-533de9eb4f01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:19.949051 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079674b9-8257-4345-a32a-533de9eb4f01 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:19.959626 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 399/782] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:13:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:13:19.960887 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583203c-e40c-43b5-bb6b-79cba893245f None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:20.017301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde0950-4de8-4182-bfc6-14fc27ca4176 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:20.017585 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde0950-4de8-4182-bfc6-14fc27ca4176 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:20.017849 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde0950-4de8-4182-bfc6-14fc27ca4176 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:20.019212 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 400/783] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 02:13:20.023915 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4e11a-56a5-4e6d-b6cb-00dcc3959a74 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:20.024188 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4e11a-56a5-4e6d-b6cb-00dcc3959a74 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:20.024460 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4e11a-56a5-4e6d-b6cb-00dcc3959a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:20.046315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-bbd4e11a-56a5-4e6d-b6cb-00dcc3959a74 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:20.048146 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-bbd4e11a-56a5-4e6d-b6cb-00dcc3959a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:20.069972 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583203c-e40c-43b5-bb6b-79cba893245f None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:20.089699 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:20.105284 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf40bfc-3187-4c17-b6ae-46aef245cf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:20.105897 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf40bfc-3187-4c17-b6ae-46aef245cf00 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:20.106171 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf40bfc-3187-4c17-b6ae-46aef245cf00 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:20.106438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf40bfc-3187-4c17-b6ae-46aef245cf00 None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:20.107094 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf40bfc-3187-4c17-b6ae-46aef245cf00 None admin] RBAC: Adding query filter params (type=image) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:20.107392 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf40bfc-3187-4c17-b6ae-46aef245cf00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:20.108785 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf40bfc-3187-4c17-b6ae-46aef245cf00 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:20.114281 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 384/784] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:13:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:20.120098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf40bfc-3187-4c17-b6ae-46aef245cf00 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:20.129443 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 401/785] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 02:13:20.184264 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:20.234354 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf40bfc-3187-4c17-b6ae-46aef245cf00 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:20.269971 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a8663-c74f-4126-8c3e-14624496f8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:20.270618 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a8663-c74f-4126-8c3e-14624496f8bb None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:20.270888 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a8663-c74f-4126-8c3e-14624496f8bb None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:20.271127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a8663-c74f-4126-8c3e-14624496f8bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:20.271778 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a8663-c74f-4126-8c3e-14624496f8bb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:20.273133 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a8663-c74f-4126-8c3e-14624496f8bb None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:20.292989 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821912d6-ecb9-4d38-8a00-04150110cb83 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:20.293702 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821912d6-ecb9-4d38-8a00-04150110cb83 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:20.293702 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821912d6-ecb9-4d38-8a00-04150110cb83 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:20.294916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 402/786] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 02:13:20.300393 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5ed05-b86d-4666-bfdc-1061ffabb834 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:20.300677 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5ed05-b86d-4666-bfdc-1061ffabb834 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:20.300950 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5ed05-b86d-4666-bfdc-1061ffabb834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:20.319388 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-ecb5ed05-b86d-4666-bfdc-1061ffabb834 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:20.320568 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-ecb5ed05-b86d-4666-bfdc-1061ffabb834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:20.355262 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 385/787] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:13:20 2022] POST /identity/v3/endpoints => generated 327 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:13:20.396818 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a8663-c74f-4126-8c3e-14624496f8bb None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:20.409329 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 403/788] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 02:13:20.506994 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a8663-c74f-4126-8c3e-14624496f8bb None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:20.524905 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:20.545498 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53997163-0a24-4c69-aa78-e6236cd59bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:20.547485 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53997163-0a24-4c69-aa78-e6236cd59bfe None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:20.547773 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53997163-0a24-4c69-aa78-e6236cd59bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:20.548042 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53997163-0a24-4c69-aa78-e6236cd59bfe None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:20.560029 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53997163-0a24-4c69-aa78-e6236cd59bfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:13:20.569593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-53997163-0a24-4c69-aa78-e6236cd59bfe None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 02:13:20.569593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:20.569593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:20.569593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:20.569593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:20.569593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:20.569593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:20.569593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:20.569593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:20.569593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:20.569593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:20.569593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:20.569593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:13:20.569593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:13:20.569593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:13:20.569593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:13:20.570688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:13:20.570688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:13:20.570688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:13:20.570688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:13:20.570688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:20.570688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:20.570688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:20.570688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:20.570688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:20.570688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:20.570688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:20.570688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:20.570688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:20.570688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:20.570688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:20.570688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:20.571764 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:20.571764 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:20.571764 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:20.571764 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:20.571764 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:13:20.571764 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:13:20.571764 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:13:20.571764 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:13:20.571764 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:13:20.571764 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:13:20.571764 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 02:13:20.571764 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:20.571764 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 386/789] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 19 02:13:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:13:20.573213 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5ed05-b86d-4666-bfdc-1061ffabb834 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:20.677542 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:20.679271 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53997163-0a24-4c69-aa78-e6236cd59bfe None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:20.681588 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5ed05-b86d-4666-bfdc-1061ffabb834 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:20.718274 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd96fbd-6c95-47b4-b48a-da4860b79700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:20.719047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd96fbd-6c95-47b4-b48a-da4860b79700 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:20.719333 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd96fbd-6c95-47b4-b48a-da4860b79700 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:20.719606 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd96fbd-6c95-47b4-b48a-da4860b79700 None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:20.720273 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd96fbd-6c95-47b4-b48a-da4860b79700 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:20.720574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd96fbd-6c95-47b4-b48a-da4860b79700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:20.721946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd96fbd-6c95-47b4-b48a-da4860b79700 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:20.736461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 404/790] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Oct 19 02:13:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:20.738245 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd96fbd-6c95-47b4-b48a-da4860b79700 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:20.786270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53997163-0a24-4c69-aa78-e6236cd59bfe None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:20.820646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a04ce-1c37-4f34-9dd5-c118509c06d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:20.821266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a04ce-1c37-4f34-9dd5-c118509c06d7 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:20.821546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a04ce-1c37-4f34-9dd5-c118509c06d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:20.821811 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a04ce-1c37-4f34-9dd5-c118509c06d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:20.822933 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a04ce-1c37-4f34-9dd5-c118509c06d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:20.824359 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a04ce-1c37-4f34-9dd5-c118509c06d7 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:20.825918 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 387/791] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:13:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:13:20.831753 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a04ce-1c37-4f34-9dd5-c118509c06d7 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:20.858996 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd96fbd-6c95-47b4-b48a-da4860b79700 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:20.882670 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:20.899594 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a889fd2-9dda-41de-a6d1-dddaa59ff8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:20.904857 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a889fd2-9dda-41de-a6d1-dddaa59ff8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:20.904857 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a889fd2-9dda-41de-a6d1-dddaa59ff8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:20.904857 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a889fd2-9dda-41de-a6d1-dddaa59ff8d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:20.913157 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a889fd2-9dda-41de-a6d1-dddaa59ff8d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:20.914712 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a889fd2-9dda-41de-a6d1-dddaa59ff8d6 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:20.930697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-5a889fd2-9dda-41de-a6d1-dddaa59ff8d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:13:20.930697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:20.930697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:20.930697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:20.930697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:20.930697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:20.930697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:20.930697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:20.930697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:20.930697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:20.930697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:20.930697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:20.930697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:13:20.930697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:13:20.930697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:13:20.930697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:13:20.931872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:20.931872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:20.931872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:20.931872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:20.931872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:20.931872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:20.931872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:20.931872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:20.931872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:20.931872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:20.931872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:20.931872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:20.931872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:20.931872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:20.931872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:20.931872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:20.931872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:13:20.932757 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:13:20.932757 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:13:20.932757 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:20.932757 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 405/792] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:13:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:13:20.938320 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a889fd2-9dda-41de-a6d1-dddaa59ff8d6 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:20.943530 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a04ce-1c37-4f34-9dd5-c118509c06d7 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:20.953630 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:20.979672 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530df5e-0f01-4898-9866-485eed95de9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:20.980879 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530df5e-0f01-4898-9866-485eed95de9d None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:20.981258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530df5e-0f01-4898-9866-485eed95de9d None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:20.981628 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530df5e-0f01-4898-9866-485eed95de9d None admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:20.982726 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530df5e-0f01-4898-9866-485eed95de9d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:20.985234 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530df5e-0f01-4898-9866-485eed95de9d None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:21.045483 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a889fd2-9dda-41de-a6d1-dddaa59ff8d6 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:21.063790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 388/793] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 02:13:20 2022] POST /identity/v3/projects => generated 311 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:13:21.085052 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa1cbe-70b1-48fb-b6c7-cb13154f16fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:21.085682 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa1cbe-70b1-48fb-b6c7-cb13154f16fc None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:21.085954 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa1cbe-70b1-48fb-b6c7-cb13154f16fc None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:21.086219 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa1cbe-70b1-48fb-b6c7-cb13154f16fc None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:21.087006 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa1cbe-70b1-48fb-b6c7-cb13154f16fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:21.087306 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa1cbe-70b1-48fb-b6c7-cb13154f16fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:21.088712 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa1cbe-70b1-48fb-b6c7-cb13154f16fc None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:21.103715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 406/794] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:13:21.109959 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530df5e-0f01-4898-9866-485eed95de9d None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:21.227620 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:21.233731 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530df5e-0f01-4898-9866-485eed95de9d None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:21.271468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149eb570-2c62-478f-91a2-1b178a50e88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:21.272136 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eb570-2c62-478f-91a2-1b178a50e88d None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:21.272354 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eb570-2c62-478f-91a2-1b178a50e88d None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:21.272663 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eb570-2c62-478f-91a2-1b178a50e88d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:21.280920 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149eb570-2c62-478f-91a2-1b178a50e88d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:21.282373 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149eb570-2c62-478f-91a2-1b178a50e88d None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:21.295655 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-149eb570-2c62-478f-91a2-1b178a50e88d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 02:13:21.295655 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:21.295655 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:21.295655 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:21.295655 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:21.295655 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:21.295655 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:21.295655 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:21.295655 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:21.295655 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:21.295655 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:21.295655 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:21.295655 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 02:13:21.295655 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 02:13:21.295655 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 02:13:21.295655 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 02:13:21.297260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:21.297260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:21.297260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:13:21.297260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:13:21.297260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:13:21.297260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:13:21.297260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:21.297260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:21.297260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:21.297260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:21.297260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:21.297260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:21.297260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:21.297260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:21.297260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:21.297260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:21.297260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:21.297260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:21.298641 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:21.298641 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:21.298641 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 02:13:21.298641 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 02:13:21.298641 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 02:13:21.298641 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 02:13:21.298641 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 02:13:21.298641 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 02:13:21.298641 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 02:13:21.298641 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:21.298641 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 389/795] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 19 02:13:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:21.303545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa1cbe-70b1-48fb-b6c7-cb13154f16fc None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:21.380136 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:21.409282 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa1cbe-70b1-48fb-b6c7-cb13154f16fc None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:21.444759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327917f-c8ee-4ba4-90d4-9e84492d009a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:21.445361 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327917f-c8ee-4ba4-90d4-9e84492d009a None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:21.445642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327917f-c8ee-4ba4-90d4-9e84492d009a None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:21.445911 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327917f-c8ee-4ba4-90d4-9e84492d009a None admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:21.446636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327917f-c8ee-4ba4-90d4-9e84492d009a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:21.446967 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327917f-c8ee-4ba4-90d4-9e84492d009a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:21.448376 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327917f-c8ee-4ba4-90d4-9e84492d009a None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:21.470713 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 407/796] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 19 02:13:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:21.471963 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149eb570-2c62-478f-91a2-1b178a50e88d None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:21.572996 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149eb570-2c62-478f-91a2-1b178a50e88d None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:21.607109 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3438913-f7f3-4283-b065-6ed4a840fdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:21.607737 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3438913-f7f3-4283-b065-6ed4a840fdc0 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:21.608014 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3438913-f7f3-4283-b065-6ed4a840fdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:21.608281 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3438913-f7f3-4283-b065-6ed4a840fdc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:21.619682 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3438913-f7f3-4283-b065-6ed4a840fdc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:21.621126 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3438913-f7f3-4283-b065-6ed4a840fdc0 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:21.636202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-f3438913-f7f3-4283-b065-6ed4a840fdc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:13:21.636202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:21.636202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:21.636202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:21.636202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:21.636202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:21.636202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:21.636202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:21.636202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:21.636202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:21.636202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:21.636202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:21.636202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:13:21.636202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:13:21.636202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:13:21.636202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:13:21.637192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:21.637192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:21.637192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:21.637192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:21.637192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:21.637192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:21.637192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:21.637192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:21.637192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:21.637192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:21.637192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:21.637192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:21.637192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:21.637192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:21.637192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:21.637192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:21.637192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:13:21.643962 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:13:21.643962 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:13:21.643962 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:21.643962 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 390/797] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:21.645366 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327917f-c8ee-4ba4-90d4-9e84492d009a None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:21.748291 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327917f-c8ee-4ba4-90d4-9e84492d009a None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:21.781899 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:21.788239 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43584d3b-560b-40d7-8f1c-792cc4eb6e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:21.788921 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43584d3b-560b-40d7-8f1c-792cc4eb6e48 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:21.789267 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43584d3b-560b-40d7-8f1c-792cc4eb6e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:21.789608 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43584d3b-560b-40d7-8f1c-792cc4eb6e48 None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:21.790318 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43584d3b-560b-40d7-8f1c-792cc4eb6e48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:21.790692 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43584d3b-560b-40d7-8f1c-792cc4eb6e48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:21.792224 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43584d3b-560b-40d7-8f1c-792cc4eb6e48 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:21.808736 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 408/798] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:21.810585 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3438913-f7f3-4283-b065-6ed4a840fdc0 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:21.823139 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:21.917566 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3438913-f7f3-4283-b065-6ed4a840fdc0 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:21.953190 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39141b6b-9c49-48d7-81a6-5d6f0a482146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:21.953815 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39141b6b-9c49-48d7-81a6-5d6f0a482146 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:21.954089 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39141b6b-9c49-48d7-81a6-5d6f0a482146 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:21.954353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39141b6b-9c49-48d7-81a6-5d6f0a482146 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:21.961709 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39141b6b-9c49-48d7-81a6-5d6f0a482146 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:21.963217 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39141b6b-9c49-48d7-81a6-5d6f0a482146 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:21.974626 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-39141b6b-9c49-48d7-81a6-5d6f0a482146 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:13:21.974626 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:21.974626 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:21.974626 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:21.974626 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:21.974626 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:21.974626 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:21.974626 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:21.974626 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:21.974626 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:21.974626 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:21.974626 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:21.974626 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 02:13:21.974626 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 02:13:21.974626 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 02:13:21.975597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 02:13:21.975597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:21.975597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:21.975597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:21.975597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:21.975597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:21.975597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:21.975597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:21.975597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:21.975597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:21.975597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:21.975597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:21.975597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:21.975597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:21.975597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:21.975597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:21.975597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:21.976490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 02:13:21.976490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 02:13:21.976490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 02:13:21.976490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 02:13:21.976490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 02:13:21.976490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 02:13:21.976490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:13:21.976490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:21.978899 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 391/799] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:13:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:21.982019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43584d3b-560b-40d7-8f1c-792cc4eb6e48 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:22.093281 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43584d3b-560b-40d7-8f1c-792cc4eb6e48 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:22.129931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4074f18-17fe-44ef-b1c3-ae3baa753988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:22.130721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4074f18-17fe-44ef-b1c3-ae3baa753988 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:22.131121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4074f18-17fe-44ef-b1c3-ae3baa753988 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:22.131506 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4074f18-17fe-44ef-b1c3-ae3baa753988 None admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:22.132297 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4074f18-17fe-44ef-b1c3-ae3baa753988 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:22.132697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4074f18-17fe-44ef-b1c3-ae3baa753988 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:22.134223 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4074f18-17fe-44ef-b1c3-ae3baa753988 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:22.152251 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 409/800] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 02:13:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:13:22.153833 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39141b6b-9c49-48d7-81a6-5d6f0a482146 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:22.237694 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:22.277838 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39141b6b-9c49-48d7-81a6-5d6f0a482146 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:22.332005 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4847a95-4d5c-4b22-b728-c153ec73a1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:22.332715 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4847a95-4d5c-4b22-b728-c153ec73a1af None admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:22.332989 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4847a95-4d5c-4b22-b728-c153ec73a1af None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:22.333261 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4847a95-4d5c-4b22-b728-c153ec73a1af None admin] PATH_INFO: `/v3/projects/91449401454c493cbf423888db8b8454/users/58a78f75a63e4d258a4afbeb748e59f6/roles/2d76ac736d7141f285d30dcda647e0f4` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:22.337259 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4847a95-4d5c-4b22-b728-c153ec73a1af None admin] RBAC: Authorizing `identity:create_grant(project_id=91449401454c493cbf423888db8b8454, user_id=58a78f75a63e4d258a4afbeb748e59f6, role_id=2d76ac736d7141f285d30dcda647e0f4)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:22.340020 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4847a95-4d5c-4b22-b728-c153ec73a1af None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:22.407572 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 392/801] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 02:13:22 2022] PUT /identity/v3/projects/91449401454c493cbf423888db8b8454/users/58a78f75a63e4d258a4afbeb748e59f6/roles/2d76ac736d7141f285d30dcda647e0f4 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:13:22.692981 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca379e4-476f-4dab-9783-081702719d53 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:22.693481 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca379e4-476f-4dab-9783-081702719d53 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:22.693481 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca379e4-476f-4dab-9783-081702719d53 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:22.694984 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 410/802] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:22.700176 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda92ef-cd8c-4529-a357-93563f316566 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:22.700460 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda92ef-cd8c-4529-a357-93563f316566 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:22.700731 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda92ef-cd8c-4529-a357-93563f316566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:22.730914 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-bfda92ef-cd8c-4529-a357-93563f316566 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:22.732103 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-bfda92ef-cd8c-4529-a357-93563f316566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:22.802359 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 393/803] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:13:23.072842 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca379e4-476f-4dab-9783-081702719d53 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:23.126047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:23.178546 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca379e4-476f-4dab-9783-081702719d53 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:23.221769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b18a8f-00b3-4d7d-883d-c270d4439ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:23.222406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b18a8f-00b3-4d7d-883d-c270d4439ab9 None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:23.222682 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b18a8f-00b3-4d7d-883d-c270d4439ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:23.222984 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b18a8f-00b3-4d7d-883d-c270d4439ab9 None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:23.223691 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b18a8f-00b3-4d7d-883d-c270d4439ab9 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:23.225120 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b18a8f-00b3-4d7d-883d-c270d4439ab9 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:23.262777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.sql.core [None req-e5b18a8f-00b3-4d7d-883d-c270d4439ab9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 02:13:23.262777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 02:13:23.262777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [parameters: {'id': '2a30aa2e9c9140c5b4a5a980c9830f63', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 19 02:13:23.262777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81670) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 02:13:23.271097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-e5b18a8f-00b3-4d7d-883d-c270d4439ab9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 19 02:13:23.271097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:23.271097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 02:13:23.271097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 02:13:23.271097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 02:13:23.271097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 02:13:23.271097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 02:13:23.271097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 02:13:23.271097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 02:13:23.271097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application conn.query(q) Oct 19 02:13:23.271097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 02:13:23.271097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 02:13:23.271097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 02:13:23.271097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application result.read() Oct 19 02:13:23.272358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 02:13:23.272358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 02:13:23.272358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 02:13:23.272358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 02:13:23.272358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 02:13:23.272358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 02:13:23.272358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 02:13:23.272358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 02:13:23.272358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 02:13:23.272358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:23.272358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 02:13:23.272358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:23.272358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:23.272358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 02:13:23.272358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 02:13:23.272358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 19 02:13:23.272358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 19 02:13:23.272358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 02:13:23.273380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application next(self.gen) Oct 19 02:13:23.273380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 02:13:23.273380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application yield resource Oct 19 02:13:23.273380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 02:13:23.273380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application next(self.gen) Oct 19 02:13:23.273380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 02:13:23.273380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 02:13:23.273380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 02:13:23.273380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 02:13:23.273380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 02:13:23.273380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise self.value Oct 19 02:13:23.273380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 02:13:23.273380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 02:13:23.273380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 02:13:23.273380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application session.commit() Oct 19 02:13:23.273380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 02:13:23.273380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 02:13:23.274417 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 02:13:23.274417 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 02:13:23.274417 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 02:13:23.274417 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self.session.flush() Oct 19 02:13:23.274417 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 02:13:23.274417 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 02:13:23.274417 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 02:13:23.274417 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 02:13:23.274417 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 02:13:23.274417 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application compat.raise_( Oct 19 02:13:23.274417 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 02:13:23.274417 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception Oct 19 02:13:23.274417 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 02:13:23.274417 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 02:13:23.274417 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 02:13:23.274417 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 02:13:23.274417 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 02:13:23.275352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 02:13:23.275352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 02:13:23.275352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 02:13:23.275352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 19 02:13:23.275352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 19 02:13:23.275352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 02:13:23.275352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 02:13:23.275352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 02:13:23.275352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 02:13:23.275352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 02:13:23.275352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 02:13:23.275352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 02:13:23.275352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 02:13:23.275352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 02:13:23.275352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 02:13:23.276144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 02:13:23.276144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception Oct 19 02:13:23.276144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 02:13:23.276144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 02:13:23.276144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 02:13:23.276144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 02:13:23.276144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 02:13:23.276144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 02:13:23.276144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 02:13:23.276144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application conn.query(q) Oct 19 02:13:23.276144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 02:13:23.276144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 02:13:23.276144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 02:13:23.276144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application result.read() Oct 19 02:13:23.276144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 02:13:23.276144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 02:13:23.276144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 02:13:23.277015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 02:13:23.277015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 02:13:23.277015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 02:13:23.277015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 02:13:23.277015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 02:13:23.277015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 02:13:23.277015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 02:13:23.277015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [parameters: {'id': '2a30aa2e9c9140c5b4a5a980c9830f63', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 19 02:13:23.277015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 02:13:23.277015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:23.277015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:13:23.277015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:23.277015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:23.277015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 19 02:13:23.277015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 19 02:13:23.277887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 02:13:23.277887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 02:13:23.277887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 19 02:13:23.277887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:23.277887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:13:23.277887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:23.277887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:23.277887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:23.277887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:23.277887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:23.277887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:23.277887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:23.277887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:23.277887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:23.277887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:23.277887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:23.277887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:23.278829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 19 02:13:23.278829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 19 02:13:23.278829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:23.278829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:23.278829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 19 02:13:23.278829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 19 02:13:23.278829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:23.278829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:23.278829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 19 02:13:23.278829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 19 02:13:23.278829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 19 02:13:23.278829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:23.278829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 411/804] 10.222.0.16 () {60 vars in 1137 bytes} [Wed Oct 19 02:13:23 2022] POST /identity/v3/domains => generated 190 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:23.282936 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda92ef-cd8c-4529-a357-93563f316566 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:23.335644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374ebd4-3058-4639-8758-99749901e804 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:23.335958 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374ebd4-3058-4639-8758-99749901e804 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:23.336132 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374ebd4-3058-4639-8758-99749901e804 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:23.337454 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 412/805] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:23.342332 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2634355-a05d-4edf-98a7-2b81139cead4 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:23.342647 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2634355-a05d-4edf-98a7-2b81139cead4 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:23.342971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2634355-a05d-4edf-98a7-2b81139cead4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:23.346328 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:23.362029 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-d2634355-a05d-4edf-98a7-2b81139cead4 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:23.363396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-d2634355-a05d-4edf-98a7-2b81139cead4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:23.391932 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda92ef-cd8c-4529-a357-93563f316566 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:23.425857 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3ead4-8aac-416b-b0c1-181fd0e92bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:23.426701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3ead4-8aac-416b-b0c1-181fd0e92bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:23.427166 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3ead4-8aac-416b-b0c1-181fd0e92bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:23.427438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3ead4-8aac-416b-b0c1-181fd0e92bf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:23.437447 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 413/806] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 02:13:23.438478 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3ead4-8aac-416b-b0c1-181fd0e92bf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:23.439957 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3ead4-8aac-416b-b0c1-181fd0e92bf1 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:23.454657 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-3ed3ead4-8aac-416b-b0c1-181fd0e92bf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:13:23.454657 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:23.454657 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:23.454657 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:23.454657 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:23.454657 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:23.454657 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:23.454657 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:23.454657 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:23.454657 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:23.454657 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:23.454657 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:23.454657 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:13:23.454657 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:13:23.454657 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:13:23.454657 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:13:23.455790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:23.455790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:23.455790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:23.455790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:23.455790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:23.455790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:23.455790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:23.455790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:23.455790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:23.455790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:23.455790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:23.455790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:23.455790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:23.455790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:23.455790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:23.455790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:23.455790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:13:23.456680 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:13:23.456680 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:13:23.456680 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:23.456680 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 394/807] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:13:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:23.462857 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2634355-a05d-4edf-98a7-2b81139cead4 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:23.511098 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:23.564829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2634355-a05d-4edf-98a7-2b81139cead4 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:23.599725 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a3d6d-acd3-45dc-898b-01bc14a0bb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:23.600250 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a3d6d-acd3-45dc-898b-01bc14a0bb07 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:23.600530 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a3d6d-acd3-45dc-898b-01bc14a0bb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:23.600795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a3d6d-acd3-45dc-898b-01bc14a0bb07 None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:23.601423 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a3d6d-acd3-45dc-898b-01bc14a0bb07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:23.601718 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a3d6d-acd3-45dc-898b-01bc14a0bb07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:23.603099 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a3d6d-acd3-45dc-898b-01bc14a0bb07 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:23.622850 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 414/808] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:23.711935 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3ead4-8aac-416b-b0c1-181fd0e92bf1 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:23.822878 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3ead4-8aac-416b-b0c1-181fd0e92bf1 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:23.833443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:23.859782 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8217100-f541-416c-95a3-8a948ce593ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:23.860658 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8217100-f541-416c-95a3-8a948ce593ef None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:23.861098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8217100-f541-416c-95a3-8a948ce593ef None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:23.861371 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8217100-f541-416c-95a3-8a948ce593ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:23.862481 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8217100-f541-416c-95a3-8a948ce593ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:23.863992 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8217100-f541-416c-95a3-8a948ce593ef None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:23.865562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 395/809] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:13:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:23.871521 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a3d6d-acd3-45dc-898b-01bc14a0bb07 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:23.981778 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a3d6d-acd3-45dc-898b-01bc14a0bb07 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:23.984794 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:24.015663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff2686-03d1-46d7-8a92-142c8de488b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:24.016266 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff2686-03d1-46d7-8a92-142c8de488b9 None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:24.016546 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff2686-03d1-46d7-8a92-142c8de488b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:24.016817 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff2686-03d1-46d7-8a92-142c8de488b9 None admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:24.017472 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff2686-03d1-46d7-8a92-142c8de488b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:24.019005 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff2686-03d1-46d7-8a92-142c8de488b9 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:24.132371 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 415/810] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 02:13:23 2022] POST /identity/v3/users => generated 285 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:13:24.599690 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9237d1-9347-42e7-b383-ce1200c31750 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:24.600200 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9237d1-9347-42e7-b383-ce1200c31750 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:24.600200 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9237d1-9347-42e7-b383-ce1200c31750 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:24.601497 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 396/811] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:24.606753 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87df25-79a9-4b0a-aa53-b0271515e358 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:24.607142 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87df25-79a9-4b0a-aa53-b0271515e358 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:24.607486 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87df25-79a9-4b0a-aa53-b0271515e358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:24.626189 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-8a87df25-79a9-4b0a-aa53-b0271515e358 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:24.627446 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-8a87df25-79a9-4b0a-aa53-b0271515e358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:24.694802 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 416/812] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:13:24.964735 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9237d1-9347-42e7-b383-ce1200c31750 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:25.068951 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9237d1-9347-42e7-b383-ce1200c31750 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:25.102781 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e1dfc-82d5-42d1-a797-a9dd3b7443de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:25.103419 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e1dfc-82d5-42d1-a797-a9dd3b7443de None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:25.103690 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e1dfc-82d5-42d1-a797-a9dd3b7443de None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:25.103960 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e1dfc-82d5-42d1-a797-a9dd3b7443de None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:25.114145 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e1dfc-82d5-42d1-a797-a9dd3b7443de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:13:25.118835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-fb9e1dfc-82d5-42d1-a797-a9dd3b7443de None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 02:13:25.118835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:25.118835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:25.118835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:25.118835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:25.118835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:25.118835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:25.118835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:25.118835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:25.118835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:25.118835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:25.118835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:25.118835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:13:25.118835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:13:25.118835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:13:25.118835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:13:25.119805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:13:25.119805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:13:25.119805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:13:25.119805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:13:25.119805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:25.119805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:25.119805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:25.119805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:25.119805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:25.119805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:25.119805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:25.119805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:25.119805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:25.119805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:25.119805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:25.119805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:25.120649 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:25.120649 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:25.120649 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:25.120649 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:25.120649 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:13:25.120649 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:13:25.120649 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:13:25.120649 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:13:25.120649 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:13:25.120649 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:13:25.120649 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 02:13:25.120649 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:25.120649 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 397/813] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 19 02:13:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:25.126932 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87df25-79a9-4b0a-aa53-b0271515e358 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:25.215784 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:25.225907 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87df25-79a9-4b0a-aa53-b0271515e358 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:25.259290 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ac57e-2894-4bdd-855a-d5333463f2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:25.259898 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ac57e-2894-4bdd-855a-d5333463f2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:25.260332 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ac57e-2894-4bdd-855a-d5333463f2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:25.261023 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ac57e-2894-4bdd-855a-d5333463f2c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:25.261820 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ac57e-2894-4bdd-855a-d5333463f2c7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:25.262124 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ac57e-2894-4bdd-855a-d5333463f2c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:25.263616 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ac57e-2894-4bdd-855a-d5333463f2c7 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:25.272238 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 417/814] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Oct 19 02:13:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:25.278000 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e1dfc-82d5-42d1-a797-a9dd3b7443de None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:25.317187 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:25.381464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e1dfc-82d5-42d1-a797-a9dd3b7443de None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:25.414721 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb069c6-24c3-4ca5-a198-9b588808e6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:25.415392 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb069c6-24c3-4ca5-a198-9b588808e6fb None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:25.415674 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb069c6-24c3-4ca5-a198-9b588808e6fb None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:25.415942 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb069c6-24c3-4ca5-a198-9b588808e6fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:25.426561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb069c6-24c3-4ca5-a198-9b588808e6fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:25.428070 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb069c6-24c3-4ca5-a198-9b588808e6fb None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:25.443156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-fbb069c6-24c3-4ca5-a198-9b588808e6fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:13:25.443156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:25.443156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:25.443156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:25.443156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:25.443156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:25.443156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:25.443156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:25.443156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:25.443156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:25.443156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:25.443156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:25.443156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:13:25.443156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:13:25.443156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:13:25.443156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:13:25.444265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:25.444265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:25.444265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:25.444265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:25.444265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:25.444265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:25.444265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:25.444265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:25.444265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:25.444265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:25.444265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:25.444265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:25.444265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:25.444265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:25.444265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:25.444265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:25.444265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:13:25.445143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:13:25.445143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:13:25.445143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:25.445143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 398/815] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:13:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:25.450150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ac57e-2894-4bdd-855a-d5333463f2c7 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:25.549638 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ac57e-2894-4bdd-855a-d5333463f2c7 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:25.582286 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1b5a9-1b0e-4bf6-bf26-3da62d0dbeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:25.582903 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1b5a9-1b0e-4bf6-bf26-3da62d0dbeda None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:25.583184 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1b5a9-1b0e-4bf6-bf26-3da62d0dbeda None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:25.583452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1b5a9-1b0e-4bf6-bf26-3da62d0dbeda None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:25.584087 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1b5a9-1b0e-4bf6-bf26-3da62d0dbeda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:25.584383 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1b5a9-1b0e-4bf6-bf26-3da62d0dbeda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:25.585722 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1b5a9-1b0e-4bf6-bf26-3da62d0dbeda None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:25.597451 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 418/816] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:25.603002 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb069c6-24c3-4ca5-a198-9b588808e6fb None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:25.690570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:25.699988 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb069c6-24c3-4ca5-a198-9b588808e6fb None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:25.734074 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e122cbd-307a-44fb-b3da-e5c6e0a1c5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:25.734696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e122cbd-307a-44fb-b3da-e5c6e0a1c5c4 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:25.735135 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e122cbd-307a-44fb-b3da-e5c6e0a1c5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:25.735409 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e122cbd-307a-44fb-b3da-e5c6e0a1c5c4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:25.742250 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e122cbd-307a-44fb-b3da-e5c6e0a1c5c4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:25.743903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e122cbd-307a-44fb-b3da-e5c6e0a1c5c4 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:25.755243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-2e122cbd-307a-44fb-b3da-e5c6e0a1c5c4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 02:13:25.755243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:25.755243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:25.755243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:25.755243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:25.755243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:25.755243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:25.755243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:25.755243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:25.755243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:25.755243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:25.755243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:25.755243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 02:13:25.755243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 02:13:25.755243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 02:13:25.755243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 02:13:25.756322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:25.756322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:25.756322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:13:25.756322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:13:25.756322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:13:25.756322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:13:25.756322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:25.756322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:25.756322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:25.756322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:25.756322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:25.756322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:25.756322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:25.756322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:25.756322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:25.756322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:25.756322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:25.756322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:25.757303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:25.757303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:25.757303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 02:13:25.757303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 02:13:25.757303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 02:13:25.757303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 02:13:25.757303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 02:13:25.757303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 02:13:25.757303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 02:13:25.757303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:25.757303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 399/817] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 19 02:13:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:13:25.762144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1b5a9-1b0e-4bf6-bf26-3da62d0dbeda None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:25.777577 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:25.863648 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1b5a9-1b0e-4bf6-bf26-3da62d0dbeda None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:25.898501 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cfe55-31c3-406b-aec1-f83d934c29ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:25.899207 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cfe55-31c3-406b-aec1-f83d934c29ca None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:25.899488 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cfe55-31c3-406b-aec1-f83d934c29ca None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:25.899763 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cfe55-31c3-406b-aec1-f83d934c29ca None admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:25.900488 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340cfe55-31c3-406b-aec1-f83d934c29ca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:25.900796 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340cfe55-31c3-406b-aec1-f83d934c29ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:25.902214 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340cfe55-31c3-406b-aec1-f83d934c29ca None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:25.919306 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 419/818] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 19 02:13:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:25.924961 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e122cbd-307a-44fb-b3da-e5c6e0a1c5c4 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:26.026220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e122cbd-307a-44fb-b3da-e5c6e0a1c5c4 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:26.059661 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730c040-f6d1-4156-8990-970b2146f2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:26.060255 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730c040-f6d1-4156-8990-970b2146f2a9 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:26.060533 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730c040-f6d1-4156-8990-970b2146f2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:26.060806 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730c040-f6d1-4156-8990-970b2146f2a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:26.080316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:26.129137 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730c040-f6d1-4156-8990-970b2146f2a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:26.130525 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730c040-f6d1-4156-8990-970b2146f2a9 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:26.233003 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 400/819] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:13:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 19 02:13:26.238677 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cfe55-31c3-406b-aec1-f83d934c29ca None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:26.293299 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63f37b-c42c-40ae-a0c5-b1f7a4eb2552 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:26.293584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63f37b-c42c-40ae-a0c5-b1f7a4eb2552 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:26.293856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63f37b-c42c-40ae-a0c5-b1f7a4eb2552 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:26.295204 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 401/820] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 02:13:26.300734 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a7584-2363-47eb-8dc9-8752f2982a7a None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:26.301014 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a7584-2363-47eb-8dc9-8752f2982a7a None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:26.301283 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a7584-2363-47eb-8dc9-8752f2982a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:26.308259 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:26.319876 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-8d7a7584-2363-47eb-8dc9-8752f2982a7a None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:26.321084 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-8d7a7584-2363-47eb-8dc9-8752f2982a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:26.339849 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cfe55-31c3-406b-aec1-f83d934c29ca None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:26.367641 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:26.375787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630ce6f-65f0-459c-9a69-3794265d2f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:26.380766 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630ce6f-65f0-459c-9a69-3794265d2f8d None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:26.380766 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630ce6f-65f0-459c-9a69-3794265d2f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:26.380766 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630ce6f-65f0-459c-9a69-3794265d2f8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:26.386927 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630ce6f-65f0-459c-9a69-3794265d2f8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:26.388303 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630ce6f-65f0-459c-9a69-3794265d2f8d None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:26.388416 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 402/821] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 02:13:26.408644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-8630ce6f-65f0-459c-9a69-3794265d2f8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:13:26.408644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:26.408644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:26.408644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:26.408644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:26.408644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:26.408644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:26.408644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:26.408644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:26.408644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:26.408644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:26.408644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:26.408644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:13:26.408644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:13:26.408644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:13:26.408644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:13:26.409759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:26.409759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:26.409759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:26.409759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:26.409759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:26.409759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:26.409759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:26.409759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:26.409759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:26.409759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:26.409759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:26.409759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:26.409759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:26.409759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:26.409759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:26.409759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:26.409759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:13:26.410642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:13:26.410642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:13:26.410642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:26.410642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 420/822] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:13:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:26.415334 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a7584-2363-47eb-8dc9-8752f2982a7a None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:26.511311 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a7584-2363-47eb-8dc9-8752f2982a7a None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:26.544668 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b240a5f-055f-44f5-88bd-a14a9fe4219c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:26.545263 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b240a5f-055f-44f5-88bd-a14a9fe4219c None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:26.545538 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b240a5f-055f-44f5-88bd-a14a9fe4219c None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:26.545832 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b240a5f-055f-44f5-88bd-a14a9fe4219c None admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:26.546464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b240a5f-055f-44f5-88bd-a14a9fe4219c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:26.546763 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b240a5f-055f-44f5-88bd-a14a9fe4219c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:26.548140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b240a5f-055f-44f5-88bd-a14a9fe4219c None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:26.559282 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 403/823] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:26.565021 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630ce6f-65f0-459c-9a69-3794265d2f8d None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:26.657192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b240a5f-055f-44f5-88bd-a14a9fe4219c None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:26.702709 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:26.763836 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b240a5f-055f-44f5-88bd-a14a9fe4219c None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:26.779071 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630ce6f-65f0-459c-9a69-3794265d2f8d None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:26.797586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88c16b-d4b0-41b8-a5f9-e7e25b594a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:26.798200 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88c16b-d4b0-41b8-a5f9-e7e25b594a65 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:26.798472 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88c16b-d4b0-41b8-a5f9-e7e25b594a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:26.798738 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88c16b-d4b0-41b8-a5f9-e7e25b594a65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:26.802958 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:26.809459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88c16b-d4b0-41b8-a5f9-e7e25b594a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:13:26.814400 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fb313-5c04-4c62-b187-6f5b7fe82f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:26.814726 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-ca88c16b-d4b0-41b8-a5f9-e7e25b594a65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:13:26.814726 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:26.814726 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:26.814726 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:26.814726 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:26.814726 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:26.814726 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:26.814726 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:26.814726 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:26.814726 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:26.814726 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:26.814726 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:26.814726 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:13:26.814726 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:13:26.814726 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:13:26.814726 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:13:26.816406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:13:26.816406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:13:26.816406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:13:26.816406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:13:26.816406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:26.816406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:26.816406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:26.816406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:26.816406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:26.816406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:26.816406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:26.816406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:26.816406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:26.816406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:26.816406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:26.816406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:26.817563 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:26.817563 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:26.817563 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:26.817563 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:26.817563 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:13:26.817563 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:13:26.817563 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:13:26.817563 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:13:26.817563 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:13:26.817563 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:13:26.817563 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:13:26.817563 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:26.818360 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fb313-5c04-4c62-b187-6f5b7fe82f06 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:26.818360 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fb313-5c04-4c62-b187-6f5b7fe82f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:26.818360 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fb313-5c04-4c62-b187-6f5b7fe82f06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:26.818610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 404/824] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 02:13:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:13:26.821716 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88c16b-d4b0-41b8-a5f9-e7e25b594a65 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:26.824477 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189fb313-5c04-4c62-b187-6f5b7fe82f06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:26.826751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189fb313-5c04-4c62-b187-6f5b7fe82f06 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:26.840161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-189fb313-5c04-4c62-b187-6f5b7fe82f06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:13:26.840161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:26.840161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:26.840161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:26.840161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:26.840161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:26.840161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:26.840161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:26.840161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:26.840161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:26.840161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:26.840161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:26.840161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 02:13:26.840161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 02:13:26.840161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 02:13:26.841053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 02:13:26.841053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:26.841053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:26.841053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:26.841053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:26.841053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:26.841053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:26.841053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:26.841053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:26.841053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:26.841053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:26.841053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:26.841053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:26.841053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:26.841053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:26.841053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:26.841053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:26.843308 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 02:13:26.843308 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 02:13:26.843308 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 02:13:26.843308 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 02:13:26.843308 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 02:13:26.843308 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 02:13:26.843308 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:13:26.843308 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:26.843308 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 421/825] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:13:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:13:26.847944 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fb313-5c04-4c62-b187-6f5b7fe82f06 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:26.918610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:26.921858 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88c16b-d4b0-41b8-a5f9-e7e25b594a65 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:26.947795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fb313-5c04-4c62-b187-6f5b7fe82f06 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:26.956196 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24b051-414d-4de7-8c08-d836acdbb3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:26.956799 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24b051-414d-4de7-8c08-d836acdbb3ac None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:26.957077 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24b051-414d-4de7-8c08-d836acdbb3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:26.957347 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24b051-414d-4de7-8c08-d836acdbb3ac None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:26.958009 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24b051-414d-4de7-8c08-d836acdbb3ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:26.958309 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24b051-414d-4de7-8c08-d836acdbb3ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:26.959702 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24b051-414d-4de7-8c08-d836acdbb3ac None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:26.967541 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 405/826] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:13:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:13:26.973413 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24b051-414d-4de7-8c08-d836acdbb3ac None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:26.986201 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113835fc-cb6e-42de-acc5-48a560608c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:26.986801 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113835fc-cb6e-42de-acc5-48a560608c34 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:26.987114 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113835fc-cb6e-42de-acc5-48a560608c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:26.987382 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113835fc-cb6e-42de-acc5-48a560608c34 None admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:26.988248 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113835fc-cb6e-42de-acc5-48a560608c34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:26.988931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113835fc-cb6e-42de-acc5-48a560608c34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:26.990355 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113835fc-cb6e-42de-acc5-48a560608c34 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:27.002535 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 422/827] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 02:13:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:13:27.008479 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113835fc-cb6e-42de-acc5-48a560608c34 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:27.050748 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:27.073189 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24b051-414d-4de7-8c08-d836acdbb3ac None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:27.106015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f214f9-7822-46f0-a9c6-fb61fe56f1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:27.106636 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f214f9-7822-46f0-a9c6-fb61fe56f1d6 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:27.106911 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113835fc-cb6e-42de-acc5-48a560608c34 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:27.107012 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f214f9-7822-46f0-a9c6-fb61fe56f1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:27.107205 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f214f9-7822-46f0-a9c6-fb61fe56f1d6 None admin] PATH_INFO: `/v3/users/14ff8ab58aff4799853aed5379abeed5` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:27.120886 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f214f9-7822-46f0-a9c6-fb61fe56f1d6 None admin] RBAC: Authorizing `identity:get_user(user_id=14ff8ab58aff4799853aed5379abeed5)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:27.122314 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f214f9-7822-46f0-a9c6-fb61fe56f1d6 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:27.129751 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 406/828] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:13:26 2022] GET /identity/v3/users/14ff8ab58aff4799853aed5379abeed5 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:13:27.130738 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f214f9-7822-46f0-a9c6-fb61fe56f1d6 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:27.141370 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710129e4-10d8-470a-a514-0309f8e4c484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:27.141968 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710129e4-10d8-470a-a514-0309f8e4c484 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:27.142236 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710129e4-10d8-470a-a514-0309f8e4c484 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:27.142504 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710129e4-10d8-470a-a514-0309f8e4c484 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:27.143247 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710129e4-10d8-470a-a514-0309f8e4c484 None admin] RBAC: Adding query filter params (role.id=2d76ac736d7141f285d30dcda647e0f4, scope.project.id=91449401454c493cbf423888db8b8454, user.id=58a78f75a63e4d258a4afbeb748e59f6) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:27.143548 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710129e4-10d8-470a-a514-0309f8e4c484 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:27.144960 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710129e4-10d8-470a-a514-0309f8e4c484 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:27.157724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 423/829] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 02:13:27 2022] GET /identity/v3/role_assignments?user.id=58a78f75a63e4d258a4afbeb748e59f6&scope.project.id=91449401454c493cbf423888db8b8454&role.id=2d76ac736d7141f285d30dcda647e0f4 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:13:27.164970 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:27.239121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f214f9-7822-46f0-a9c6-fb61fe56f1d6 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:27.274838 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff90c5b-e5f0-4db9-8321-d5694cd5092f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:27.275505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff90c5b-e5f0-4db9-8321-d5694cd5092f None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:27.275779 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff90c5b-e5f0-4db9-8321-d5694cd5092f None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:27.278708 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff90c5b-e5f0-4db9-8321-d5694cd5092f None admin] PATH_INFO: `/v3/projects/a1e1dd9f210446bfa8c0e4f2cc6e7e62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:27.278708 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff90c5b-e5f0-4db9-8321-d5694cd5092f None admin] RBAC: Authorizing `identity:get_project(project_id=a1e1dd9f210446bfa8c0e4f2cc6e7e62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:27.278708 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff90c5b-e5f0-4db9-8321-d5694cd5092f None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:27.280933 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 407/830] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:13:27 2022] GET /identity/v3/projects/a1e1dd9f210446bfa8c0e4f2cc6e7e62 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:27.287171 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710129e4-10d8-470a-a514-0309f8e4c484 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:27.392191 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710129e4-10d8-470a-a514-0309f8e4c484 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:27.399300 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:27.427584 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd14aef-98b7-4e38-8ac0-2797cc676e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:27.428237 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd14aef-98b7-4e38-8ac0-2797cc676e5f None admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:27.428519 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd14aef-98b7-4e38-8ac0-2797cc676e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:27.428785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd14aef-98b7-4e38-8ac0-2797cc676e5f None admin] PATH_INFO: `/v3/projects/a1e1dd9f210446bfa8c0e4f2cc6e7e62/users/14ff8ab58aff4799853aed5379abeed5/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:27.430854 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd14aef-98b7-4e38-8ac0-2797cc676e5f None admin] RBAC: Authorizing `identity:create_grant(project_id=a1e1dd9f210446bfa8c0e4f2cc6e7e62, user_id=14ff8ab58aff4799853aed5379abeed5, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:27.432164 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd14aef-98b7-4e38-8ac0-2797cc676e5f None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:27.482668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 424/831] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 02:13:27 2022] PUT /identity/v3/projects/a1e1dd9f210446bfa8c0e4f2cc6e7e62/users/14ff8ab58aff4799853aed5379abeed5/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:13:29.609137 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af62485-19b0-4e49-b487-c5baf8339c19 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:29.609654 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af62485-19b0-4e49-b487-c5baf8339c19 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:29.609654 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af62485-19b0-4e49-b487-c5baf8339c19 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:29.611021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 408/832] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:29.616151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb63de-884c-415c-bf89-6ca06231dd1a None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:29.616553 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb63de-884c-415c-bf89-6ca06231dd1a None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:29.616702 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb63de-884c-415c-bf89-6ca06231dd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:29.635128 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-35cb63de-884c-415c-bf89-6ca06231dd1a None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:29.636299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-35cb63de-884c-415c-bf89-6ca06231dd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:29.700968 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 425/833] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:13:29.967790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af62485-19b0-4e49-b487-c5baf8339c19 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:30.054147 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:30.066683 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af62485-19b0-4e49-b487-c5baf8339c19 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:30.100920 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fddb8-2869-4344-a80a-deafd0e7f5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:30.101538 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fddb8-2869-4344-a80a-deafd0e7f5f2 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:30.101815 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fddb8-2869-4344-a80a-deafd0e7f5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:30.102084 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fddb8-2869-4344-a80a-deafd0e7f5f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:30.112210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fddb8-2869-4344-a80a-deafd0e7f5f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:13:30.116948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-1d4fddb8-2869-4344-a80a-deafd0e7f5f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:13:30.116948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:30.116948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:30.116948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:30.116948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:30.116948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:30.116948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:30.116948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:30.116948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:30.116948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:30.116948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:30.116948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:30.116948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:13:30.116948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:13:30.116948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:13:30.116948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:13:30.118021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:13:30.118021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:13:30.118021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:13:30.118021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:13:30.118021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:30.118021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:30.118021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:30.118021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:30.118021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:30.118021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:30.118021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:30.118021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:30.118021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:30.118021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:30.118021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:30.118021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:30.119068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:30.119068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:30.119068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:30.119068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:30.119068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:13:30.119068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:13:30.119068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:13:30.119068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:13:30.119068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:13:30.119068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:13:30.119068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:13:30.119068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:30.119068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 409/834] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 02:13:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:30.124225 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb63de-884c-415c-bf89-6ca06231dd1a None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:30.214635 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:30.220918 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb63de-884c-415c-bf89-6ca06231dd1a None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:30.254118 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3cb1e-55e8-4ffc-8dbe-3479c2a8fa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:30.254708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3cb1e-55e8-4ffc-8dbe-3479c2a8fa92 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:30.255010 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3cb1e-55e8-4ffc-8dbe-3479c2a8fa92 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:30.255278 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3cb1e-55e8-4ffc-8dbe-3479c2a8fa92 None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:30.255934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3cb1e-55e8-4ffc-8dbe-3479c2a8fa92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:30.256229 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3cb1e-55e8-4ffc-8dbe-3479c2a8fa92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:30.262193 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3cb1e-55e8-4ffc-8dbe-3479c2a8fa92 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:30.265951 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 426/835] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:13:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:30.271926 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fddb8-2869-4344-a80a-deafd0e7f5f2 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:30.370098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fddb8-2869-4344-a80a-deafd0e7f5f2 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:30.404119 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028cfa9-c66a-4732-aad8-97f0025f7bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:30.404725 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028cfa9-c66a-4732-aad8-97f0025f7bee None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:30.405917 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028cfa9-c66a-4732-aad8-97f0025f7bee None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:30.406198 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028cfa9-c66a-4732-aad8-97f0025f7bee None admin] PATH_INFO: `/v3/users/14ff8ab58aff4799853aed5379abeed5` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:30.407321 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028cfa9-c66a-4732-aad8-97f0025f7bee None admin] RBAC: Authorizing `identity:get_user(user_id=14ff8ab58aff4799853aed5379abeed5)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:30.408735 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028cfa9-c66a-4732-aad8-97f0025f7bee None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:30.410288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 410/836] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:13:30 2022] GET /identity/v3/users/14ff8ab58aff4799853aed5379abeed5 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:13:30.416081 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3cb1e-55e8-4ffc-8dbe-3479c2a8fa92 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:30.528587 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3cb1e-55e8-4ffc-8dbe-3479c2a8fa92 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:30.562024 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9285e-6863-4fb5-9bfd-0a7698d4336f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:30.562626 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9285e-6863-4fb5-9bfd-0a7698d4336f None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:30.562928 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9285e-6863-4fb5-9bfd-0a7698d4336f None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:30.563200 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9285e-6863-4fb5-9bfd-0a7698d4336f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:30.588436 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:30.628935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9285e-6863-4fb5-9bfd-0a7698d4336f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:30.630379 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9285e-6863-4fb5-9bfd-0a7698d4336f None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:30.725275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 427/837] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:13:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 02:13:30.731156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028cfa9-c66a-4732-aad8-97f0025f7bee None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:30.749583 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:30.829052 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028cfa9-c66a-4732-aad8-97f0025f7bee None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:30.861875 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1daa3-7893-4186-8624-2d45b6c540b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:30.862485 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1daa3-7893-4186-8624-2d45b6c540b0 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:30.862760 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1daa3-7893-4186-8624-2d45b6c540b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:30.863055 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1daa3-7893-4186-8624-2d45b6c540b0 None admin] PATH_INFO: `/v3/projects/a1e1dd9f210446bfa8c0e4f2cc6e7e62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:30.864143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1daa3-7893-4186-8624-2d45b6c540b0 None admin] RBAC: Authorizing `identity:get_project(project_id=a1e1dd9f210446bfa8c0e4f2cc6e7e62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:30.865558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1daa3-7893-4186-8624-2d45b6c540b0 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:30.867179 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 411/838] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:13:30 2022] GET /identity/v3/projects/a1e1dd9f210446bfa8c0e4f2cc6e7e62 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:30.873222 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9285e-6863-4fb5-9bfd-0a7698d4336f None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:30.929434 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:30.969823 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9285e-6863-4fb5-9bfd-0a7698d4336f None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:31.004372 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294717c-878d-43b3-8380-c9bbce2c57cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:31.004962 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294717c-878d-43b3-8380-c9bbce2c57cd None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:31.005240 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294717c-878d-43b3-8380-c9bbce2c57cd None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:31.005507 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294717c-878d-43b3-8380-c9bbce2c57cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:31.006222 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294717c-878d-43b3-8380-c9bbce2c57cd None admin] RBAC: Adding query filter params (role.id=e2e7c80d19c141bc9f9bfc13c2ec2a12, scope.project.id=a1e1dd9f210446bfa8c0e4f2cc6e7e62, user.id=14ff8ab58aff4799853aed5379abeed5) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:31.006528 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294717c-878d-43b3-8380-c9bbce2c57cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:31.007978 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294717c-878d-43b3-8380-c9bbce2c57cd None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:31.013599 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 428/839] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 02:13:30 2022] GET /identity/v3/role_assignments?user.id=14ff8ab58aff4799853aed5379abeed5&scope.project.id=a1e1dd9f210446bfa8c0e4f2cc6e7e62&role.id=e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:33.154397 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55086dfe-09c5-4cf8-afd7-ca9d901f7377 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:33.155589 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55086dfe-09c5-4cf8-afd7-ca9d901f7377 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:33.155589 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55086dfe-09c5-4cf8-afd7-ca9d901f7377 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:33.156808 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 412/840] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:33.162158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d5d42-f7ee-46fb-9162-c33f297afefb None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:33.162589 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d5d42-f7ee-46fb-9162-c33f297afefb None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:33.162693 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d5d42-f7ee-46fb-9162-c33f297afefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:33.180441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-a32d5d42-f7ee-46fb-9162-c33f297afefb None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:33.181622 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-a32d5d42-f7ee-46fb-9162-c33f297afefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:33.247382 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 429/841] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:13:33.525604 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55086dfe-09c5-4cf8-afd7-ca9d901f7377 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:33.608691 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:33.625050 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55086dfe-09c5-4cf8-afd7-ca9d901f7377 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:33.658563 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a2aaa-5010-4061-a708-99b73e01ceab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:33.659201 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a2aaa-5010-4061-a708-99b73e01ceab None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:33.659478 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a2aaa-5010-4061-a708-99b73e01ceab None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:33.659754 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a2aaa-5010-4061-a708-99b73e01ceab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:33.660907 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a2aaa-5010-4061-a708-99b73e01ceab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:33.662329 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a2aaa-5010-4061-a708-99b73e01ceab None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:33.663897 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 413/842] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:13:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:33.669601 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d5d42-f7ee-46fb-9162-c33f297afefb None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:33.722235 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:33.768251 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d5d42-f7ee-46fb-9162-c33f297afefb None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:33.801238 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e17d03-d27d-4737-b433-3db7fce18353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:33.801767 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e17d03-d27d-4737-b433-3db7fce18353 None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:33.802038 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e17d03-d27d-4737-b433-3db7fce18353 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:33.802302 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e17d03-d27d-4737-b433-3db7fce18353 None admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:33.802974 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e17d03-d27d-4737-b433-3db7fce18353 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:33.804396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e17d03-d27d-4737-b433-3db7fce18353 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:33.881164 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 430/843] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 02:13:33 2022] POST /identity/v3/users => generated 286 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:13:36.034596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689e581-c9c7-4a7c-a118-d7487d4db73f None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:36.035185 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689e581-c9c7-4a7c-a118-d7487d4db73f None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:36.035185 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689e581-c9c7-4a7c-a118-d7487d4db73f None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:36.036529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 414/844] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:36.041792 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9f93d-96f0-4983-a39e-48a781d1743b None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:36.042215 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9f93d-96f0-4983-a39e-48a781d1743b None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:36.042333 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9f93d-96f0-4983-a39e-48a781d1743b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:36.061499 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-e1c9f93d-96f0-4983-a39e-48a781d1743b None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:36.062683 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-e1c9f93d-96f0-4983-a39e-48a781d1743b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:36.128920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 431/845] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:13:36.402990 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689e581-c9c7-4a7c-a118-d7487d4db73f None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:36.502970 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689e581-c9c7-4a7c-a118-d7487d4db73f None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:36.535730 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbaf31-afc5-4d08-9e8d-f00099ad8e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:36.536338 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbaf31-afc5-4d08-9e8d-f00099ad8e64 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:36.536616 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbaf31-afc5-4d08-9e8d-f00099ad8e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:36.536885 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbaf31-afc5-4d08-9e8d-f00099ad8e64 None admin] PATH_INFO: `/v3/roles/619c0bef418849679ac636aa63923dc9` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:36.538253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbaf31-afc5-4d08-9e8d-f00099ad8e64 None admin] RBAC: Authorizing `identity:get_role(role_id=619c0bef418849679ac636aa63923dc9)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:36.539639 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbaf31-afc5-4d08-9e8d-f00099ad8e64 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:36.540934 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 415/846] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:13:36 2022] GET /identity/v3/roles/619c0bef418849679ac636aa63923dc9 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:36.547885 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9f93d-96f0-4983-a39e-48a781d1743b None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:36.585500 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:36.642653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9f93d-96f0-4983-a39e-48a781d1743b None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:36.676416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dbfdf-8e37-41ca-baab-1be38463345b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:36.676974 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dbfdf-8e37-41ca-baab-1be38463345b None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:36.677249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dbfdf-8e37-41ca-baab-1be38463345b None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:36.677517 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dbfdf-8e37-41ca-baab-1be38463345b None admin] PATH_INFO: `/v3/users/f6a923450ace4d5bb1b2e8a6f8284674` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:36.690495 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8dbfdf-8e37-41ca-baab-1be38463345b None admin] RBAC: Authorizing `identity:get_user(user_id=f6a923450ace4d5bb1b2e8a6f8284674)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:36.691945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8dbfdf-8e37-41ca-baab-1be38463345b None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:36.693504 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 432/847] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:13:36 2022] GET /identity/v3/users/f6a923450ace4d5bb1b2e8a6f8284674 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:36.699203 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbaf31-afc5-4d08-9e8d-f00099ad8e64 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:36.721215 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:36.796549 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbaf31-afc5-4d08-9e8d-f00099ad8e64 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:36.829968 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902df308-5a18-4653-9ac3-2ff347d127c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:36.830581 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902df308-5a18-4653-9ac3-2ff347d127c7 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:36.830879 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902df308-5a18-4653-9ac3-2ff347d127c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:36.831152 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902df308-5a18-4653-9ac3-2ff347d127c7 None admin] PATH_INFO: `/v3/projects/a1e1dd9f210446bfa8c0e4f2cc6e7e62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:36.832245 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902df308-5a18-4653-9ac3-2ff347d127c7 None admin] RBAC: Authorizing `identity:get_project(project_id=a1e1dd9f210446bfa8c0e4f2cc6e7e62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:36.833661 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902df308-5a18-4653-9ac3-2ff347d127c7 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:36.835279 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 416/848] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:13:36 2022] GET /identity/v3/projects/a1e1dd9f210446bfa8c0e4f2cc6e7e62 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:36.841112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dbfdf-8e37-41ca-baab-1be38463345b None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:36.931846 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:36.937913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dbfdf-8e37-41ca-baab-1be38463345b None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:36.971618 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf3a6d-77b8-4bfc-b274-b67a03090b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:36.972255 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf3a6d-77b8-4bfc-b274-b67a03090b06 None admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:36.972531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf3a6d-77b8-4bfc-b274-b67a03090b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:36.972801 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf3a6d-77b8-4bfc-b274-b67a03090b06 None admin] PATH_INFO: `/v3/projects/a1e1dd9f210446bfa8c0e4f2cc6e7e62/users/f6a923450ace4d5bb1b2e8a6f8284674/roles/619c0bef418849679ac636aa63923dc9` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:36.974933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf3a6d-77b8-4bfc-b274-b67a03090b06 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1e1dd9f210446bfa8c0e4f2cc6e7e62, user_id=f6a923450ace4d5bb1b2e8a6f8284674, role_id=619c0bef418849679ac636aa63923dc9)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:36.976336 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf3a6d-77b8-4bfc-b274-b67a03090b06 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:37.036093 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 433/849] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 02:13:36 2022] PUT /identity/v3/projects/a1e1dd9f210446bfa8c0e4f2cc6e7e62/users/f6a923450ace4d5bb1b2e8a6f8284674/roles/619c0bef418849679ac636aa63923dc9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:13:39.145148 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486f775-7aad-4756-a79d-0707961bba8e None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:39.145752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486f775-7aad-4756-a79d-0707961bba8e None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:39.145752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486f775-7aad-4756-a79d-0707961bba8e None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:39.147089 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 417/850] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:39.152291 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cd75b-7c5b-4879-aef0-d80098760cce None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:39.152678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cd75b-7c5b-4879-aef0-d80098760cce None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:39.152859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cd75b-7c5b-4879-aef0-d80098760cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:39.172035 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-642cd75b-7c5b-4879-aef0-d80098760cce None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:39.173196 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-642cd75b-7c5b-4879-aef0-d80098760cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:39.239350 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 434/851] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:13:39.508316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486f775-7aad-4756-a79d-0707961bba8e None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:39.594137 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:39.606361 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486f775-7aad-4756-a79d-0707961bba8e None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:39.640262 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf67f2-00db-40a0-9c55-34e9afcffec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:39.640864 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf67f2-00db-40a0-9c55-34e9afcffec5 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:39.641142 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf67f2-00db-40a0-9c55-34e9afcffec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:39.641418 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf67f2-00db-40a0-9c55-34e9afcffec5 None admin] PATH_INFO: `/v3/roles/619c0bef418849679ac636aa63923dc9` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:39.642775 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf67f2-00db-40a0-9c55-34e9afcffec5 None admin] RBAC: Authorizing `identity:get_role(role_id=619c0bef418849679ac636aa63923dc9)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:39.644162 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf67f2-00db-40a0-9c55-34e9afcffec5 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:39.645450 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 418/852] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:13:39 2022] GET /identity/v3/roles/619c0bef418849679ac636aa63923dc9 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:39.651399 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cd75b-7c5b-4879-aef0-d80098760cce None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:39.733387 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:39.747449 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cd75b-7c5b-4879-aef0-d80098760cce None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:39.782415 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37f497-3552-44c1-9ce0-d9f00d88008d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:39.783017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37f497-3552-44c1-9ce0-d9f00d88008d None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:39.783505 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37f497-3552-44c1-9ce0-d9f00d88008d None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:39.783942 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37f497-3552-44c1-9ce0-d9f00d88008d None admin] PATH_INFO: `/v3/users/f6a923450ace4d5bb1b2e8a6f8284674` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:39.785409 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37f497-3552-44c1-9ce0-d9f00d88008d None admin] RBAC: Authorizing `identity:get_user(user_id=f6a923450ace4d5bb1b2e8a6f8284674)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:39.786840 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37f497-3552-44c1-9ce0-d9f00d88008d None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:39.788398 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 435/853] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:13:39 2022] GET /identity/v3/users/f6a923450ace4d5bb1b2e8a6f8284674 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:39.794215 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf67f2-00db-40a0-9c55-34e9afcffec5 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:39.891461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf67f2-00db-40a0-9c55-34e9afcffec5 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:39.923804 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7a92b-bc04-41f1-b245-2e5c828a552d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:39.924388 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7a92b-bc04-41f1-b245-2e5c828a552d None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:39.924660 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7a92b-bc04-41f1-b245-2e5c828a552d None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:39.924926 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7a92b-bc04-41f1-b245-2e5c828a552d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:39.948692 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:39.989498 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7a92b-bc04-41f1-b245-2e5c828a552d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:39.990947 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7a92b-bc04-41f1-b245-2e5c828a552d None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:40.083997 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 419/854] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:13:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 02:13:40.089908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37f497-3552-44c1-9ce0-d9f00d88008d None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:40.189417 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37f497-3552-44c1-9ce0-d9f00d88008d None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:40.222559 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8495cf4-7ef2-419b-8c0b-81296a332452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:40.223213 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8495cf4-7ef2-419b-8c0b-81296a332452 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:40.223493 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8495cf4-7ef2-419b-8c0b-81296a332452 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:40.223763 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8495cf4-7ef2-419b-8c0b-81296a332452 None admin] PATH_INFO: `/v3/projects/a1e1dd9f210446bfa8c0e4f2cc6e7e62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:40.224875 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8495cf4-7ef2-419b-8c0b-81296a332452 None admin] RBAC: Authorizing `identity:get_project(project_id=a1e1dd9f210446bfa8c0e4f2cc6e7e62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:40.226290 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8495cf4-7ef2-419b-8c0b-81296a332452 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:40.227948 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 436/855] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:13:40 2022] GET /identity/v3/projects/a1e1dd9f210446bfa8c0e4f2cc6e7e62 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:40.234709 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7a92b-bc04-41f1-b245-2e5c828a552d None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:40.289496 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:40.333405 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7a92b-bc04-41f1-b245-2e5c828a552d None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:40.365889 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615a14a-031c-47e7-b68d-d29aee21c043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:40.366469 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615a14a-031c-47e7-b68d-d29aee21c043 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:40.366741 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615a14a-031c-47e7-b68d-d29aee21c043 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:40.367037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615a14a-031c-47e7-b68d-d29aee21c043 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:40.367740 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615a14a-031c-47e7-b68d-d29aee21c043 None admin] RBAC: Adding query filter params (role.id=619c0bef418849679ac636aa63923dc9, scope.project.id=a1e1dd9f210446bfa8c0e4f2cc6e7e62, user.id=f6a923450ace4d5bb1b2e8a6f8284674) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:40.368041 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615a14a-031c-47e7-b68d-d29aee21c043 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:40.369445 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615a14a-031c-47e7-b68d-d29aee21c043 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:40.375855 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 420/856] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 02:13:40 2022] GET /identity/v3/role_assignments?user.id=f6a923450ace4d5bb1b2e8a6f8284674&scope.project.id=a1e1dd9f210446bfa8c0e4f2cc6e7e62&role.id=619c0bef418849679ac636aa63923dc9 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:42.546753 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d003d52-b9b0-4f55-98db-3bba4fd222a4 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:42.547293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d003d52-b9b0-4f55-98db-3bba4fd222a4 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:42.547293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d003d52-b9b0-4f55-98db-3bba4fd222a4 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:42.548562 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 437/857] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:42.553848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c7375-d320-438f-b183-e2b3b23f52c4 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:42.554261 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c7375-d320-438f-b183-e2b3b23f52c4 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:42.554404 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c7375-d320-438f-b183-e2b3b23f52c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:42.572989 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-958c7375-d320-438f-b183-e2b3b23f52c4 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:42.574176 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-958c7375-d320-438f-b183-e2b3b23f52c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:42.639238 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 421/858] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:13:42.905913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d003d52-b9b0-4f55-98db-3bba4fd222a4 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:42.930481 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:43.005053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d003d52-b9b0-4f55-98db-3bba4fd222a4 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:43.037829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e41ba-4378-4c46-aa33-97fca5de0968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:43.038435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e41ba-4378-4c46-aa33-97fca5de0968 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:43.038708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e41ba-4378-4c46-aa33-97fca5de0968 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:43.039123 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e41ba-4378-4c46-aa33-97fca5de0968 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:43.040219 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e41ba-4378-4c46-aa33-97fca5de0968 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:43.041631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e41ba-4378-4c46-aa33-97fca5de0968 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:43.043182 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 438/859] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:13:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:43.049513 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c7375-d320-438f-b183-e2b3b23f52c4 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:43.097531 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:43.147046 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c7375-d320-438f-b183-e2b3b23f52c4 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:43.179941 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38e623-c670-4758-b8fe-7bab461f51e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:43.180482 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38e623-c670-4758-b8fe-7bab461f51e7 None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:43.180758 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38e623-c670-4758-b8fe-7bab461f51e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:43.181026 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38e623-c670-4758-b8fe-7bab461f51e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:43.181691 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38e623-c670-4758-b8fe-7bab461f51e7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:43.183135 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38e623-c670-4758-b8fe-7bab461f51e7 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:43.259614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 422/860] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 02:13:43 2022] POST /identity/v3/projects => generated 311 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:13:45.417849 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d7809-ab8c-44b9-a98b-474cd7535621 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:45.418382 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d7809-ab8c-44b9-a98b-474cd7535621 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:45.418382 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d7809-ab8c-44b9-a98b-474cd7535621 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:45.420408 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 439/861] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:45.425490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efa604-43d2-4675-a128-44ca6099dfac None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:45.425871 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efa604-43d2-4675-a128-44ca6099dfac None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:45.426042 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efa604-43d2-4675-a128-44ca6099dfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:45.444897 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-93efa604-43d2-4675-a128-44ca6099dfac None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:45.446070 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-93efa604-43d2-4675-a128-44ca6099dfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:45.510602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 423/862] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 02:13:45.782249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d7809-ab8c-44b9-a98b-474cd7535621 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:45.871535 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:45.881522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d7809-ab8c-44b9-a98b-474cd7535621 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:45.915271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1d61c-b5a6-4c3b-902d-f4e6d3a2af2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:45.915886 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1d61c-b5a6-4c3b-902d-f4e6d3a2af2e None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:45.916161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1d61c-b5a6-4c3b-902d-f4e6d3a2af2e None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:45.916429 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1d61c-b5a6-4c3b-902d-f4e6d3a2af2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:45.917529 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1d61c-b5a6-4c3b-902d-f4e6d3a2af2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:45.918981 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1d61c-b5a6-4c3b-902d-f4e6d3a2af2e None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:45.920540 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 440/863] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:13:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:45.926248 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efa604-43d2-4675-a128-44ca6099dfac None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:45.956050 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:46.023766 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efa604-43d2-4675-a128-44ca6099dfac None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:46.057015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d98fa-5670-42e6-9d1f-3d952d599c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:46.057544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d98fa-5670-42e6-9d1f-3d952d599c53 None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:46.057818 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d98fa-5670-42e6-9d1f-3d952d599c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:46.058082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d98fa-5670-42e6-9d1f-3d952d599c53 None admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:46.059017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d98fa-5670-42e6-9d1f-3d952d599c53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:46.060870 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d98fa-5670-42e6-9d1f-3d952d599c53 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:46.166971 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 424/864] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 02:13:45 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:13:48.356035 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685af08-39d3-4c06-a30b-14980695eac6 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:48.356628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685af08-39d3-4c06-a30b-14980695eac6 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:48.356628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685af08-39d3-4c06-a30b-14980695eac6 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:48.358632 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 441/865] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:48.363695 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053fd5f-0bae-41b1-b518-eeb214430555 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:48.364099 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053fd5f-0bae-41b1-b518-eeb214430555 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:48.364235 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053fd5f-0bae-41b1-b518-eeb214430555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:48.382603 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-9053fd5f-0bae-41b1-b518-eeb214430555 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:48.383826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-9053fd5f-0bae-41b1-b518-eeb214430555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:48.447928 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 425/866] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:13:48.714105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685af08-39d3-4c06-a30b-14980695eac6 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:48.812791 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685af08-39d3-4c06-a30b-14980695eac6 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:48.845617 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7995e6-c096-415e-8f26-e1ef878d3a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:48.846225 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7995e6-c096-415e-8f26-e1ef878d3a35 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:48.846502 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7995e6-c096-415e-8f26-e1ef878d3a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:48.846774 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7995e6-c096-415e-8f26-e1ef878d3a35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:48.856496 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7995e6-c096-415e-8f26-e1ef878d3a35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:13:48.861769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-ab7995e6-c096-415e-8f26-e1ef878d3a35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:13:48.861769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:48.861769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:48.861769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:48.861769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:48.861769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:48.861769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:48.861769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:48.861769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:48.861769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:48.861769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:48.861769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:48.861769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:13:48.861769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:13:48.861769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:13:48.861769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:13:48.862931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:13:48.862931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:13:48.862931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:13:48.862931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:13:48.862931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:48.862931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:48.862931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:48.862931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:48.862931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:48.862931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:48.862931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:48.862931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:48.862931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:48.862931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:48.862931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:48.862931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:48.863999 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:48.863999 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:48.863999 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:48.863999 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:48.863999 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:13:48.863999 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:13:48.863999 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:13:48.863999 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:13:48.863999 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:13:48.863999 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:13:48.863999 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:13:48.863999 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:13:48.863999 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 442/867] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 02:13:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:48.868770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053fd5f-0bae-41b1-b518-eeb214430555 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:48.887025 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:48.966250 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053fd5f-0bae-41b1-b518-eeb214430555 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:48.999894 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14033c53-9daf-4644-8c20-21106e6ac48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:49.000487 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14033c53-9daf-4644-8c20-21106e6ac48e None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:49.000766 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14033c53-9daf-4644-8c20-21106e6ac48e None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:49.001042 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14033c53-9daf-4644-8c20-21106e6ac48e None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:49.001697 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14033c53-9daf-4644-8c20-21106e6ac48e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:49.002000 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14033c53-9daf-4644-8c20-21106e6ac48e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:49.003398 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14033c53-9daf-4644-8c20-21106e6ac48e None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:49.011143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 426/868] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:13:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:49.016804 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7995e6-c096-415e-8f26-e1ef878d3a35 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:49.035969 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:49.114213 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7995e6-c096-415e-8f26-e1ef878d3a35 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:49.147121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8db9c-4df4-400a-abc5-5aea955eb36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:49.147729 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8db9c-4df4-400a-abc5-5aea955eb36a None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:49.148004 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8db9c-4df4-400a-abc5-5aea955eb36a None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:49.148276 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8db9c-4df4-400a-abc5-5aea955eb36a None admin] PATH_INFO: `/v3/users/87e47648d30545f898796e89f1d7bf6c` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:49.161947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8db9c-4df4-400a-abc5-5aea955eb36a None admin] RBAC: Authorizing `identity:get_user(user_id=87e47648d30545f898796e89f1d7bf6c)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:49.163408 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8db9c-4df4-400a-abc5-5aea955eb36a None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:49.164960 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 443/869] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:13:49 2022] GET /identity/v3/users/87e47648d30545f898796e89f1d7bf6c => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:49.171266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14033c53-9daf-4644-8c20-21106e6ac48e None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:49.250201 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:49.268853 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14033c53-9daf-4644-8c20-21106e6ac48e None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:49.302197 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f0d72-5c2a-4ba2-8e5a-426f132838ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:49.302834 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f0d72-5c2a-4ba2-8e5a-426f132838ac None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:49.303110 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f0d72-5c2a-4ba2-8e5a-426f132838ac None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:49.303375 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f0d72-5c2a-4ba2-8e5a-426f132838ac None admin] PATH_INFO: `/v3/projects/ca1defc8feca485cae8d8a39983ab66c` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:49.304451 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f0d72-5c2a-4ba2-8e5a-426f132838ac None admin] RBAC: Authorizing `identity:get_project(project_id=ca1defc8feca485cae8d8a39983ab66c)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:49.305866 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f0d72-5c2a-4ba2-8e5a-426f132838ac None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:49.307501 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 427/870] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:13:49 2022] GET /identity/v3/projects/ca1defc8feca485cae8d8a39983ab66c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:13:49.313642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8db9c-4df4-400a-abc5-5aea955eb36a None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:49.387831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:49.410137 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8db9c-4df4-400a-abc5-5aea955eb36a None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:49.443949 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5755b6-0eb3-43a4-9b9b-67b64886ff40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:49.444588 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5755b6-0eb3-43a4-9b9b-67b64886ff40 None admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:49.444862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5755b6-0eb3-43a4-9b9b-67b64886ff40 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:49.445129 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5755b6-0eb3-43a4-9b9b-67b64886ff40 None admin] PATH_INFO: `/v3/projects/ca1defc8feca485cae8d8a39983ab66c/users/87e47648d30545f898796e89f1d7bf6c/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:49.447024 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5755b6-0eb3-43a4-9b9b-67b64886ff40 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca1defc8feca485cae8d8a39983ab66c, user_id=87e47648d30545f898796e89f1d7bf6c, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:49.448437 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5755b6-0eb3-43a4-9b9b-67b64886ff40 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:49.566508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 444/871] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 02:13:49 2022] PUT /identity/v3/projects/ca1defc8feca485cae8d8a39983ab66c/users/87e47648d30545f898796e89f1d7bf6c/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:13:51.679917 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71a240-9986-485d-9c7f-4272cb371587 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:51.680470 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71a240-9986-485d-9c7f-4272cb371587 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:51.680470 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71a240-9986-485d-9c7f-4272cb371587 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:51.681775 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 428/872] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:51.687807 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752524ac-5f88-4a33-a2d3-2222677b6572 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:51.688236 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752524ac-5f88-4a33-a2d3-2222677b6572 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:51.688353 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752524ac-5f88-4a33-a2d3-2222677b6572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:51.706634 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-752524ac-5f88-4a33-a2d3-2222677b6572 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:51.707853 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-752524ac-5f88-4a33-a2d3-2222677b6572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:51.772218 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 445/873] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:13:52.041942 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71a240-9986-485d-9c7f-4272cb371587 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:52.141061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71a240-9986-485d-9c7f-4272cb371587 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:52.174959 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c72c2-7d0b-402f-8a76-53645f3f2bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:52.175566 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c72c2-7d0b-402f-8a76-53645f3f2bec None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:52.175841 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c72c2-7d0b-402f-8a76-53645f3f2bec None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:52.176109 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c72c2-7d0b-402f-8a76-53645f3f2bec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:52.186114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c72c2-7d0b-402f-8a76-53645f3f2bec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:13:52.190793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-5e5c72c2-7d0b-402f-8a76-53645f3f2bec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:13:52.190793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:13:52.190793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:13:52.190793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:13:52.190793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:13:52.190793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:13:52.190793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:13:52.190793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:13:52.190793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:13:52.190793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:13:52.190793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:13:52.190793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:13:52.190793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:13:52.190793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:13:52.190793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:13:52.190793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:13:52.191890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:13:52.191890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:13:52.191890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:13:52.191890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:13:52.191890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:13:52.191890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:13:52.191890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:13:52.191890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:13:52.191890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:13:52.191890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:13:52.191890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:13:52.191890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:13:52.191890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:13:52.191890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:13:52.191890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:13:52.191890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:13:52.193033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:13:52.193033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:13:52.193033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:13:52.193033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:13:52.193033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:13:52.193033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:13:52.193033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:13:52.193033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:13:52.193033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:13:52.193033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:13:52.193033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:13:52.193033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:13:52.193033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 429/874] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 02:13:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:13:52.197808 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752524ac-5f88-4a33-a2d3-2222677b6572 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:52.262328 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:52.296267 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752524ac-5f88-4a33-a2d3-2222677b6572 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:52.329538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea82640-978c-43f6-a584-531367aac508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:52.330573 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea82640-978c-43f6-a584-531367aac508 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:52.330878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea82640-978c-43f6-a584-531367aac508 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:52.331156 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea82640-978c-43f6-a584-531367aac508 None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:52.331811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea82640-978c-43f6-a584-531367aac508 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:52.332112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea82640-978c-43f6-a584-531367aac508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:52.333467 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea82640-978c-43f6-a584-531367aac508 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:52.342017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 446/875] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:13:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:52.348154 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c72c2-7d0b-402f-8a76-53645f3f2bec None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:52.360238 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:52.446176 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c72c2-7d0b-402f-8a76-53645f3f2bec None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:52.478562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8fa65-912a-4cb1-b38d-70da9d021b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:52.479252 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8fa65-912a-4cb1-b38d-70da9d021b43 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:52.479535 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8fa65-912a-4cb1-b38d-70da9d021b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:52.479803 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8fa65-912a-4cb1-b38d-70da9d021b43 None admin] PATH_INFO: `/v3/users/87e47648d30545f898796e89f1d7bf6c` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:52.480902 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8fa65-912a-4cb1-b38d-70da9d021b43 None admin] RBAC: Authorizing `identity:get_user(user_id=87e47648d30545f898796e89f1d7bf6c)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:52.482946 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8fa65-912a-4cb1-b38d-70da9d021b43 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:52.484495 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 430/876] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:13:52 2022] GET /identity/v3/users/87e47648d30545f898796e89f1d7bf6c => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:52.490225 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea82640-978c-43f6-a584-531367aac508 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:52.588937 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea82640-978c-43f6-a584-531367aac508 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:52.614630 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:52.622098 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7050527-52c6-4139-bf9c-057d9a580dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:52.625244 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7050527-52c6-4139-bf9c-057d9a580dda None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:52.625244 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7050527-52c6-4139-bf9c-057d9a580dda None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:52.625244 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7050527-52c6-4139-bf9c-057d9a580dda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:52.691352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7050527-52c6-4139-bf9c-057d9a580dda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:52.692770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7050527-52c6-4139-bf9c-057d9a580dda None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:52.788510 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 447/877] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:13:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 02:13:52.794634 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8fa65-912a-4cb1-b38d-70da9d021b43 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:52.868889 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:52.891519 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8fa65-912a-4cb1-b38d-70da9d021b43 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:52.925694 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a007a3-e1a3-44e3-b16b-921ff50e06df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:52.926307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a007a3-e1a3-44e3-b16b-921ff50e06df None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:52.926584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a007a3-e1a3-44e3-b16b-921ff50e06df None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:52.926879 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a007a3-e1a3-44e3-b16b-921ff50e06df None admin] PATH_INFO: `/v3/projects/ca1defc8feca485cae8d8a39983ab66c` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:52.927987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a007a3-e1a3-44e3-b16b-921ff50e06df None admin] RBAC: Authorizing `identity:get_project(project_id=ca1defc8feca485cae8d8a39983ab66c)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:52.929413 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a007a3-e1a3-44e3-b16b-921ff50e06df None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:52.931052 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 431/878] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:13:52 2022] GET /identity/v3/projects/ca1defc8feca485cae8d8a39983ab66c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:52.937487 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7050527-52c6-4139-bf9c-057d9a580dda None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:52.964020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:53.034133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7050527-52c6-4139-bf9c-057d9a580dda None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:53.067343 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7b58c-aaa8-46cc-96b6-1ff8dafcb5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:53.067923 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7b58c-aaa8-46cc-96b6-1ff8dafcb5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:53.068196 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7b58c-aaa8-46cc-96b6-1ff8dafcb5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:53.068466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7b58c-aaa8-46cc-96b6-1ff8dafcb5d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:53.069178 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7b58c-aaa8-46cc-96b6-1ff8dafcb5d2 None admin] RBAC: Adding query filter params (role.id=e2e7c80d19c141bc9f9bfc13c2ec2a12, scope.project.id=ca1defc8feca485cae8d8a39983ab66c, user.id=87e47648d30545f898796e89f1d7bf6c) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:13:53.069484 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7b58c-aaa8-46cc-96b6-1ff8dafcb5d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:53.070919 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7b58c-aaa8-46cc-96b6-1ff8dafcb5d2 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:53.076538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 448/879] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 02:13:52 2022] GET /identity/v3/role_assignments?user.id=87e47648d30545f898796e89f1d7bf6c&scope.project.id=ca1defc8feca485cae8d8a39983ab66c&role.id=e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:55.203238 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddde9f8-4350-454d-86b5-bea284d22812 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:55.203767 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddde9f8-4350-454d-86b5-bea284d22812 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:55.203767 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddde9f8-4350-454d-86b5-bea284d22812 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:55.205100 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 432/880] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:55.210382 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407e376-3a04-4cdf-bb06-bf8ec801b4d9 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:55.210812 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407e376-3a04-4cdf-bb06-bf8ec801b4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:55.210951 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407e376-3a04-4cdf-bb06-bf8ec801b4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:55.229472 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-a407e376-3a04-4cdf-bb06-bf8ec801b4d9 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:55.230653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-a407e376-3a04-4cdf-bb06-bf8ec801b4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:55.295746 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 449/881] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:13:55.564600 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddde9f8-4350-454d-86b5-bea284d22812 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:55.663057 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddde9f8-4350-454d-86b5-bea284d22812 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:55.696199 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d2ea1-c8cb-4719-8449-98522ef7e1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:55.696783 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d2ea1-c8cb-4719-8449-98522ef7e1bc None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:55.697059 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d2ea1-c8cb-4719-8449-98522ef7e1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:55.697329 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d2ea1-c8cb-4719-8449-98522ef7e1bc None admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:55.697973 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d2ea1-c8cb-4719-8449-98522ef7e1bc None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:55.699366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d2ea1-c8cb-4719-8449-98522ef7e1bc None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:55.779318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 433/882] 10.222.0.16 () {60 vars in 1138 bytes} [Wed Oct 19 02:13:55 2022] POST /identity/v3/domains => generated 267 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:13:57.927415 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a37a8-cb84-4613-be10-0e08d1433f75 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:57.927979 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a37a8-cb84-4613-be10-0e08d1433f75 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:57.927979 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a37a8-cb84-4613-be10-0e08d1433f75 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:57.929273 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 450/883] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:13:57.935382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28e9c9-9d0d-46a9-a076-440acb3ad268 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:57.935815 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28e9c9-9d0d-46a9-a076-440acb3ad268 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:57.936061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28e9c9-9d0d-46a9-a076-440acb3ad268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:57.943233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:57.953956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-4a28e9c9-9d0d-46a9-a076-440acb3ad268 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:13:57.955156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-4a28e9c9-9d0d-46a9-a076-440acb3ad268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:13:58.018801 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 434/884] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:13:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:13:58.289779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a37a8-cb84-4613-be10-0e08d1433f75 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:58.315049 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:58.389054 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a37a8-cb84-4613-be10-0e08d1433f75 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:58.421696 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7afdc9-4e2f-4949-8982-be33f24c5588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:58.422307 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7afdc9-4e2f-4949-8982-be33f24c5588 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:58.422583 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7afdc9-4e2f-4949-8982-be33f24c5588 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:58.422876 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7afdc9-4e2f-4949-8982-be33f24c5588 None admin] PATH_INFO: `/v3/domains/1a9ea46146af4d368cb19024d5951f42` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:58.433043 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7afdc9-4e2f-4949-8982-be33f24c5588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1a9ea46146af4d368cb19024d5951f42)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:58.435590 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7afdc9-4e2f-4949-8982-be33f24c5588 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:58.437088 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 451/885] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Oct 19 02:13:58 2022] GET /identity/v3/domains/1a9ea46146af4d368cb19024d5951f42 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:13:58.442934 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a28e9c9-9d0d-46a9-a076-440acb3ad268 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:13:58.540263 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a28e9c9-9d0d-46a9-a076-440acb3ad268 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:13:58.574190 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c4caf-638f-475c-b554-735b22195e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:13:58.574779 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c4caf-638f-475c-b554-735b22195e27 None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:13:58.575113 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c4caf-638f-475c-b554-735b22195e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:13:58.575536 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c4caf-638f-475c-b554-735b22195e27 None admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:13:58.576174 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c4caf-638f-475c-b554-735b22195e27 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:13:58.577595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c4caf-638f-475c-b554-735b22195e27 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:13:58.581998 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:58.671106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 435/886] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 02:13:58 2022] POST /identity/v3/projects => generated 361 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:14:00.836489 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b6c44-d699-4784-b798-0ffb0e227168 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:14:00.837050 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b6c44-d699-4784-b798-0ffb0e227168 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:14:00.837050 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b6c44-d699-4784-b798-0ffb0e227168 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:14:00.838366 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 452/887] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:14:00.844135 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72734a-e8be-414d-bd32-81fb03868223 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:14:00.844576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72734a-e8be-414d-bd32-81fb03868223 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:14:00.844681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72734a-e8be-414d-bd32-81fb03868223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:14:00.862706 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-5e72734a-e8be-414d-bd32-81fb03868223 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:14:00.863909 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-5e72734a-e8be-414d-bd32-81fb03868223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:14:00.927738 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 436/888] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:14:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:14:01.198430 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b6c44-d699-4784-b798-0ffb0e227168 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:14:01.281198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:14:01.299515 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b6c44-d699-4784-b798-0ffb0e227168 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:14:01.333114 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30430e0-c346-4bed-a663-2a11b78636e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:14:01.333730 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30430e0-c346-4bed-a663-2a11b78636e0 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:14:01.334008 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30430e0-c346-4bed-a663-2a11b78636e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:14:01.334280 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30430e0-c346-4bed-a663-2a11b78636e0 None admin] PATH_INFO: `/v3/domains/1a9ea46146af4d368cb19024d5951f42` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:14:01.335403 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30430e0-c346-4bed-a663-2a11b78636e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1a9ea46146af4d368cb19024d5951f42)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:14:01.336855 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30430e0-c346-4bed-a663-2a11b78636e0 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:14:01.338401 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 453/889] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Oct 19 02:14:01 2022] GET /identity/v3/domains/1a9ea46146af4d368cb19024d5951f42 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:14:01.344168 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72734a-e8be-414d-bd32-81fb03868223 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:14:01.439636 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72734a-e8be-414d-bd32-81fb03868223 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:14:01.455913 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:14:01.472934 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74584792-b6e6-45a7-bf6b-4b45734b8be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:14:01.473527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74584792-b6e6-45a7-bf6b-4b45734b8be0 None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:14:01.473804 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74584792-b6e6-45a7-bf6b-4b45734b8be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:14:01.474073 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74584792-b6e6-45a7-bf6b-4b45734b8be0 None admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:14:01.474718 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74584792-b6e6-45a7-bf6b-4b45734b8be0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:14:01.476179 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74584792-b6e6-45a7-bf6b-4b45734b8be0 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:14:01.574086 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 437/890] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 02:14:01 2022] POST /identity/v3/users => generated 311 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:14:03.730758 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2859e-170e-4695-b10b-54f684623951 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:14:03.731886 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2859e-170e-4695-b10b-54f684623951 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:14:03.732021 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2859e-170e-4695-b10b-54f684623951 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:14:03.733334 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 454/891] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:14:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:14:03.738377 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd4123-c271-426b-8438-282a3cfdc4c0 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:14:03.738834 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd4123-c271-426b-8438-282a3cfdc4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:14:03.738945 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd4123-c271-426b-8438-282a3cfdc4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:14:03.756633 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-4bfd4123-c271-426b-8438-282a3cfdc4c0 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:14:03.757813 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-4bfd4123-c271-426b-8438-282a3cfdc4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:14:03.823187 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 438/892] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:14:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:14:04.096038 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2859e-170e-4695-b10b-54f684623951 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:14:04.195421 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2859e-170e-4695-b10b-54f684623951 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:14:04.228806 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cec3ed-611b-4fef-930f-3976a51e0411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:14:04.229432 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cec3ed-611b-4fef-930f-3976a51e0411 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:14:04.229711 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cec3ed-611b-4fef-930f-3976a51e0411 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:14:04.229987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cec3ed-611b-4fef-930f-3976a51e0411 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:14:04.240015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cec3ed-611b-4fef-930f-3976a51e0411 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:14:04.244838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-c0cec3ed-611b-4fef-930f-3976a51e0411 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:14:04.244838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:14:04.244838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:14:04.244838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:14:04.244838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:14:04.244838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:14:04.244838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:14:04.244838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:14:04.244838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:14:04.244838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:14:04.244838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:14:04.244838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:14:04.244838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:14:04.244838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:14:04.244838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:14:04.244838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:14:04.245913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:14:04.245913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:14:04.245913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:14:04.245913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:14:04.245913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:14:04.245913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:14:04.245913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:14:04.245913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:14:04.245913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:14:04.245913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:14:04.245913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:14:04.245913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:14:04.245913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:14:04.245913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:14:04.245913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:14:04.245913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:14:04.247538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:14:04.247538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:14:04.247538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:14:04.247538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:14:04.247538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:14:04.247538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:14:04.247538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:14:04.247538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:14:04.247538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:14:04.247538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:14:04.247538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:14:04.247538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:14:04.247538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 455/893] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 02:14:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:14:04.252770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd4123-c271-426b-8438-282a3cfdc4c0 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:14:04.349487 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd4123-c271-426b-8438-282a3cfdc4c0 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:14:04.350944 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:14:04.382579 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60ee17-2b0e-4fc5-831c-a6cbf34bfbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:14:04.385724 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60ee17-2b0e-4fc5-831c-a6cbf34bfbbc None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:14:04.385724 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60ee17-2b0e-4fc5-831c-a6cbf34bfbbc None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:14:04.385724 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60ee17-2b0e-4fc5-831c-a6cbf34bfbbc None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:14:04.385724 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60ee17-2b0e-4fc5-831c-a6cbf34bfbbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:14:04.385724 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60ee17-2b0e-4fc5-831c-a6cbf34bfbbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:14:04.386136 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60ee17-2b0e-4fc5-831c-a6cbf34bfbbc None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:14:04.393750 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 439/894] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:14:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:14:04.399588 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cec3ed-611b-4fef-930f-3976a51e0411 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:14:04.412726 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:14:04.498047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cec3ed-611b-4fef-930f-3976a51e0411 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:14:04.531018 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8990b1e-bd39-4c79-a878-8e7c0014d14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:14:04.531633 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8990b1e-bd39-4c79-a878-8e7c0014d14d None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:14:04.531907 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8990b1e-bd39-4c79-a878-8e7c0014d14d None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:14:04.532175 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8990b1e-bd39-4c79-a878-8e7c0014d14d None admin] PATH_INFO: `/v3/users/39fcbd682de44358be9b524cc0b3e5d0` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:14:04.545210 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8990b1e-bd39-4c79-a878-8e7c0014d14d None admin] RBAC: Authorizing `identity:get_user(user_id=39fcbd682de44358be9b524cc0b3e5d0)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:14:04.546629 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8990b1e-bd39-4c79-a878-8e7c0014d14d None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:14:04.548234 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 456/895] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:14:04 2022] GET /identity/v3/users/39fcbd682de44358be9b524cc0b3e5d0 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:14:04.554014 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60ee17-2b0e-4fc5-831c-a6cbf34bfbbc None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:14:04.651244 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60ee17-2b0e-4fc5-831c-a6cbf34bfbbc None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:14:04.683586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74dbf7-06a0-4213-ba8f-ea6f5d55bc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:14:04.684283 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74dbf7-06a0-4213-ba8f-ea6f5d55bc21 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:14:04.684587 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74dbf7-06a0-4213-ba8f-ea6f5d55bc21 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:14:04.684908 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74dbf7-06a0-4213-ba8f-ea6f5d55bc21 None admin] PATH_INFO: `/v3/projects/bddba4b09ebc4ac59c8ceed1b629e2de` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:14:04.686006 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74dbf7-06a0-4213-ba8f-ea6f5d55bc21 None admin] RBAC: Authorizing `identity:get_project(project_id=bddba4b09ebc4ac59c8ceed1b629e2de)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:14:04.687465 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74dbf7-06a0-4213-ba8f-ea6f5d55bc21 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:14:04.689059 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 440/896] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:14:04 2022] GET /identity/v3/projects/bddba4b09ebc4ac59c8ceed1b629e2de => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:14:04.695077 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8990b1e-bd39-4c79-a878-8e7c0014d14d None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:14:04.759765 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:14:04.792671 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8990b1e-bd39-4c79-a878-8e7c0014d14d None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:14:04.826397 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd08ffe-897c-4d4a-9c9b-54ed2be000a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:14:04.827065 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd08ffe-897c-4d4a-9c9b-54ed2be000a3 None admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:14:04.827344 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd08ffe-897c-4d4a-9c9b-54ed2be000a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:14:04.827639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd08ffe-897c-4d4a-9c9b-54ed2be000a3 None admin] PATH_INFO: `/v3/projects/bddba4b09ebc4ac59c8ceed1b629e2de/users/39fcbd682de44358be9b524cc0b3e5d0/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:14:04.829525 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd08ffe-897c-4d4a-9c9b-54ed2be000a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=bddba4b09ebc4ac59c8ceed1b629e2de, user_id=39fcbd682de44358be9b524cc0b3e5d0, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:14:04.830977 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd08ffe-897c-4d4a-9c9b-54ed2be000a3 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:14:04.919925 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 457/897] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 02:14:04 2022] PUT /identity/v3/projects/bddba4b09ebc4ac59c8ceed1b629e2de/users/39fcbd682de44358be9b524cc0b3e5d0/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:14:07.038734 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e252ca-4283-4604-ad6e-69eb21941200 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:14:07.039327 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e252ca-4283-4604-ad6e-69eb21941200 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:14:07.039327 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e252ca-4283-4604-ad6e-69eb21941200 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:14:07.040669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 441/898] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:14:07.046350 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6aa83-fd87-482f-8ad5-6a3987c4f63d None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:14:07.046785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6aa83-fd87-482f-8ad5-6a3987c4f63d None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:14:07.046920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6aa83-fd87-482f-8ad5-6a3987c4f63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:14:07.065843 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-58e6aa83-fd87-482f-8ad5-6a3987c4f63d None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:14:07.067055 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-58e6aa83-fd87-482f-8ad5-6a3987c4f63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:14:07.131735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 458/899] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:14:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:14:07.404004 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e252ca-4283-4604-ad6e-69eb21941200 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:14:07.435463 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:14:07.505054 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e252ca-4283-4604-ad6e-69eb21941200 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:14:07.537903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ce7b5-953a-4816-b35f-9d71e8e49f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:14:07.538516 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ce7b5-953a-4816-b35f-9d71e8e49f32 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:14:07.538795 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ce7b5-953a-4816-b35f-9d71e8e49f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:14:07.539098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ce7b5-953a-4816-b35f-9d71e8e49f32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:14:07.549833 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ce7b5-953a-4816-b35f-9d71e8e49f32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:14:07.554527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-d45ce7b5-953a-4816-b35f-9d71e8e49f32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:14:07.554527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:14:07.554527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:14:07.554527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:14:07.554527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:14:07.554527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:14:07.554527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:14:07.554527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:14:07.554527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:14:07.554527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:14:07.554527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:14:07.554527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:14:07.554527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:14:07.554527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:14:07.554527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:14:07.554527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:14:07.555644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:14:07.555644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:14:07.555644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:14:07.555644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:14:07.555644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:14:07.555644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:14:07.555644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:14:07.555644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:14:07.555644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:14:07.555644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:14:07.555644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:14:07.555644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:14:07.555644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:14:07.555644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:14:07.555644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:14:07.555644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:14:07.556844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:14:07.556844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:14:07.556844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:14:07.556844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:14:07.556844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:14:07.556844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:14:07.556844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:14:07.556844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:14:07.556844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:14:07.556844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:14:07.556844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:14:07.556844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:14:07.556844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 442/900] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 02:14:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:14:07.562530 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6aa83-fd87-482f-8ad5-6a3987c4f63d None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:14:07.618526 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:14:07.659901 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6aa83-fd87-482f-8ad5-6a3987c4f63d None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:14:07.692839 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e030d97-3451-475b-80ef-b28c49cf5fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:14:07.693429 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e030d97-3451-475b-80ef-b28c49cf5fef None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:14:07.693708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e030d97-3451-475b-80ef-b28c49cf5fef None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:14:07.693979 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e030d97-3451-475b-80ef-b28c49cf5fef None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:14:07.694632 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e030d97-3451-475b-80ef-b28c49cf5fef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:14:07.694966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e030d97-3451-475b-80ef-b28c49cf5fef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:14:07.696322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e030d97-3451-475b-80ef-b28c49cf5fef None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:14:07.704622 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 459/901] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:14:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:14:07.710437 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ce7b5-953a-4816-b35f-9d71e8e49f32 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:14:07.799211 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:14:07.807659 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ce7b5-953a-4816-b35f-9d71e8e49f32 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:14:07.841315 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9d2db-ece6-4e63-b154-82a5c040c753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:14:07.841920 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9d2db-ece6-4e63-b154-82a5c040c753 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:14:07.842199 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9d2db-ece6-4e63-b154-82a5c040c753 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:14:07.842468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9d2db-ece6-4e63-b154-82a5c040c753 None admin] PATH_INFO: `/v3/users/39fcbd682de44358be9b524cc0b3e5d0` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:14:07.843592 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9d2db-ece6-4e63-b154-82a5c040c753 None admin] RBAC: Authorizing `identity:get_user(user_id=39fcbd682de44358be9b524cc0b3e5d0)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:14:07.845010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9d2db-ece6-4e63-b154-82a5c040c753 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:14:07.846569 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 443/902] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 19 02:14:07 2022] GET /identity/v3/users/39fcbd682de44358be9b524cc0b3e5d0 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:14:07.852446 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e030d97-3451-475b-80ef-b28c49cf5fef None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:14:07.951014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e030d97-3451-475b-80ef-b28c49cf5fef None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:14:07.970152 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:14:07.984103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65b271-1d64-4fd9-85c9-e2907d23f38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:14:07.984698 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65b271-1d64-4fd9-85c9-e2907d23f38a None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:14:07.990919 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65b271-1d64-4fd9-85c9-e2907d23f38a None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:14:07.990919 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65b271-1d64-4fd9-85c9-e2907d23f38a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:14:08.050143 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65b271-1d64-4fd9-85c9-e2907d23f38a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:14:08.051607 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65b271-1d64-4fd9-85c9-e2907d23f38a None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:14:08.145857 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 460/903] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:14:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 02:14:08.151747 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9d2db-ece6-4e63-b154-82a5c040c753 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:14:08.249002 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9d2db-ece6-4e63-b154-82a5c040c753 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:14:08.282803 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066d71b-458b-4e94-a862-21e1c09cdc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:14:08.283449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066d71b-458b-4e94-a862-21e1c09cdc37 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:14:08.283730 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066d71b-458b-4e94-a862-21e1c09cdc37 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:14:08.284004 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066d71b-458b-4e94-a862-21e1c09cdc37 None admin] PATH_INFO: `/v3/projects/bddba4b09ebc4ac59c8ceed1b629e2de` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:14:08.285112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066d71b-458b-4e94-a862-21e1c09cdc37 None admin] RBAC: Authorizing `identity:get_project(project_id=bddba4b09ebc4ac59c8ceed1b629e2de)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:14:08.286557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066d71b-458b-4e94-a862-21e1c09cdc37 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:14:08.288205 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 444/904] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 19 02:14:08 2022] GET /identity/v3/projects/bddba4b09ebc4ac59c8ceed1b629e2de => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:14:08.294732 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65b271-1d64-4fd9-85c9-e2907d23f38a None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:14:08.315663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:14:08.393077 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65b271-1d64-4fd9-85c9-e2907d23f38a None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:14:08.426596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feeb5b9-090e-4b8c-a079-e935e69f2953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:14:08.427205 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feeb5b9-090e-4b8c-a079-e935e69f2953 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:14:08.427479 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feeb5b9-090e-4b8c-a079-e935e69f2953 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:14:08.427743 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feeb5b9-090e-4b8c-a079-e935e69f2953 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:14:08.428448 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feeb5b9-090e-4b8c-a079-e935e69f2953 None admin] RBAC: Adding query filter params (role.id=e2e7c80d19c141bc9f9bfc13c2ec2a12, scope.project.id=bddba4b09ebc4ac59c8ceed1b629e2de, user.id=39fcbd682de44358be9b524cc0b3e5d0) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:14:08.428748 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feeb5b9-090e-4b8c-a079-e935e69f2953 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:14:08.430161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feeb5b9-090e-4b8c-a079-e935e69f2953 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:14:08.436385 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 461/905] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 02:14:08 2022] GET /identity/v3/role_assignments?user.id=39fcbd682de44358be9b524cc0b3e5d0&scope.project.id=bddba4b09ebc4ac59c8ceed1b629e2de&role.id=e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:14:18.278198 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=86 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:14:18.433460 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=58 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:26.766217 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8147d-b444-4d67-8114-484c09cb353b None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:26.766853 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8147d-b444-4d67-8114-484c09cb353b None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:26.766853 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8147d-b444-4d67-8114-484c09cb353b None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:26.768113 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 445/906] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:15:26.773319 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6709b-72aa-4ce6-8fb1-6f815cfd5181 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:26.773717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6709b-72aa-4ce6-8fb1-6f815cfd5181 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:26.773861 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6709b-72aa-4ce6-8fb1-6f815cfd5181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:26.793592 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-bfa6709b-72aa-4ce6-8fb1-6f815cfd5181 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:15:26.794780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-bfa6709b-72aa-4ce6-8fb1-6f815cfd5181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:15:26.862336 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 462/907] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:15:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:15:27.138763 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8147d-b444-4d67-8114-484c09cb353b None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:27.241981 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8147d-b444-4d67-8114-484c09cb353b None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:27.275751 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7f407-c083-44ab-a992-6c14029857eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:27.276965 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7f407-c083-44ab-a992-6c14029857eb None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:27.277791 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7f407-c083-44ab-a992-6c14029857eb None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:27.278059 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7f407-c083-44ab-a992-6c14029857eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:27.287712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7f407-c083-44ab-a992-6c14029857eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:27.289176 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7f407-c083-44ab-a992-6c14029857eb None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:27.303696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-2ca7f407-c083-44ab-a992-6c14029857eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:15:27.303696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:27.303696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:15:27.303696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:15:27.303696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:15:27.303696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:15:27.303696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:15:27.303696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:15:27.303696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:15:27.303696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:15:27.303696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:15:27.303696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:15:27.303696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:15:27.303696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:15:27.303696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:15:27.303696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:15:27.304950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:15:27.304950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:15:27.304950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:15:27.304950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:15:27.304950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:15:27.304950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:15:27.304950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:15:27.304950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:15:27.304950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:15:27.304950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:15:27.304950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:15:27.304950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:15:27.304950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:15:27.304950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:15:27.304950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:15:27.304950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:15:27.304950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:15:27.306496 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:15:27.306496 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:15:27.306496 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:15:27.306496 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 446/908] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:15:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:15:27.312274 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6709b-72aa-4ce6-8fb1-6f815cfd5181 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:27.409970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6709b-72aa-4ce6-8fb1-6f815cfd5181 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:27.437961 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:27.443618 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec55825-2c13-47a0-90ef-76e222d53621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:27.444212 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec55825-2c13-47a0-90ef-76e222d53621 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:27.444489 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec55825-2c13-47a0-90ef-76e222d53621 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:27.444759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec55825-2c13-47a0-90ef-76e222d53621 None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:27.445391 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec55825-2c13-47a0-90ef-76e222d53621 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:27.445691 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec55825-2c13-47a0-90ef-76e222d53621 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:27.447075 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec55825-2c13-47a0-90ef-76e222d53621 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:27.458737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 463/909] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:27.464428 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7f407-c083-44ab-a992-6c14029857eb None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:27.517102 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:27.563688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7f407-c083-44ab-a992-6c14029857eb None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:27.596221 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130eae80-a0bd-4ff9-9a5e-fdc0afb765f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:27.596822 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130eae80-a0bd-4ff9-9a5e-fdc0afb765f8 None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:27.597097 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130eae80-a0bd-4ff9-9a5e-fdc0afb765f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:27.597364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130eae80-a0bd-4ff9-9a5e-fdc0afb765f8 None admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:27.598008 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130eae80-a0bd-4ff9-9a5e-fdc0afb765f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:27.599470 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130eae80-a0bd-4ff9-9a5e-fdc0afb765f8 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:27.758360 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 447/910] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 19 02:15:27 2022] POST /identity/v3/users => generated 251 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:15:29.921572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee81cf9-ffaf-4201-bb18-90ec5bc72fcd None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:29.922134 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee81cf9-ffaf-4201-bb18-90ec5bc72fcd None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:29.922134 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee81cf9-ffaf-4201-bb18-90ec5bc72fcd None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:29.923490 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 464/911] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:15:29.928649 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086cf3a-891a-41b5-b8e9-7b1bbcb907a9 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:29.929046 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086cf3a-891a-41b5-b8e9-7b1bbcb907a9 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:29.929194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086cf3a-891a-41b5-b8e9-7b1bbcb907a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:29.948972 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-1086cf3a-891a-41b5-b8e9-7b1bbcb907a9 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:15:29.950155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-1086cf3a-891a-41b5-b8e9-7b1bbcb907a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:15:30.014940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 448/912] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:15:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:15:30.284636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee81cf9-ffaf-4201-bb18-90ec5bc72fcd None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:30.384507 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee81cf9-ffaf-4201-bb18-90ec5bc72fcd None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:30.417538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fac171-6fc4-47ff-847a-9a409230e5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:30.418156 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fac171-6fc4-47ff-847a-9a409230e5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:30.418432 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fac171-6fc4-47ff-847a-9a409230e5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:30.418700 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fac171-6fc4-47ff-847a-9a409230e5f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:30.429217 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fac171-6fc4-47ff-847a-9a409230e5f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:15:30.434867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-95fac171-6fc4-47ff-847a-9a409230e5f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:15:30.434867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:30.434867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:15:30.434867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:15:30.434867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:15:30.434867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:15:30.434867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:15:30.434867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:15:30.434867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:15:30.434867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:15:30.434867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:15:30.434867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:15:30.434867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:15:30.434867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:15:30.434867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:15:30.434867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:15:30.436040 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:15:30.436040 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:15:30.436040 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:15:30.436040 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:15:30.436040 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:15:30.436040 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:15:30.436040 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:15:30.436040 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:15:30.436040 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:15:30.436040 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:15:30.436040 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:15:30.436040 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:15:30.436040 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:15:30.436040 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:15:30.436040 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:15:30.436040 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:15:30.437068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:15:30.437068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:15:30.437068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:15:30.437068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:15:30.437068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:15:30.437068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:15:30.437068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:15:30.437068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:15:30.437068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:15:30.437068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:15:30.437068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:15:30.437068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:15:30.437068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 465/913] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 02:15:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:15:30.442076 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086cf3a-891a-41b5-b8e9-7b1bbcb907a9 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:30.480865 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:30.538558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086cf3a-891a-41b5-b8e9-7b1bbcb907a9 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:30.572578 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc7c92-bfb4-4473-b278-90b6adfc0ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:30.573350 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc7c92-bfb4-4473-b278-90b6adfc0ffb None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:30.573677 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc7c92-bfb4-4473-b278-90b6adfc0ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:30.574015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc7c92-bfb4-4473-b278-90b6adfc0ffb None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:30.574675 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc7c92-bfb4-4473-b278-90b6adfc0ffb None admin] RBAC: Adding query filter params (name=service) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:30.575014 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc7c92-bfb4-4473-b278-90b6adfc0ffb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:30.576386 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc7c92-bfb4-4473-b278-90b6adfc0ffb None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:30.584047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 449/914] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 02:15:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:30.590236 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fac171-6fc4-47ff-847a-9a409230e5f6 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:30.639576 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:30.690181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fac171-6fc4-47ff-847a-9a409230e5f6 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:30.723186 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b8468-715d-417e-81e2-ac99577f1dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:30.723797 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b8468-715d-417e-81e2-ac99577f1dbd None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:30.724073 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b8468-715d-417e-81e2-ac99577f1dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:30.724340 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b8468-715d-417e-81e2-ac99577f1dbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:30.735130 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b8468-715d-417e-81e2-ac99577f1dbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:30.736507 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b8468-715d-417e-81e2-ac99577f1dbd None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:30.750122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-796b8468-715d-417e-81e2-ac99577f1dbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:15:30.750122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:30.750122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:15:30.750122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:15:30.750122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:15:30.750122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:15:30.750122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:15:30.750122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:15:30.750122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:15:30.750122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:15:30.750122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:15:30.750122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:15:30.750122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:15:30.750122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:15:30.750122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:15:30.750122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:15:30.755362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:15:30.755362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:15:30.755362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:15:30.755362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:15:30.755362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:15:30.755362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:15:30.755362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:15:30.755362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:15:30.755362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:15:30.755362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:15:30.755362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:15:30.755362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:15:30.755362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:15:30.755362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:15:30.755362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:15:30.755362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:15:30.755362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:15:30.756567 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:15:30.756567 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:15:30.756567 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:15:30.756567 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 466/915] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:15:30.758040 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc7c92-bfb4-4473-b278-90b6adfc0ffb None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:30.854252 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:30.857253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc7c92-bfb4-4473-b278-90b6adfc0ffb None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:30.890319 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f495314-23a8-462b-9508-b5771bf3f814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:30.890941 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f495314-23a8-462b-9508-b5771bf3f814 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:30.891215 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f495314-23a8-462b-9508-b5771bf3f814 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:30.891479 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f495314-23a8-462b-9508-b5771bf3f814 None admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:30.892104 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f495314-23a8-462b-9508-b5771bf3f814 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:30.892401 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f495314-23a8-462b-9508-b5771bf3f814 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:30.893869 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f495314-23a8-462b-9508-b5771bf3f814 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:30.906021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 450/916] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:30.911802 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b8468-715d-417e-81e2-ac99577f1dbd None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:31.012227 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b8468-715d-417e-81e2-ac99577f1dbd None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:31.013652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:31.045715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa02d7b-e673-4cec-be85-abc10366d43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:31.046338 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa02d7b-e673-4cec-be85-abc10366d43e None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:31.046610 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa02d7b-e673-4cec-be85-abc10366d43e None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:31.046904 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa02d7b-e673-4cec-be85-abc10366d43e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:31.054243 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa02d7b-e673-4cec-be85-abc10366d43e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:31.055693 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa02d7b-e673-4cec-be85-abc10366d43e None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:31.068866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-3aa02d7b-e673-4cec-be85-abc10366d43e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 19 02:15:31.068866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:31.068866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:15:31.068866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:15:31.068866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:15:31.068866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:15:31.068866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:15:31.068866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:15:31.068866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:15:31.068866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:15:31.068866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:15:31.068866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:15:31.068866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 02:15:31.068866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 02:15:31.068866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 02:15:31.068866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 02:15:31.070027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:15:31.070027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:15:31.070027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:15:31.070027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:15:31.070027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:15:31.070027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:15:31.070027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:15:31.070027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:15:31.070027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:15:31.070027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:15:31.070027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:15:31.070027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:15:31.070027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:15:31.070027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:15:31.070027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:15:31.070027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:15:31.070027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:15:31.070027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:15:31.071407 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:15:31.071407 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:15:31.071407 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 02:15:31.071407 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 02:15:31.071407 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 02:15:31.071407 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 02:15:31.071407 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 02:15:31.071407 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 02:15:31.071407 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 19 02:15:31.071407 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:15:31.071407 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 467/917] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:15:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:15:31.076515 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f495314-23a8-462b-9508-b5771bf3f814 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:31.175645 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f495314-23a8-462b-9508-b5771bf3f814 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:31.209527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d700de-4f36-4598-8a34-123a87479f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:31.210136 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d700de-4f36-4598-8a34-123a87479f63 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:31.210421 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d700de-4f36-4598-8a34-123a87479f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:31.210693 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d700de-4f36-4598-8a34-123a87479f63 None admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:31.211464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d700de-4f36-4598-8a34-123a87479f63 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:31.211762 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d700de-4f36-4598-8a34-123a87479f63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:31.213256 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d700de-4f36-4598-8a34-123a87479f63 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:31.230964 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 451/918] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Oct 19 02:15:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:31.236915 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa02d7b-e673-4cec-be85-abc10366d43e None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:31.337187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa02d7b-e673-4cec-be85-abc10366d43e None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:31.371557 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fd1f8-84bb-4c57-8e9e-9a89b9c1e540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:31.372158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fd1f8-84bb-4c57-8e9e-9a89b9c1e540 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:31.372441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fd1f8-84bb-4c57-8e9e-9a89b9c1e540 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:31.372712 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fd1f8-84bb-4c57-8e9e-9a89b9c1e540 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:31.383246 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0fd1f8-84bb-4c57-8e9e-9a89b9c1e540 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:31.384774 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0fd1f8-84bb-4c57-8e9e-9a89b9c1e540 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:31.399202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-1d0fd1f8-84bb-4c57-8e9e-9a89b9c1e540 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:15:31.399202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:31.399202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:15:31.399202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:15:31.399202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:15:31.399202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:15:31.399202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:15:31.399202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:15:31.399202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:15:31.399202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:15:31.399202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:15:31.399202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:15:31.399202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:15:31.399202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:15:31.399202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:15:31.399202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:15:31.400301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:15:31.400301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:15:31.400301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:15:31.400301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:15:31.400301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:15:31.400301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:15:31.400301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:15:31.400301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:15:31.400301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:15:31.400301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:15:31.400301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:15:31.400301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:15:31.400301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:15:31.400301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:15:31.400301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:15:31.400301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:15:31.400301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:15:31.401696 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:15:31.401696 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:15:31.401696 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:15:31.401696 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 468/919] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:15:31.406259 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d700de-4f36-4598-8a34-123a87479f63 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:31.425406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:31.503803 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d700de-4f36-4598-8a34-123a87479f63 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:31.536546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e72a50-88b6-4683-87be-741add06a2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:31.537150 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e72a50-88b6-4683-87be-741add06a2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:31.537432 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e72a50-88b6-4683-87be-741add06a2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:31.537706 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e72a50-88b6-4683-87be-741add06a2a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:31.538373 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e72a50-88b6-4683-87be-741add06a2a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:31.538963 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e72a50-88b6-4683-87be-741add06a2a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:31.544163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e72a50-88b6-4683-87be-741add06a2a8 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:31.552866 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 452/920] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:31.559513 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fd1f8-84bb-4c57-8e9e-9a89b9c1e540 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:31.575665 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:31.657866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fd1f8-84bb-4c57-8e9e-9a89b9c1e540 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:31.691415 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e91154-9391-408f-886c-a90df9f42016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:31.692030 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e91154-9391-408f-886c-a90df9f42016 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:31.692305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e91154-9391-408f-886c-a90df9f42016 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:31.692576 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e91154-9391-408f-886c-a90df9f42016 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:31.699478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e91154-9391-408f-886c-a90df9f42016 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:31.700915 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e91154-9391-408f-886c-a90df9f42016 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:31.711822 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-90e91154-9391-408f-886c-a90df9f42016 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:15:31.711822 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:31.711822 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:15:31.711822 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:15:31.711822 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:15:31.711822 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:15:31.711822 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:15:31.711822 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:15:31.711822 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:15:31.711822 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:15:31.711822 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:15:31.711822 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:15:31.711822 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 02:15:31.711822 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 02:15:31.711822 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 02:15:31.712878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 02:15:31.712878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:15:31.712878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:15:31.712878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:15:31.712878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:15:31.712878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:15:31.712878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:15:31.712878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:15:31.712878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:15:31.712878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:15:31.712878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:15:31.712878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:15:31.712878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:15:31.712878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:15:31.712878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:15:31.712878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:15:31.712878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:15:31.714003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 02:15:31.714003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 02:15:31.714003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 02:15:31.714003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 02:15:31.714003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 02:15:31.714003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 02:15:31.714003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:15:31.714003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:15:31.714003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 469/921] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:15:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:15:31.719621 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e72a50-88b6-4683-87be-741add06a2a8 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:31.799101 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:31.820524 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e72a50-88b6-4683-87be-741add06a2a8 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:31.852577 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6150ab-253b-4a5a-8ee5-d26d69335b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:31.855557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6150ab-253b-4a5a-8ee5-d26d69335b99 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:31.855557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6150ab-253b-4a5a-8ee5-d26d69335b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:31.855557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6150ab-253b-4a5a-8ee5-d26d69335b99 None admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:31.855557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6150ab-253b-4a5a-8ee5-d26d69335b99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:31.855557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6150ab-253b-4a5a-8ee5-d26d69335b99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:31.856724 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6150ab-253b-4a5a-8ee5-d26d69335b99 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:31.868099 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 453/922] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 02:15:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:31.874284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e91154-9391-408f-886c-a90df9f42016 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:31.949686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:31.973920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e91154-9391-408f-886c-a90df9f42016 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:32.006047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1347eb5-5b27-49e3-b30e-429a4aa100d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:32.006691 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1347eb5-5b27-49e3-b30e-429a4aa100d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:32.006996 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1347eb5-5b27-49e3-b30e-429a4aa100d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:32.007269 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1347eb5-5b27-49e3-b30e-429a4aa100d1 None admin] PATH_INFO: `/v3/projects/91449401454c493cbf423888db8b8454/users/a66b9bc695b44877a06f17ea6bbeb27a/roles/abb44cb94d7c46d3955fd92860aff94d` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:32.020878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1347eb5-5b27-49e3-b30e-429a4aa100d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=91449401454c493cbf423888db8b8454, user_id=a66b9bc695b44877a06f17ea6bbeb27a, role_id=abb44cb94d7c46d3955fd92860aff94d)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:32.022303 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1347eb5-5b27-49e3-b30e-429a4aa100d1 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:32.141159 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 470/923] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 02:15:31 2022] PUT /identity/v3/projects/91449401454c493cbf423888db8b8454/users/a66b9bc695b44877a06f17ea6bbeb27a/roles/abb44cb94d7c46d3955fd92860aff94d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:15:34.253422 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b518349-8129-49c8-b8ab-8dbccd83446d None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:34.253953 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b518349-8129-49c8-b8ab-8dbccd83446d None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:34.253953 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b518349-8129-49c8-b8ab-8dbccd83446d None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:34.255307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 454/924] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:15:34.261004 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb080c1-a941-46b2-bde6-56fc29ca8921 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:34.261418 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb080c1-a941-46b2-bde6-56fc29ca8921 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:34.261418 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb080c1-a941-46b2-bde6-56fc29ca8921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:34.279696 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-0bb080c1-a941-46b2-bde6-56fc29ca8921 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:15:34.280873 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-0bb080c1-a941-46b2-bde6-56fc29ca8921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:15:34.347172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 471/925] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:15:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:15:34.631017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b518349-8129-49c8-b8ab-8dbccd83446d None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:34.732354 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b518349-8129-49c8-b8ab-8dbccd83446d None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:34.765994 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7e108-bee2-495d-9e70-04c8d7468d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:34.766609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7e108-bee2-495d-9e70-04c8d7468d84 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:34.766917 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7e108-bee2-495d-9e70-04c8d7468d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:34.767187 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7e108-bee2-495d-9e70-04c8d7468d84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:34.773718 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:34.777740 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7e108-bee2-495d-9e70-04c8d7468d84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:15:34.782527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-0ed7e108-bee2-495d-9e70-04c8d7468d84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:15:34.782527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:34.782527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:15:34.782527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:15:34.782527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:15:34.782527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:15:34.782527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:15:34.782527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:15:34.782527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:15:34.782527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:15:34.782527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:15:34.782527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:15:34.782527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:15:34.782527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:15:34.782527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:15:34.782527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:15:34.786007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:15:34.786007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:15:34.786007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:15:34.786007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:15:34.786007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:15:34.786007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:15:34.786007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:15:34.786007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:15:34.786007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:15:34.786007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:15:34.786007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:15:34.786007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:15:34.786007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:15:34.786007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:15:34.786007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:15:34.786007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:15:34.787093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:15:34.787093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:15:34.787093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:15:34.787093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:15:34.787093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:15:34.787093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:15:34.787093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:15:34.787093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:15:34.787093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:15:34.787093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:15:34.787093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 02:15:34.787093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:15:34.787093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 455/926] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 19 02:15:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:15:34.789626 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb080c1-a941-46b2-bde6-56fc29ca8921 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:34.845377 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:34.888894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb080c1-a941-46b2-bde6-56fc29ca8921 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:34.921996 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1721d-5208-4b78-9230-76eae24d2e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:34.922583 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1721d-5208-4b78-9230-76eae24d2e02 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:34.922878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1721d-5208-4b78-9230-76eae24d2e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:34.923147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1721d-5208-4b78-9230-76eae24d2e02 None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:34.923794 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1721d-5208-4b78-9230-76eae24d2e02 None admin] RBAC: Adding query filter params (name=service) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:34.924092 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1721d-5208-4b78-9230-76eae24d2e02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:34.925440 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1721d-5208-4b78-9230-76eae24d2e02 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:34.933533 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 472/927] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 19 02:15:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:34.939453 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7e108-bee2-495d-9e70-04c8d7468d84 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:35.039521 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7e108-bee2-495d-9e70-04c8d7468d84 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:35.074638 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefc823-3914-4cf0-ac9d-20d5ae7bcbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:35.075278 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefc823-3914-4cf0-ac9d-20d5ae7bcbe2 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:35.075554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefc823-3914-4cf0-ac9d-20d5ae7bcbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:35.075818 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefc823-3914-4cf0-ac9d-20d5ae7bcbe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:35.085509 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefc823-3914-4cf0-ac9d-20d5ae7bcbe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:35.086972 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefc823-3914-4cf0-ac9d-20d5ae7bcbe2 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:35.102251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-7fefc823-3914-4cf0-ac9d-20d5ae7bcbe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:15:35.102251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:35.102251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:15:35.102251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:15:35.102251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:15:35.102251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:15:35.102251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:15:35.102251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:15:35.102251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:15:35.102251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:15:35.102251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:15:35.102251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:15:35.102251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:15:35.102251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:15:35.102251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:15:35.102251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:15:35.103364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:15:35.103364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:15:35.103364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:15:35.103364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:15:35.103364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:15:35.103364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:15:35.103364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:15:35.103364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:15:35.103364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:15:35.103364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:15:35.103364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:15:35.103364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:15:35.103364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:15:35.103364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:15:35.103364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:15:35.103364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:15:35.103364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:15:35.105231 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:15:35.105231 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:15:35.105231 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:15:35.105231 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 456/928] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:15:35.109739 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1721d-5208-4b78-9230-76eae24d2e02 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:35.210896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1721d-5208-4b78-9230-76eae24d2e02 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:35.227726 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:35.245098 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cf811-c4d6-4240-b309-9544954d590a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:35.245703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cf811-c4d6-4240-b309-9544954d590a None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:35.245986 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cf811-c4d6-4240-b309-9544954d590a None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:35.246260 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cf811-c4d6-4240-b309-9544954d590a None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:35.246936 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cf811-c4d6-4240-b309-9544954d590a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:35.247241 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cf811-c4d6-4240-b309-9544954d590a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:35.248602 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cf811-c4d6-4240-b309-9544954d590a None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:35.259883 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 473/929] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:35.266468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefc823-3914-4cf0-ac9d-20d5ae7bcbe2 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:35.316219 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:35.365915 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefc823-3914-4cf0-ac9d-20d5ae7bcbe2 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:35.398150 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d99b4d-eaa1-4f89-9a9c-6e25aeca979d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:35.398769 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d99b4d-eaa1-4f89-9a9c-6e25aeca979d None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:35.399184 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d99b4d-eaa1-4f89-9a9c-6e25aeca979d None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:35.399328 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d99b4d-eaa1-4f89-9a9c-6e25aeca979d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:35.407366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d99b4d-eaa1-4f89-9a9c-6e25aeca979d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:35.408794 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d99b4d-eaa1-4f89-9a9c-6e25aeca979d None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:35.420802 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-44d99b4d-eaa1-4f89-9a9c-6e25aeca979d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 19 02:15:35.420802 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:35.420802 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:15:35.420802 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:15:35.420802 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:15:35.420802 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:15:35.420802 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:15:35.420802 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:15:35.420802 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:15:35.420802 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:15:35.420802 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:15:35.420802 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:15:35.420802 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 02:15:35.420802 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 02:15:35.420802 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 02:15:35.420802 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 02:15:35.423839 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:15:35.423839 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:15:35.423839 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:15:35.423839 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:15:35.423839 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:15:35.423839 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:15:35.423839 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:15:35.423839 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:15:35.423839 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:15:35.423839 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:15:35.423839 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:15:35.423839 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:15:35.423839 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:15:35.423839 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:15:35.423839 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:15:35.423839 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:15:35.423839 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:15:35.423839 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:15:35.424848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:15:35.424848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:15:35.424848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 02:15:35.424848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 02:15:35.424848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 02:15:35.424848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 02:15:35.424848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 02:15:35.424848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 02:15:35.424848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 19 02:15:35.424848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:15:35.424848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 457/930] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:15:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:15:35.427840 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cf811-c4d6-4240-b309-9544954d590a None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:35.527802 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cf811-c4d6-4240-b309-9544954d590a None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:35.561962 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b0c51-79d6-46a2-a088-bdb31b8e3c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:35.562552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b0c51-79d6-46a2-a088-bdb31b8e3c7e None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:35.562847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b0c51-79d6-46a2-a088-bdb31b8e3c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:35.563118 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b0c51-79d6-46a2-a088-bdb31b8e3c7e None admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:35.563827 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b0c51-79d6-46a2-a088-bdb31b8e3c7e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:35.564126 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b0c51-79d6-46a2-a088-bdb31b8e3c7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:35.565585 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b0c51-79d6-46a2-a088-bdb31b8e3c7e None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:35.583384 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 474/931] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Oct 19 02:15:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:35.589577 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d99b4d-eaa1-4f89-9a9c-6e25aeca979d None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:35.691350 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d99b4d-eaa1-4f89-9a9c-6e25aeca979d None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:35.702329 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:35.724964 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270b952-b80a-48ab-864b-64c2f14ca484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:35.725561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270b952-b80a-48ab-864b-64c2f14ca484 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:35.725839 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270b952-b80a-48ab-864b-64c2f14ca484 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:35.726108 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270b952-b80a-48ab-864b-64c2f14ca484 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:35.791523 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270b952-b80a-48ab-864b-64c2f14ca484 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:35.792911 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270b952-b80a-48ab-864b-64c2f14ca484 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:35.891070 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 458/932] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:15:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 19 02:15:35.896959 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b0c51-79d6-46a2-a088-bdb31b8e3c7e None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:35.931339 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:35.995966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b0c51-79d6-46a2-a088-bdb31b8e3c7e None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:36.030179 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0838a-2a2d-4515-b7c3-2cc63d1df61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:36.030859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0838a-2a2d-4515-b7c3-2cc63d1df61d None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:36.031172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0838a-2a2d-4515-b7c3-2cc63d1df61d None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:36.031449 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0838a-2a2d-4515-b7c3-2cc63d1df61d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:36.041359 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e0838a-2a2d-4515-b7c3-2cc63d1df61d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:36.043044 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e0838a-2a2d-4515-b7c3-2cc63d1df61d None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:36.057709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-35e0838a-2a2d-4515-b7c3-2cc63d1df61d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:15:36.057709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:36.057709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:15:36.057709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:15:36.057709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:15:36.057709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:15:36.057709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:15:36.057709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:15:36.057709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:15:36.057709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:15:36.057709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:15:36.057709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:15:36.057709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:15:36.057709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:15:36.057709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:15:36.057709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:15:36.063686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:15:36.063686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:15:36.063686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:15:36.063686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:15:36.063686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:15:36.063686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:15:36.063686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:15:36.063686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:15:36.063686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:15:36.063686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:15:36.063686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:15:36.063686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:15:36.063686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:15:36.063686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:15:36.063686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:15:36.063686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:15:36.063686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:15:36.064810 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:15:36.064810 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:15:36.064810 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:15:36.064810 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 475/933] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:15:36.066149 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270b952-b80a-48ab-864b-64c2f14ca484 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:36.078039 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:36.164810 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270b952-b80a-48ab-864b-64c2f14ca484 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:36.198846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069b907-7668-46f5-bb31-308957fbe09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:36.199266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069b907-7668-46f5-bb31-308957fbe09f None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:36.199546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069b907-7668-46f5-bb31-308957fbe09f None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:36.199817 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069b907-7668-46f5-bb31-308957fbe09f None admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:36.200449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069b907-7668-46f5-bb31-308957fbe09f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:36.200748 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069b907-7668-46f5-bb31-308957fbe09f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:36.202105 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069b907-7668-46f5-bb31-308957fbe09f None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:36.213392 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 459/934] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:36.219777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0838a-2a2d-4515-b7c3-2cc63d1df61d None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:36.303581 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:36.318594 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0838a-2a2d-4515-b7c3-2cc63d1df61d None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:36.351897 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9445912-09e5-4e7e-a666-15c0f89afda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:36.352521 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9445912-09e5-4e7e-a666-15c0f89afda2 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:36.352798 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9445912-09e5-4e7e-a666-15c0f89afda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:36.353092 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9445912-09e5-4e7e-a666-15c0f89afda2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:36.359786 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9445912-09e5-4e7e-a666-15c0f89afda2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:36.361219 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9445912-09e5-4e7e-a666-15c0f89afda2 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:36.372946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-d9445912-09e5-4e7e-a666-15c0f89afda2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:15:36.372946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:36.372946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:15:36.372946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:15:36.372946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:15:36.372946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:15:36.372946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:15:36.372946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:15:36.372946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:15:36.372946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:15:36.372946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:15:36.372946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:15:36.372946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 02:15:36.372946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 02:15:36.372946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 02:15:36.373990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 02:15:36.373990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:15:36.373990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:15:36.373990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:15:36.373990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:15:36.373990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:15:36.373990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:15:36.373990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:15:36.373990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:15:36.373990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:15:36.373990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:15:36.373990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:15:36.373990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:15:36.373990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:15:36.373990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:15:36.373990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:15:36.373990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:15:36.374945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 02:15:36.374945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 02:15:36.374945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 02:15:36.374945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 02:15:36.374945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 02:15:36.374945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 02:15:36.374945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:15:36.374945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:15:36.374945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 476/935] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:15:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:15:36.380425 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069b907-7668-46f5-bb31-308957fbe09f None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:36.450974 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:36.480881 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069b907-7668-46f5-bb31-308957fbe09f None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:36.515396 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bd0f0-0fc0-4d1b-bd19-e63d244aaf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:36.516032 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bd0f0-0fc0-4d1b-bd19-e63d244aaf92 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:36.516295 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bd0f0-0fc0-4d1b-bd19-e63d244aaf92 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:36.516566 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bd0f0-0fc0-4d1b-bd19-e63d244aaf92 None admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:36.517255 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011bd0f0-0fc0-4d1b-bd19-e63d244aaf92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:36.517559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011bd0f0-0fc0-4d1b-bd19-e63d244aaf92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:36.519030 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011bd0f0-0fc0-4d1b-bd19-e63d244aaf92 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:36.531227 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 460/936] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 02:15:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:36.537636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9445912-09e5-4e7e-a666-15c0f89afda2 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:36.638241 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9445912-09e5-4e7e-a666-15c0f89afda2 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:36.670988 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288ce5d-01bf-4020-b81c-b35c47ab96b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:36.671580 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288ce5d-01bf-4020-b81c-b35c47ab96b9 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:36.671860 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288ce5d-01bf-4020-b81c-b35c47ab96b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:36.672133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288ce5d-01bf-4020-b81c-b35c47ab96b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:36.672844 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288ce5d-01bf-4020-b81c-b35c47ab96b9 None admin] RBAC: Adding query filter params (role.id=abb44cb94d7c46d3955fd92860aff94d, scope.project.id=91449401454c493cbf423888db8b8454, user.id=a66b9bc695b44877a06f17ea6bbeb27a) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:36.673150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288ce5d-01bf-4020-b81c-b35c47ab96b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:36.674573 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288ce5d-01bf-4020-b81c-b35c47ab96b9 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:36.680193 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 477/937] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 02:15:36 2022] GET /identity/v3/role_assignments?user.id=a66b9bc695b44877a06f17ea6bbeb27a&scope.project.id=91449401454c493cbf423888db8b8454&role.id=abb44cb94d7c46d3955fd92860aff94d => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:38.832269 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162022a8-2d12-4688-a8f0-cff53c2b92c8 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:38.832804 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162022a8-2d12-4688-a8f0-cff53c2b92c8 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:38.832804 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162022a8-2d12-4688-a8f0-cff53c2b92c8 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:38.834137 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 461/938] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:15:38.839846 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fe1c7-4b88-4834-ab78-ca562fed0c91 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:38.840294 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fe1c7-4b88-4834-ab78-ca562fed0c91 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:38.840383 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fe1c7-4b88-4834-ab78-ca562fed0c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:38.859114 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-9e3fe1c7-4b88-4834-ab78-ca562fed0c91 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:15:38.860293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-9e3fe1c7-4b88-4834-ab78-ca562fed0c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:15:38.863013 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:38.925810 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 478/939] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:15:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:15:39.193217 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162022a8-2d12-4688-a8f0-cff53c2b92c8 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:39.295273 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162022a8-2d12-4688-a8f0-cff53c2b92c8 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:39.324154 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:39.329702 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ceda63-5d61-4f4c-ba40-be133eaa2c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:39.330318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceda63-5d61-4f4c-ba40-be133eaa2c82 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:39.330592 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceda63-5d61-4f4c-ba40-be133eaa2c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:39.330881 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceda63-5d61-4f4c-ba40-be133eaa2c82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:39.340537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ceda63-5d61-4f4c-ba40-be133eaa2c82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:15:39.345224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-13ceda63-5d61-4f4c-ba40-be133eaa2c82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:15:39.345224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:39.345224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:15:39.345224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:15:39.345224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:15:39.345224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:15:39.345224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:15:39.345224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:15:39.345224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:15:39.345224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:15:39.345224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:15:39.345224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:15:39.345224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:15:39.345224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:15:39.345224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:15:39.345224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:15:39.347687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:15:39.347687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:15:39.347687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:15:39.347687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:15:39.347687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:15:39.347687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:15:39.347687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:15:39.347687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:15:39.347687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:15:39.347687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:15:39.347687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:15:39.347687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:15:39.347687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:15:39.347687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:15:39.347687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:15:39.347687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:15:39.348594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:15:39.348594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:15:39.348594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:15:39.348594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:15:39.348594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:15:39.348594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:15:39.348594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:15:39.348594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:15:39.348594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:15:39.348594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:15:39.348594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:15:39.348594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:15:39.348594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 462/940] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 02:15:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:15:39.352605 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fe1c7-4b88-4834-ab78-ca562fed0c91 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:39.455502 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fe1c7-4b88-4834-ab78-ca562fed0c91 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:39.488694 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb346f-6723-4cec-9da2-d2f6f744ed1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:39.489291 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb346f-6723-4cec-9da2-d2f6f744ed1c None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:39.489566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb346f-6723-4cec-9da2-d2f6f744ed1c None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:39.489834 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb346f-6723-4cec-9da2-d2f6f744ed1c None admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:39.490528 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb346f-6723-4cec-9da2-d2f6f744ed1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:39.490852 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb346f-6723-4cec-9da2-d2f6f744ed1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:39.492215 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb346f-6723-4cec-9da2-d2f6f744ed1c None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:39.500637 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 479/941] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:15:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:39.506371 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ceda63-5d61-4f4c-ba40-be133eaa2c82 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:39.606326 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ceda63-5d61-4f4c-ba40-be133eaa2c82 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:39.639803 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356e844-aced-4a44-a02d-2f5a05556967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:39.640422 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356e844-aced-4a44-a02d-2f5a05556967 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:39.640699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356e844-aced-4a44-a02d-2f5a05556967 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:39.640967 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356e844-aced-4a44-a02d-2f5a05556967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:39.651392 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356e844-aced-4a44-a02d-2f5a05556967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:39.652824 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356e844-aced-4a44-a02d-2f5a05556967 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:39.667593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-9356e844-aced-4a44-a02d-2f5a05556967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:15:39.667593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:39.667593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:15:39.667593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:15:39.667593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:15:39.667593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:15:39.667593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:15:39.667593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:15:39.667593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:15:39.667593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:15:39.667593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:15:39.667593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:15:39.667593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:15:39.667593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:15:39.667593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:15:39.667593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:15:39.668681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:15:39.668681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:15:39.668681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:15:39.668681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:15:39.668681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:15:39.668681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:15:39.668681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:15:39.668681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:15:39.668681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:15:39.668681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:15:39.668681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:15:39.668681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:15:39.668681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:15:39.668681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:15:39.668681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:15:39.668681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:15:39.668681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:15:39.669927 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:15:39.669927 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:15:39.669927 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:15:39.669927 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 463/942] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:15:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:15:39.674438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb346f-6723-4cec-9da2-d2f6f744ed1c None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:39.677380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:39.772493 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb346f-6723-4cec-9da2-d2f6f744ed1c None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:39.805346 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22236717-a8ce-4dc9-8b02-cf50a91f43a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:39.806200 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22236717-a8ce-4dc9-8b02-cf50a91f43a6 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:39.806474 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22236717-a8ce-4dc9-8b02-cf50a91f43a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:39.806742 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22236717-a8ce-4dc9-8b02-cf50a91f43a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:39.807869 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22236717-a8ce-4dc9-8b02-cf50a91f43a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:39.808175 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22236717-a8ce-4dc9-8b02-cf50a91f43a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:39.809522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22236717-a8ce-4dc9-8b02-cf50a91f43a6 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:39.820793 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 480/943] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:39.827075 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356e844-aced-4a44-a02d-2f5a05556967 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:39.870714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:39.926151 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356e844-aced-4a44-a02d-2f5a05556967 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:39.959607 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b09932-1a66-4241-99a7-8ad04bdf1c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:39.960228 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b09932-1a66-4241-99a7-8ad04bdf1c5c None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:39.960526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b09932-1a66-4241-99a7-8ad04bdf1c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:39.960799 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b09932-1a66-4241-99a7-8ad04bdf1c5c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:39.968754 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b09932-1a66-4241-99a7-8ad04bdf1c5c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:39.970192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b09932-1a66-4241-99a7-8ad04bdf1c5c None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:39.981114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-a7b09932-1a66-4241-99a7-8ad04bdf1c5c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 19 02:15:39.981114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:39.981114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:15:39.981114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:15:39.981114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:15:39.981114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:15:39.981114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:15:39.981114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:15:39.981114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:15:39.981114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:15:39.981114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:15:39.981114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:15:39.981114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 02:15:39.981114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 02:15:39.981114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 02:15:39.981114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 02:15:39.982210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:15:39.982210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:15:39.982210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:15:39.982210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:15:39.982210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:15:39.982210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:15:39.982210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:15:39.982210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:15:39.982210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:15:39.982210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:15:39.982210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:15:39.982210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:15:39.982210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:15:39.982210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:15:39.982210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:15:39.982210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:15:39.982210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:15:39.982210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:15:39.983406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:15:39.983406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:15:39.983406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 02:15:39.983406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 02:15:39.983406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 02:15:39.983406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 02:15:39.983406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 02:15:39.983406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 02:15:39.983406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 19 02:15:39.983406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:15:39.983406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 464/944] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:15:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:15:39.988095 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22236717-a8ce-4dc9-8b02-cf50a91f43a6 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:40.049744 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:40.087453 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22236717-a8ce-4dc9-8b02-cf50a91f43a6 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:40.120293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c9ee9-88a8-428e-b684-ddf36765fa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:40.120892 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c9ee9-88a8-428e-b684-ddf36765fa1f None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:40.121169 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c9ee9-88a8-428e-b684-ddf36765fa1f None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:40.121475 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c9ee9-88a8-428e-b684-ddf36765fa1f None admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:40.122205 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c9ee9-88a8-428e-b684-ddf36765fa1f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:40.122508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c9ee9-88a8-428e-b684-ddf36765fa1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:40.123966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c9ee9-88a8-428e-b684-ddf36765fa1f None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:40.141438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 481/945] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Oct 19 02:15:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:40.147272 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b09932-1a66-4241-99a7-8ad04bdf1c5c None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:40.247774 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b09932-1a66-4241-99a7-8ad04bdf1c5c None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:40.249293 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:40.281590 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216716b-218f-4874-be07-46774eefc26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:40.282209 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216716b-218f-4874-be07-46774eefc26e None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:40.282486 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216716b-218f-4874-be07-46774eefc26e None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:40.282756 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216716b-218f-4874-be07-46774eefc26e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:40.293229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216716b-218f-4874-be07-46774eefc26e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:40.294706 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216716b-218f-4874-be07-46774eefc26e None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:40.309169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-0216716b-218f-4874-be07-46774eefc26e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:15:40.309169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:40.309169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:15:40.309169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:15:40.309169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:15:40.309169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:15:40.309169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:15:40.309169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:15:40.309169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:15:40.309169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:15:40.309169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:15:40.309169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:15:40.309169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:15:40.309169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:15:40.309169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:15:40.309169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:15:40.310264 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:15:40.310264 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:15:40.310264 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:15:40.310264 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:15:40.310264 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:15:40.310264 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:15:40.310264 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:15:40.310264 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:15:40.310264 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:15:40.310264 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:15:40.310264 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:15:40.310264 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:15:40.310264 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:15:40.310264 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:15:40.310264 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:15:40.310264 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:15:40.310264 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:15:40.314352 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:15:40.314352 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:15:40.314352 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:15:40.314352 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 465/946] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:15:40.316119 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c9ee9-88a8-428e-b684-ddf36765fa1f None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:40.414790 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c9ee9-88a8-428e-b684-ddf36765fa1f None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:40.435488 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:40.449382 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557d0c8-8cf5-4b18-8770-043d984d4075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:40.449987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557d0c8-8cf5-4b18-8770-043d984d4075 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:40.450263 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557d0c8-8cf5-4b18-8770-043d984d4075 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:40.450532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557d0c8-8cf5-4b18-8770-043d984d4075 None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:40.451201 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557d0c8-8cf5-4b18-8770-043d984d4075 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:40.451503 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557d0c8-8cf5-4b18-8770-043d984d4075 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:40.452868 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557d0c8-8cf5-4b18-8770-043d984d4075 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:40.464191 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 482/947] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:40.469944 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216716b-218f-4874-be07-46774eefc26e None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:40.568198 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216716b-218f-4874-be07-46774eefc26e None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:40.601612 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f00fa-e1e9-47c4-9840-0e58c7e03b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:40.602257 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f00fa-e1e9-47c4-9840-0e58c7e03b33 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:40.614528 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f00fa-e1e9-47c4-9840-0e58c7e03b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:40.614528 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f00fa-e1e9-47c4-9840-0e58c7e03b33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:40.614528 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f00fa-e1e9-47c4-9840-0e58c7e03b33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:40.614528 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f00fa-e1e9-47c4-9840-0e58c7e03b33 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:40.621843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-642f00fa-e1e9-47c4-9840-0e58c7e03b33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:15:40.621843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:40.621843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:15:40.621843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:15:40.621843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:15:40.621843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:15:40.621843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:15:40.621843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:15:40.621843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:15:40.621843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:15:40.621843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:15:40.621843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:15:40.621843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 02:15:40.621843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 02:15:40.621843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 02:15:40.622892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 02:15:40.622892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:15:40.622892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:15:40.622892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:15:40.622892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:15:40.622892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:15:40.622892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:15:40.622892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:15:40.622892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:15:40.622892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:15:40.622892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:15:40.622892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:15:40.622892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:15:40.622892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:15:40.622892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:15:40.622892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:15:40.622892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:15:40.624088 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 02:15:40.624088 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 02:15:40.624088 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 02:15:40.624088 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 02:15:40.624088 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 02:15:40.624088 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 02:15:40.624088 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:15:40.624088 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:15:40.624088 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 466/948] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:15:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:15:40.628681 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557d0c8-8cf5-4b18-8770-043d984d4075 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:40.728086 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557d0c8-8cf5-4b18-8770-043d984d4075 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:40.761339 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe774f-ec1b-47cb-a00d-8996b7c6038f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:40.761938 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe774f-ec1b-47cb-a00d-8996b7c6038f None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:40.762215 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe774f-ec1b-47cb-a00d-8996b7c6038f None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:40.762488 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe774f-ec1b-47cb-a00d-8996b7c6038f None admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:40.763212 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe774f-ec1b-47cb-a00d-8996b7c6038f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:40.763554 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe774f-ec1b-47cb-a00d-8996b7c6038f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:40.764974 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe774f-ec1b-47cb-a00d-8996b7c6038f None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:40.777302 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 483/949] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 02:15:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:40.783385 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f00fa-e1e9-47c4-9840-0e58c7e03b33 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:40.799339 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:40.883082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f00fa-e1e9-47c4-9840-0e58c7e03b33 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:40.916771 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cc5f9-813c-438b-a042-1c23e99017b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:40.917408 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cc5f9-813c-438b-a042-1c23e99017b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:40.917687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cc5f9-813c-438b-a042-1c23e99017b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:40.917966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cc5f9-813c-438b-a042-1c23e99017b3 None admin] PATH_INFO: `/v3/projects/91449401454c493cbf423888db8b8454/users/a66b9bc695b44877a06f17ea6bbeb27a/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:40.919877 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9cc5f9-813c-438b-a042-1c23e99017b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=91449401454c493cbf423888db8b8454, user_id=a66b9bc695b44877a06f17ea6bbeb27a, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:40.921338 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9cc5f9-813c-438b-a042-1c23e99017b3 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:41.015833 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 467/950] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 19 02:15:40 2022] PUT /identity/v3/projects/91449401454c493cbf423888db8b8454/users/a66b9bc695b44877a06f17ea6bbeb27a/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:15:43.153287 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3bb73-4987-4080-874d-600662e32f4c None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:43.153857 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3bb73-4987-4080-874d-600662e32f4c None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:43.153857 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3bb73-4987-4080-874d-600662e32f4c None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:43.155195 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 484/951] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:15:43.160483 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53a7b4-cf09-438b-bacd-8ef678cf106e None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:43.160861 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53a7b4-cf09-438b-bacd-8ef678cf106e None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:43.161066 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53a7b4-cf09-438b-bacd-8ef678cf106e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:43.179011 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-ea53a7b4-cf09-438b-bacd-8ef678cf106e None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:15:43.180199 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ea53a7b4-cf09-438b-bacd-8ef678cf106e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:15:43.246677 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 468/952] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:15:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:15:43.513982 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3bb73-4987-4080-874d-600662e32f4c None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:43.557819 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:43.614727 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3bb73-4987-4080-874d-600662e32f4c None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:43.648943 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea4eb1-aed1-402b-a9d0-c6aff5c1ecb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:43.649577 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea4eb1-aed1-402b-a9d0-c6aff5c1ecb3 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:43.649846 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea4eb1-aed1-402b-a9d0-c6aff5c1ecb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:43.650114 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea4eb1-aed1-402b-a9d0-c6aff5c1ecb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:43.660080 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea4eb1-aed1-402b-a9d0-c6aff5c1ecb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 02:15:43.664831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-b8ea4eb1-aed1-402b-a9d0-c6aff5c1ecb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:15:43.664831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:43.664831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:15:43.664831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:15:43.664831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:15:43.664831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:15:43.664831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:15:43.664831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:15:43.664831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:15:43.664831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:15:43.664831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:15:43.664831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:15:43.664831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 02:15:43.664831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 02:15:43.664831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 02:15:43.664831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 02:15:43.666477 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 02:15:43.666477 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 02:15:43.666477 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 02:15:43.666477 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 02:15:43.666477 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:15:43.666477 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:15:43.666477 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:15:43.666477 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:15:43.666477 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:15:43.666477 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:15:43.666477 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:15:43.666477 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:15:43.666477 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:15:43.666477 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:15:43.666477 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:15:43.666477 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:15:43.668223 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:15:43.668223 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:15:43.668223 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:15:43.668223 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:15:43.668223 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 02:15:43.668223 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 02:15:43.668223 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 02:15:43.668223 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 02:15:43.668223 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 02:15:43.668223 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 02:15:43.668223 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 02:15:43.668223 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:15:43.668223 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 485/953] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 19 02:15:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:15:43.672481 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53a7b4-cf09-438b-bacd-8ef678cf106e None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:43.675557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:43.768550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53a7b4-cf09-438b-bacd-8ef678cf106e None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:43.802607 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961437a9-3fad-41a4-af94-01c3c154ba9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:43.803248 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961437a9-3fad-41a4-af94-01c3c154ba9b None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:43.803530 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961437a9-3fad-41a4-af94-01c3c154ba9b None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:43.803801 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961437a9-3fad-41a4-af94-01c3c154ba9b None admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:43.804463 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961437a9-3fad-41a4-af94-01c3c154ba9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:43.804768 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961437a9-3fad-41a4-af94-01c3c154ba9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:43.806391 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961437a9-3fad-41a4-af94-01c3c154ba9b None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:43.815302 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 469/954] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 19 02:15:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:43.821145 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea4eb1-aed1-402b-a9d0-c6aff5c1ecb3 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:43.918555 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:43.921514 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea4eb1-aed1-402b-a9d0-c6aff5c1ecb3 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:43.953468 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c1484-7167-4ee1-826b-8d769f9eb07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:43.954077 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c1484-7167-4ee1-826b-8d769f9eb07c None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:43.954353 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c1484-7167-4ee1-826b-8d769f9eb07c None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:43.954620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c1484-7167-4ee1-826b-8d769f9eb07c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:43.965531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c1484-7167-4ee1-826b-8d769f9eb07c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:43.967001 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c1484-7167-4ee1-826b-8d769f9eb07c None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:43.981994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-d54c1484-7167-4ee1-826b-8d769f9eb07c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:15:43.981994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:43.981994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:15:43.981994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:15:43.981994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:15:43.981994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:15:43.981994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:15:43.981994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:15:43.981994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:15:43.981994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:15:43.981994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:15:43.981994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:15:43.981994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:15:43.981994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:15:43.981994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:15:43.981994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:15:43.993064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:15:43.993064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:15:43.993064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:15:43.993064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:15:43.993064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:15:43.993064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:15:43.993064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:15:43.993064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:15:43.993064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:15:43.993064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:15:43.993064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:15:43.993064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:15:43.993064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:15:43.993064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:15:43.993064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:15:43.993064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:15:43.993064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:15:43.994408 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:15:43.994408 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:15:43.994408 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:15:43.994408 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 486/955] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:15:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:15:43.994703 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961437a9-3fad-41a4-af94-01c3c154ba9b None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:44.056506 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:44.090583 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961437a9-3fad-41a4-af94-01c3c154ba9b None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:44.124694 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6852a64-6af7-41e7-8cf1-b7e74a8ffbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:44.125299 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6852a64-6af7-41e7-8cf1-b7e74a8ffbcc None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:44.125581 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6852a64-6af7-41e7-8cf1-b7e74a8ffbcc None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:44.125856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6852a64-6af7-41e7-8cf1-b7e74a8ffbcc None admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:44.126495 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6852a64-6af7-41e7-8cf1-b7e74a8ffbcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:44.126799 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6852a64-6af7-41e7-8cf1-b7e74a8ffbcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:44.128197 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6852a64-6af7-41e7-8cf1-b7e74a8ffbcc None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:44.140498 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 470/956] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:44.146265 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c1484-7167-4ee1-826b-8d769f9eb07c None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:44.246589 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c1484-7167-4ee1-826b-8d769f9eb07c None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:44.280833 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43872142-3628-47a5-abe0-a826732a15f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:44.281457 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43872142-3628-47a5-abe0-a826732a15f4 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:44.281733 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43872142-3628-47a5-abe0-a826732a15f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:44.282106 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43872142-3628-47a5-abe0-a826732a15f4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:44.289369 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43872142-3628-47a5-abe0-a826732a15f4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:44.290789 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43872142-3628-47a5-abe0-a826732a15f4 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:44.301756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-43872142-3628-47a5-abe0-a826732a15f4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 19 02:15:44.301756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:44.301756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:15:44.301756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:15:44.301756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:15:44.301756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:15:44.301756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:15:44.301756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:15:44.301756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:15:44.301756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:15:44.301756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:15:44.301756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:15:44.301756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 02:15:44.301756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 02:15:44.301756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 02:15:44.301756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 02:15:44.302916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:15:44.302916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:15:44.302916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 02:15:44.302916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:15:44.302916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 02:15:44.302916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 02:15:44.302916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:15:44.302916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:15:44.302916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:15:44.302916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:15:44.302916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:15:44.302916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:15:44.302916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:15:44.302916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:15:44.302916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:15:44.302916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:15:44.302916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:15:44.302916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:15:44.303963 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:15:44.303963 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:15:44.303963 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 02:15:44.303963 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 02:15:44.303963 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 02:15:44.303963 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 02:15:44.303963 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 02:15:44.303963 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 02:15:44.303963 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 19 02:15:44.303963 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:15:44.307037 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 487/957] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:15:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:15:44.308966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6852a64-6af7-41e7-8cf1-b7e74a8ffbcc None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:44.407603 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6852a64-6af7-41e7-8cf1-b7e74a8ffbcc None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:44.433051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:44.440855 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760eab5-c665-44ef-a737-dcc59af01b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:44.441499 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760eab5-c665-44ef-a737-dcc59af01b20 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:44.441757 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760eab5-c665-44ef-a737-dcc59af01b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:44.442024 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760eab5-c665-44ef-a737-dcc59af01b20 None admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:44.442750 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760eab5-c665-44ef-a737-dcc59af01b20 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:44.443081 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760eab5-c665-44ef-a737-dcc59af01b20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:44.444510 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760eab5-c665-44ef-a737-dcc59af01b20 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:44.461409 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 471/958] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Oct 19 02:15:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:44.467945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43872142-3628-47a5-abe0-a826732a15f4 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:44.483795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:44.568833 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43872142-3628-47a5-abe0-a826732a15f4 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:44.602427 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dde590-fafa-46e0-83c8-5f9caa77efbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:44.603040 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dde590-fafa-46e0-83c8-5f9caa77efbf None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:44.603316 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dde590-fafa-46e0-83c8-5f9caa77efbf None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:44.604102 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dde590-fafa-46e0-83c8-5f9caa77efbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:44.671826 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dde590-fafa-46e0-83c8-5f9caa77efbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:44.673279 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dde590-fafa-46e0-83c8-5f9caa77efbf None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:44.687367 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:44.771511 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 488/959] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 19 02:15:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 02:15:44.777381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760eab5-c665-44ef-a737-dcc59af01b20 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:44.876138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760eab5-c665-44ef-a737-dcc59af01b20 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:44.910848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2390b1-4f57-4a76-b9ce-3a745263271e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:44.911468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2390b1-4f57-4a76-b9ce-3a745263271e None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:44.911749 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2390b1-4f57-4a76-b9ce-3a745263271e None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:44.912021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2390b1-4f57-4a76-b9ce-3a745263271e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:44.922720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2390b1-4f57-4a76-b9ce-3a745263271e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:44.924184 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2390b1-4f57-4a76-b9ce-3a745263271e None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:44.939467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-1c2390b1-4f57-4a76-b9ce-3a745263271e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:15:44.939467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:44.939467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:15:44.939467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:15:44.939467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:15:44.939467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:15:44.939467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:15:44.939467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:15:44.939467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:15:44.939467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:15:44.939467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:15:44.939467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:15:44.939467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 02:15:44.939467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 02:15:44.939467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 02:15:44.939467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 02:15:44.940595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:15:44.940595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:15:44.940595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:15:44.940595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:15:44.940595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:15:44.940595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:15:44.940595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:15:44.940595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:15:44.940595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:15:44.940595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:15:44.940595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:15:44.940595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:15:44.940595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:15:44.940595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:15:44.940595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:15:44.940595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:15:44.940595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 02:15:44.941503 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 02:15:44.941503 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 02:15:44.941503 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:15:44.941503 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 472/960] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:15:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 02:15:44.946271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dde590-fafa-46e0-83c8-5f9caa77efbf None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:45.044847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dde590-fafa-46e0-83c8-5f9caa77efbf None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:45.058455 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:45.078409 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ada7f-9e10-4fbf-844f-fb41936d6821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:45.079024 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ada7f-9e10-4fbf-844f-fb41936d6821 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:45.079297 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ada7f-9e10-4fbf-844f-fb41936d6821 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:45.079563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ada7f-9e10-4fbf-844f-fb41936d6821 None admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:45.080195 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ada7f-9e10-4fbf-844f-fb41936d6821 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:45.080486 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ada7f-9e10-4fbf-844f-fb41936d6821 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:45.081829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ada7f-9e10-4fbf-844f-fb41936d6821 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:45.092873 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 489/961] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 19 02:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:45.099726 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2390b1-4f57-4a76-b9ce-3a745263271e None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:45.135568 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:45.198783 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2390b1-4f57-4a76-b9ce-3a745263271e None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:45.234414 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae3eca-db92-4f81-aa2f-ef58c0e491a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:45.235075 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae3eca-db92-4f81-aa2f-ef58c0e491a0 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:45.235352 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae3eca-db92-4f81-aa2f-ef58c0e491a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:45.235622 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae3eca-db92-4f81-aa2f-ef58c0e491a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:45.242168 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae3eca-db92-4f81-aa2f-ef58c0e491a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:45.243620 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae3eca-db92-4f81-aa2f-ef58c0e491a0 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:45.255427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application [None req-7cae3eca-db92-4f81-aa2f-ef58c0e491a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:15:45.255427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:45.255427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:15:45.255427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:15:45.255427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:15:45.255427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:15:45.255427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:15:45.255427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:15:45.255427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:15:45.255427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:15:45.255427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:15:45.255427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:15:45.255427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 02:15:45.255427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 02:15:45.255427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 02:15:45.256468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 02:15:45.256468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:15:45.256468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:15:45.256468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:15:45.256468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:15:45.256468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:15:45.256468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:15:45.256468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:15:45.256468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application with Lock( Oct 19 02:15:45.256468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:15:45.256468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:15:45.256468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:15:45.256468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:15:45.256468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:15:45.256468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:15:45.256468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:15:45.256468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:15:45.257636 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 02:15:45.257636 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 02:15:45.257636 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 02:15:45.257636 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 02:15:45.257636 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 02:15:45.257636 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 02:15:45.257636 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 02:15:45.257636 dv-cinder-861491-4-smb devstack@keystone.service[81671]: ERROR keystone.server.flask.application Oct 19 02:15:45.257636 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 473/962] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 19 02:15:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:15:45.262716 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ada7f-9e10-4fbf-844f-fb41936d6821 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:45.362005 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ada7f-9e10-4fbf-844f-fb41936d6821 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:45.394539 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05f75e-cab5-4bc5-89d2-e1deb32f61fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:45.395112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05f75e-cab5-4bc5-89d2-e1deb32f61fd None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:45.395390 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05f75e-cab5-4bc5-89d2-e1deb32f61fd None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:45.395660 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05f75e-cab5-4bc5-89d2-e1deb32f61fd None admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:45.396342 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05f75e-cab5-4bc5-89d2-e1deb32f61fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:45.396646 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05f75e-cab5-4bc5-89d2-e1deb32f61fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:45.398063 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05f75e-cab5-4bc5-89d2-e1deb32f61fd None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:45.410193 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 490/963] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 19 02:15:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:45.416885 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae3eca-db92-4f81-aa2f-ef58c0e491a0 None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:45.515578 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:45.521194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae3eca-db92-4f81-aa2f-ef58c0e491a0 None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:45.554181 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565cd25-986b-493a-8286-acf1f33f0156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:45.554811 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565cd25-986b-493a-8286-acf1f33f0156 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:45.555070 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565cd25-986b-493a-8286-acf1f33f0156 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:45.555338 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565cd25-986b-493a-8286-acf1f33f0156 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:45.556304 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565cd25-986b-493a-8286-acf1f33f0156 None admin] RBAC: Adding query filter params (role.id=e2e7c80d19c141bc9f9bfc13c2ec2a12, scope.project.id=91449401454c493cbf423888db8b8454, user.id=a66b9bc695b44877a06f17ea6bbeb27a) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:45.557108 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565cd25-986b-493a-8286-acf1f33f0156 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:45.558561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565cd25-986b-493a-8286-acf1f33f0156 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:45.564203 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 474/964] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 19 02:15:45 2022] GET /identity/v3/role_assignments?user.id=a66b9bc695b44877a06f17ea6bbeb27a&scope.project.id=91449401454c493cbf423888db8b8454&role.id=e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:47.719850 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352182c-b0db-4f95-ab0b-10aac5f7a1de None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:47.720406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352182c-b0db-4f95-ab0b-10aac5f7a1de None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:47.720406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352182c-b0db-4f95-ab0b-10aac5f7a1de None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:47.721756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 491/965] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:15:47.726792 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef4e90-211a-4063-93b7-b177467241b1 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:47.727237 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef4e90-211a-4063-93b7-b177467241b1 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:47.727392 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef4e90-211a-4063-93b7-b177467241b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:47.746359 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-b4ef4e90-211a-4063-93b7-b177467241b1 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:15:47.747651 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-b4ef4e90-211a-4063-93b7-b177467241b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:15:47.813537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 475/966] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:15:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:15:48.087929 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352182c-b0db-4f95-ab0b-10aac5f7a1de None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:48.119461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:48.191771 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352182c-b0db-4f95-ab0b-10aac5f7a1de None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:48.226617 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dade172-0fbf-4c49-8ae9-5b13b1e08c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:48.227304 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dade172-0fbf-4c49-8ae9-5b13b1e08c0b None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:48.227584 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dade172-0fbf-4c49-8ae9-5b13b1e08c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:48.227854 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dade172-0fbf-4c49-8ae9-5b13b1e08c0b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:48.228962 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dade172-0fbf-4c49-8ae9-5b13b1e08c0b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:48.230459 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dade172-0fbf-4c49-8ae9-5b13b1e08c0b None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:48.239354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-3dade172-0fbf-4c49-8ae9-5b13b1e08c0b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 02:15:48.239354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:48.239354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:15:48.239354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:15:48.239354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:15:48.239354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:15:48.239354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:15:48.239354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:15:48.239354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 02:15:48.239354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:15:48.239354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:15:48.239354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:15:48.239354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:48.239354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:15:48.239354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:15:48.239354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:15:48.239354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:15:48.240466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:15:48.240466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:15:48.240466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:15:48.240466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:15:48.240466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:15:48.240466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:15:48.240466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:15:48.240466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:15:48.240466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:15:48.240466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:15:48.240466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:15:48.240466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:15:48.240466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:15:48.240466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:15:48.240466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:15:48.240466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:15:48.241336 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:15:48.241336 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:15:48.241336 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:15:48.241336 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:15:48.241336 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:15:48.241336 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:15:48.241336 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:15:48.241336 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:15:48.241336 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:15:48.241336 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:15:48.241336 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:15:48.241336 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:15:48.241336 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 02:15:48.241336 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:15:48.241336 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 492/967] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 19 02:15:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:15:48.247400 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef4e90-211a-4063-93b7-b177467241b1 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:48.335088 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:48.344989 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef4e90-211a-4063-93b7-b177467241b1 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:48.379128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c49aff-a071-41f5-8351-820ab79d5af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:48.379731 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c49aff-a071-41f5-8351-820ab79d5af4 None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:48.380016 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c49aff-a071-41f5-8351-820ab79d5af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:48.380287 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c49aff-a071-41f5-8351-820ab79d5af4 None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:48.380911 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c49aff-a071-41f5-8351-820ab79d5af4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:48.381214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c49aff-a071-41f5-8351-820ab79d5af4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:48.382599 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c49aff-a071-41f5-8351-820ab79d5af4 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:48.387549 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 476/968] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Oct 19 02:15:48 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:48.393401 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dade172-0fbf-4c49-8ae9-5b13b1e08c0b None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:48.488872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:48.495047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dade172-0fbf-4c49-8ae9-5b13b1e08c0b None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:48.528382 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37723464-4487-4072-aaa3-c2ca8012a7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:48.528968 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37723464-4487-4072-aaa3-c2ca8012a7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:48.529242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37723464-4487-4072-aaa3-c2ca8012a7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:48.529508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37723464-4487-4072-aaa3-c2ca8012a7b6 None admin] PATH_INFO: `/v3/services` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:48.530125 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37723464-4487-4072-aaa3-c2ca8012a7b6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:48.530423 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37723464-4487-4072-aaa3-c2ca8012a7b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:48.531809 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37723464-4487-4072-aaa3-c2ca8012a7b6 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:48.536177 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 493/969] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Oct 19 02:15:48 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:50.692212 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc09df-cfd9-4298-8825-f5ed213ab032 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:50.732596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc09df-cfd9-4298-8825-f5ed213ab032 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:50.732596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc09df-cfd9-4298-8825-f5ed213ab032 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:50.732596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 477/970] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:15:50.732888 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae342a-5b53-4248-95af-774536f7b359 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:50.732888 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae342a-5b53-4248-95af-774536f7b359 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:50.732888 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae342a-5b53-4248-95af-774536f7b359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:50.732888 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-eaae342a-5b53-4248-95af-774536f7b359 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:15:50.732888 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-eaae342a-5b53-4248-95af-774536f7b359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:15:50.787061 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 494/971] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:15:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:15:51.057983 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc09df-cfd9-4298-8825-f5ed213ab032 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:51.161251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc09df-cfd9-4298-8825-f5ed213ab032 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:51.195578 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9be36-8f4c-40cd-aa00-6313ac9123b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:51.196172 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9be36-8f4c-40cd-aa00-6313ac9123b8 None admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:51.196443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9be36-8f4c-40cd-aa00-6313ac9123b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:51.196708 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9be36-8f4c-40cd-aa00-6313ac9123b8 None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:51.198340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9be36-8f4c-40cd-aa00-6313ac9123b8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:51.199748 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9be36-8f4c-40cd-aa00-6313ac9123b8 None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:51.351989 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 478/972] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 19 02:15:51 2022] POST /identity/v3/services => generated 246 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:15:53.546981 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034f32a-619d-43d7-96f9-3e7ac354645a None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:53.547503 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034f32a-619d-43d7-96f9-3e7ac354645a None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:53.547503 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034f32a-619d-43d7-96f9-3e7ac354645a None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:53.548794 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 495/973] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:15:53.553988 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f0aea-6520-4753-b34f-fdde7587419a None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:53.554392 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f0aea-6520-4753-b34f-fdde7587419a None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:53.554537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f0aea-6520-4753-b34f-fdde7587419a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:53.574122 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-699f0aea-6520-4753-b34f-fdde7587419a None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:15:53.575343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-699f0aea-6520-4753-b34f-fdde7587419a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:15:53.584577 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:53.648117 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 479/974] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:15:53 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 02:15:53.920865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034f32a-619d-43d7-96f9-3e7ac354645a None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:54.011675 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:54.022094 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034f32a-619d-43d7-96f9-3e7ac354645a None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:54.058272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729463e-238d-4b29-9e8b-508e60df410b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:54.058937 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729463e-238d-4b29-9e8b-508e60df410b None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:54.059425 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729463e-238d-4b29-9e8b-508e60df410b None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:54.059930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729463e-238d-4b29-9e8b-508e60df410b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:54.060867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729463e-238d-4b29-9e8b-508e60df410b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:54.062263 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729463e-238d-4b29-9e8b-508e60df410b None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:54.070934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-9729463e-238d-4b29-9e8b-508e60df410b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 02:15:54.070934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:54.070934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:15:54.070934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:15:54.070934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:15:54.070934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:15:54.070934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:15:54.070934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:15:54.070934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 02:15:54.070934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:15:54.070934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:15:54.070934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:15:54.070934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:54.070934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:15:54.070934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:15:54.070934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:15:54.070934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:15:54.072249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:15:54.072249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:15:54.072249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:15:54.072249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:15:54.072249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:15:54.072249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:15:54.072249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:15:54.072249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:15:54.072249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:15:54.072249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:15:54.072249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:15:54.072249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:15:54.072249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:15:54.072249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:15:54.072249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:15:54.072249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:15:54.073386 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:15:54.073386 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:15:54.073386 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:15:54.073386 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:15:54.073386 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:15:54.073386 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:15:54.073386 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:15:54.073386 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:15:54.073386 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:15:54.073386 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:15:54.073386 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:15:54.073386 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:15:54.073386 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 02:15:54.073386 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:15:54.073386 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 496/975] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 19 02:15:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:15:54.078280 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f0aea-6520-4753-b34f-fdde7587419a None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:54.175696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f0aea-6520-4753-b34f-fdde7587419a None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:54.210350 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3910e7-d909-4f8e-aaaa-a206d321dd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:54.211033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3910e7-d909-4f8e-aaaa-a206d321dd4a None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:54.215389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3910e7-d909-4f8e-aaaa-a206d321dd4a None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:54.215389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3910e7-d909-4f8e-aaaa-a206d321dd4a None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:54.215389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3910e7-d909-4f8e-aaaa-a206d321dd4a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:54.215389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3910e7-d909-4f8e-aaaa-a206d321dd4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:54.215389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3910e7-d909-4f8e-aaaa-a206d321dd4a None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:54.220864 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 480/976] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Oct 19 02:15:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:54.226880 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729463e-238d-4b29-9e8b-508e60df410b None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:54.326087 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729463e-238d-4b29-9e8b-508e60df410b None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:54.359168 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9cc62d-b058-4231-a7fd-e27318aa9ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:54.359761 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cc62d-b058-4231-a7fd-e27318aa9ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:54.360037 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cc62d-b058-4231-a7fd-e27318aa9ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:54.360306 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cc62d-b058-4231-a7fd-e27318aa9ac1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:54.360998 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9cc62d-b058-4231-a7fd-e27318aa9ac1 None admin] RBAC: Adding query filter params (interface=public, service_id=da4fc3f2367342f2b7eae223d5d366ed, region_id=RegionOne) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:54.361303 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9cc62d-b058-4231-a7fd-e27318aa9ac1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:54.362668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9cc62d-b058-4231-a7fd-e27318aa9ac1 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:54.367549 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 497/977] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 19 02:15:54 2022] GET /identity/v3/endpoints?service_id=da4fc3f2367342f2b7eae223d5d366ed&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:54.373652 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3910e7-d909-4f8e-aaaa-a206d321dd4a None admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:54.377344 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:54.475805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3910e7-d909-4f8e-aaaa-a206d321dd4a None admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:54.509472 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8515c-15d4-4ec1-8784-099542b1c4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:54.510077 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8515c-15d4-4ec1-8784-099542b1c4af None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:54.510353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8515c-15d4-4ec1-8784-099542b1c4af None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:54.510624 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8515c-15d4-4ec1-8784-099542b1c4af None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:54.511258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8515c-15d4-4ec1-8784-099542b1c4af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:54.512645 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8515c-15d4-4ec1-8784-099542b1c4af None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:54.519423 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 481/978] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 19 02:15:54 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:15:56.674370 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cc716-c2a7-436c-99aa-4e43310be222 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:56.674965 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cc716-c2a7-436c-99aa-4e43310be222 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:56.674965 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cc716-c2a7-436c-99aa-4e43310be222 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:56.676296 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 498/979] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:15:56.682920 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352a862-8535-4110-989c-145c3505c4c9 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:56.685866 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352a862-8535-4110-989c-145c3505c4c9 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:56.685866 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352a862-8535-4110-989c-145c3505c4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:56.702394 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-7352a862-8535-4110-989c-145c3505c4c9 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:15:56.703645 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-7352a862-8535-4110-989c-145c3505c4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:15:56.764916 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:56.770200 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 482/980] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:15:56 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 02:15:57.035561 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cc716-c2a7-436c-99aa-4e43310be222 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:57.057062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:57.139061 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cc716-c2a7-436c-99aa-4e43310be222 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:57.172945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f16c4-f072-459b-8fd0-f71bfa27f363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:57.173562 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f16c4-f072-459b-8fd0-f71bfa27f363 None admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:57.173839 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f16c4-f072-459b-8fd0-f71bfa27f363 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:57.174110 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f16c4-f072-459b-8fd0-f71bfa27f363 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:57.174688 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f16c4-f072-459b-8fd0-f71bfa27f363 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:57.176071 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f16c4-f072-459b-8fd0-f71bfa27f363 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:57.185890 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application [None req-291f16c4-f072-459b-8fd0-f71bfa27f363 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 02:15:57.185890 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:57.185890 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 02:15:57.185890 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 02:15:57.185890 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 02:15:57.185890 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 02:15:57.185890 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 02:15:57.185890 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:15:57.185890 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 02:15:57.185890 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:15:57.185890 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 02:15:57.185890 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:15:57.185890 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 02:15:57.185890 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 02:15:57.185890 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 02:15:57.185890 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 02:15:57.185890 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 02:15:57.188491 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 02:15:57.188491 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 02:15:57.188491 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 02:15:57.188491 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 02:15:57.188491 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 02:15:57.188491 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 02:15:57.188491 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 02:15:57.188491 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 02:15:57.188491 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 02:15:57.188491 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 02:15:57.188491 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 02:15:57.188491 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 02:15:57.188491 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 02:15:57.188491 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 02:15:57.188491 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 02:15:57.188491 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 02:15:57.189516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 02:15:57.189516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application with Lock( Oct 19 02:15:57.189516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 02:15:57.189516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self._enter() Oct 19 02:15:57.189516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 02:15:57.189516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 02:15:57.189516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 02:15:57.189516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application return self.creator() Oct 19 02:15:57.189516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 02:15:57.189516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application created_value = creator( Oct 19 02:15:57.189516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 02:15:57.189516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 02:15:57.189516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 02:15:57.189516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: ERROR keystone.server.flask.application Oct 19 02:15:57.189516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 499/981] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 19 02:15:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 02:15:57.193164 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352a862-8535-4110-989c-145c3505c4c9 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:57.292856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352a862-8535-4110-989c-145c3505c4c9 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:57.325940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8ee36-d08f-4e2d-80eb-681204dbe31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:57.326543 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8ee36-d08f-4e2d-80eb-681204dbe31e None admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:57.326842 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8ee36-d08f-4e2d-80eb-681204dbe31e None admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:57.327114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8ee36-d08f-4e2d-80eb-681204dbe31e None admin] PATH_INFO: `/v3/services` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:57.327741 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8ee36-d08f-4e2d-80eb-681204dbe31e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:15:57.328041 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8ee36-d08f-4e2d-80eb-681204dbe31e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:57.329396 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8ee36-d08f-4e2d-80eb-681204dbe31e None admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:57.334544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 483/982] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Oct 19 02:15:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:15:57.342682 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f16c4-f072-459b-8fd0-f71bfa27f363 None admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:15:57.424076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:57.443058 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f16c4-f072-459b-8fd0-f71bfa27f363 None admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:15:57.476351 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3e19e-be08-42e4-bdeb-541972f09546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:15:57.476947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3e19e-be08-42e4-bdeb-541972f09546 None admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:15:57.477225 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3e19e-be08-42e4-bdeb-541972f09546 None admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:15:57.477502 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3e19e-be08-42e4-bdeb-541972f09546 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:15:57.478871 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3e19e-be08-42e4-bdeb-541972f09546 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:15:57.480210 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3e19e-be08-42e4-bdeb-541972f09546 None admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:15:57.574655 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 500/983] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:15:57 2022] POST /identity/v3/endpoints => generated 331 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:16:07.331435 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=69 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:16:07.569460 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:23:49.089132 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a0128-edec-4ecd-9f1b-84076e98aabd None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:23:49.090768 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a0128-edec-4ecd-9f1b-84076e98aabd None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:23:49.091653 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a0128-edec-4ecd-9f1b-84076e98aabd None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:23:49.093826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 484/984] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:23:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:23:49.101510 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f6bc2-2780-45bd-9040-d9827493dcaa None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:23:49.102841 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f6bc2-2780-45bd-9040-d9827493dcaa None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:23:49.103676 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f6bc2-2780-45bd-9040-d9827493dcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:23:49.220160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-3c9f6bc2-2780-45bd-9040-d9827493dcaa None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:23:49.221885 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-3c9f6bc2-2780-45bd-9040-d9827493dcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:23:49.344661 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 501/985] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:23:49.646291 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f71604-7cca-41d2-9a0b-331077c7c5a1 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:23:49.646654 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f71604-7cca-41d2-9a0b-331077c7c5a1 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:23:49.647162 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f71604-7cca-41d2-9a0b-331077c7c5a1 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:23:49.649215 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 485/986] 10.222.0.16 () {54 vars in 964 bytes} [Wed Oct 19 02:23:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:23:49.656127 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505e3dc-1bf0-44ec-8429-48f0fbb4e7f9 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:23:49.656453 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505e3dc-1bf0-44ec-8429-48f0fbb4e7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:23:49.656685 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505e3dc-1bf0-44ec-8429-48f0fbb4e7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:23:49.747632 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-5505e3dc-1bf0-44ec-8429-48f0fbb4e7f9 None None] MFA Rules not processed for user `e7e4640bd879468d81ec0281827687ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:23:49.748851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-5505e3dc-1bf0-44ec-8429-48f0fbb4e7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:23:49.774066 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:23:49.835309 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 502/987] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Oct 19 02:23:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:23:49.844741 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f71604-7cca-41d2-9a0b-331077c7c5a1 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:23:49.846563 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-e3f71604-7cca-41d2-9a0b-331077c7c5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:23:49.958653 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f71604-7cca-41d2-9a0b-331077c7c5a1 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:23:50.039460 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2dcdc-1f7b-47a3-9bbc-a089bcedfe97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:23:50.040354 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2dcdc-1f7b-47a3-9bbc-a089bcedfe97 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:23:50.040791 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2dcdc-1f7b-47a3-9bbc-a089bcedfe97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:23:50.041208 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2dcdc-1f7b-47a3-9bbc-a089bcedfe97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:23:50.043097 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-b9f2dcdc-1f7b-47a3-9bbc-a089bcedfe97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:23:50.104313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:23:50.165183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2dcdc-1f7b-47a3-9bbc-a089bcedfe97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:23:50.166923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2dcdc-1f7b-47a3-9bbc-a089bcedfe97 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:23:50.187317 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 486/988] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:23:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:23:52.637265 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793c8a9-eba5-4f22-8ee7-bcf4cbfb60be None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:23:52.637788 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793c8a9-eba5-4f22-8ee7-bcf4cbfb60be None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:23:52.637788 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793c8a9-eba5-4f22-8ee7-bcf4cbfb60be None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:23:52.639181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 503/989] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:23:52.644353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32843e2c-717e-41de-bc96-0b6cd7c873ee None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:23:52.644732 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32843e2c-717e-41de-bc96-0b6cd7c873ee None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:23:52.644843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32843e2c-717e-41de-bc96-0b6cd7c873ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:23:52.715601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-32843e2c-717e-41de-bc96-0b6cd7c873ee None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:23:52.716799 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-32843e2c-717e-41de-bc96-0b6cd7c873ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:23:52.810695 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 487/990] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:23:53.094401 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793c8a9-eba5-4f22-8ee7-bcf4cbfb60be None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:23:53.095988 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-4793c8a9-eba5-4f22-8ee7-bcf4cbfb60be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:23:53.203207 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793c8a9-eba5-4f22-8ee7-bcf4cbfb60be None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:23:53.278069 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:23:53.280209 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3888a-e7fb-4fe3-8c48-363772ca23fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:23:53.280854 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3888a-e7fb-4fe3-8c48-363772ca23fe service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:23:53.281128 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3888a-e7fb-4fe3-8c48-363772ca23fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:23:53.281397 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3888a-e7fb-4fe3-8c48-363772ca23fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:23:53.283028 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-1be3888a-e7fb-4fe3-8c48-363772ca23fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:23:53.394443 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3888a-e7fb-4fe3-8c48-363772ca23fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:23:53.395846 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3888a-e7fb-4fe3-8c48-363772ca23fe service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:23:53.414395 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 504/991] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:23:56.129585 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a20a75-6870-482b-8143-67b4ca21a40d None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:23:56.130127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a20a75-6870-482b-8143-67b4ca21a40d None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:23:56.130127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a20a75-6870-482b-8143-67b4ca21a40d None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:23:56.131551 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 488/992] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:23:56.137559 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a4054-d954-4176-a0e5-669cc3718394 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:23:56.137987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a4054-d954-4176-a0e5-669cc3718394 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:23:56.138103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a4054-d954-4176-a0e5-669cc3718394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:23:56.204478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-c40a4054-d954-4176-a0e5-669cc3718394 None None] MFA Rules not processed for user `947420b556064f1388b8623a98f5073e`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:23:56.205674 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-c40a4054-d954-4176-a0e5-669cc3718394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:23:56.257101 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:23:56.302285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 505/993] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:23:56 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:23:56.596839 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a20a75-6870-482b-8143-67b4ca21a40d None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:23:56.598375 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-09a20a75-6870-482b-8143-67b4ca21a40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:23:56.609627 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:23:56.702910 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a20a75-6870-482b-8143-67b4ca21a40d None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:23:56.775218 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016214bc-9a04-4b40-83eb-81bd3cc6019e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:23:56.775813 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016214bc-9a04-4b40-83eb-81bd3cc6019e service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:23:56.776086 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016214bc-9a04-4b40-83eb-81bd3cc6019e service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:23:56.776349 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016214bc-9a04-4b40-83eb-81bd3cc6019e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:23:56.777914 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-016214bc-9a04-4b40-83eb-81bd3cc6019e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:23:56.840849 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:23:56.886337 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016214bc-9a04-4b40-83eb-81bd3cc6019e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:23:56.887796 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016214bc-9a04-4b40-83eb-81bd3cc6019e service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:23:56.905693 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 489/994] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:23:56 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:23:59.812693 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b562ea-9811-494a-a140-290ebca48ce7 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:23:59.813233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b562ea-9811-494a-a140-290ebca48ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:23:59.813233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b562ea-9811-494a-a140-290ebca48ce7 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:23:59.814569 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 506/995] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:23:59.820540 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54270e-52b4-41ee-af73-c8abb343306a None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:23:59.820970 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54270e-52b4-41ee-af73-c8abb343306a None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:23:59.821249 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54270e-52b4-41ee-af73-c8abb343306a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:23:59.887197 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-5e54270e-52b4-41ee-af73-c8abb343306a None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:23:59.888433 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-5e54270e-52b4-41ee-af73-c8abb343306a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:23:59.983284 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 490/996] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:23:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:24:00.282429 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b562ea-9811-494a-a140-290ebca48ce7 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:00.283988 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-71b562ea-9811-494a-a140-290ebca48ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:00.390031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b562ea-9811-494a-a140-290ebca48ce7 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:00.463821 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b88b2-bcc4-4298-b88b-826b665c9127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:00.464470 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b88b2-bcc4-4298-b88b-826b665c9127 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:00.464702 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b88b2-bcc4-4298-b88b-826b665c9127 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:00.464972 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b88b2-bcc4-4298-b88b-826b665c9127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:00.466567 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-b28b88b2-bcc4-4298-b88b-826b665c9127 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:00.473394 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:00.577492 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b88b2-bcc4-4298-b88b-826b665c9127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:00.578959 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b88b2-bcc4-4298-b88b-826b665c9127 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:00.596862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 507/997] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:24:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:24:03.631275 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cddf2-8c9e-4d8e-9e5b-7269ef62cbdc None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:03.631885 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cddf2-8c9e-4d8e-9e5b-7269ef62cbdc None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:03.631885 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cddf2-8c9e-4d8e-9e5b-7269ef62cbdc None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:03.633708 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 491/998] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:24:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:24:03.638950 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539565a4-44e7-49ef-ac1b-84d83947d73e None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:03.639370 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539565a4-44e7-49ef-ac1b-84d83947d73e None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:03.639623 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539565a4-44e7-49ef-ac1b-84d83947d73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:03.706276 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-539565a4-44e7-49ef-ac1b-84d83947d73e None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:24:03.707518 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-539565a4-44e7-49ef-ac1b-84d83947d73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:03.767086 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:03.807119 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 508/999] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:24:04.095842 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cddf2-8c9e-4d8e-9e5b-7269ef62cbdc None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:04.097391 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-bc9cddf2-8c9e-4d8e-9e5b-7269ef62cbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:04.118121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:04.202848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cddf2-8c9e-4d8e-9e5b-7269ef62cbdc None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:04.278760 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f4311-87a3-4486-9f25-d3417a804cfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:04.279294 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f4311-87a3-4486-9f25-d3417a804cfe service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:04.279570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f4311-87a3-4486-9f25-d3417a804cfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:04.279840 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f4311-87a3-4486-9f25-d3417a804cfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:04.281424 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-5d3f4311-87a3-4486-9f25-d3417a804cfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:04.353128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:04.390731 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f4311-87a3-4486-9f25-d3417a804cfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:04.391541 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f4311-87a3-4486-9f25-d3417a804cfe service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:04.409380 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 492/1000] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:24:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:24:06.625636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d390eb1-3cf3-4cc8-85ce-68b160222d37 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:06.626199 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d390eb1-3cf3-4cc8-85ce-68b160222d37 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:06.626199 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d390eb1-3cf3-4cc8-85ce-68b160222d37 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:06.627538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 509/1001] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:24:06.633647 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b31bae-83d9-4ea4-bffd-35eedb1d618b None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:06.634081 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b31bae-83d9-4ea4-bffd-35eedb1d618b None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:06.634180 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b31bae-83d9-4ea4-bffd-35eedb1d618b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:06.700380 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-e5b31bae-83d9-4ea4-bffd-35eedb1d618b None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:24:06.701607 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-e5b31bae-83d9-4ea4-bffd-35eedb1d618b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:06.801015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 493/1002] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:24:07.082544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d390eb1-3cf3-4cc8-85ce-68b160222d37 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:07.084136 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-6d390eb1-3cf3-4cc8-85ce-68b160222d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:07.195249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d390eb1-3cf3-4cc8-85ce-68b160222d37 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:07.276700 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacfa61-4002-491b-8a61-e9985139d9c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:07.277302 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacfa61-4002-491b-8a61-e9985139d9c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:07.277576 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacfa61-4002-491b-8a61-e9985139d9c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:07.277843 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacfa61-4002-491b-8a61-e9985139d9c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:07.279457 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-ebacfa61-4002-491b-8a61-e9985139d9c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:07.297035 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:07.391518 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacfa61-4002-491b-8a61-e9985139d9c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:07.392961 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacfa61-4002-491b-8a61-e9985139d9c1 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:07.413518 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 510/1003] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:24:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:24:09.631871 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba15624-f56f-4801-a509-3c6c1cf07350 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:09.632429 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba15624-f56f-4801-a509-3c6c1cf07350 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:09.632429 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba15624-f56f-4801-a509-3c6c1cf07350 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:09.633763 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 494/1004] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:24:09.639288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b8d93-5ebd-435c-a88b-9e280cf1e293 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:09.639747 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b8d93-5ebd-435c-a88b-9e280cf1e293 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:09.639836 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b8d93-5ebd-435c-a88b-9e280cf1e293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:09.706109 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-8f1b8d93-5ebd-435c-a88b-9e280cf1e293 None None] MFA Rules not processed for user `947420b556064f1388b8623a98f5073e`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:24:09.707355 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-8f1b8d93-5ebd-435c-a88b-9e280cf1e293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:09.773653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:09.805646 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 511/1005] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:24:09 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:24:10.087234 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba15624-f56f-4801-a509-3c6c1cf07350 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:10.088818 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-0ba15624-f56f-4801-a509-3c6c1cf07350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:10.122501 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:10.200355 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba15624-f56f-4801-a509-3c6c1cf07350 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:10.279412 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0806103-c28c-4579-84f3-2d584b5bafec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:10.280023 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0806103-c28c-4579-84f3-2d584b5bafec service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:10.280299 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0806103-c28c-4579-84f3-2d584b5bafec service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:10.280569 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0806103-c28c-4579-84f3-2d584b5bafec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:10.282147 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-a0806103-c28c-4579-84f3-2d584b5bafec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:10.361266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:10.393124 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0806103-c28c-4579-84f3-2d584b5bafec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:10.394954 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0806103-c28c-4579-84f3-2d584b5bafec service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:10.416924 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 495/1006] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:24:10 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:24:13.035591 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14166e8-59a6-48bf-bf80-787b81616960 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:13.036183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14166e8-59a6-48bf-bf80-787b81616960 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:13.036183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14166e8-59a6-48bf-bf80-787b81616960 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:13.037528 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 512/1007] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:24:13.044057 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44463c0-0d7f-4d48-91fa-8f00cd33f785 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:13.044659 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44463c0-0d7f-4d48-91fa-8f00cd33f785 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:13.044659 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44463c0-0d7f-4d48-91fa-8f00cd33f785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:13.110863 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-b44463c0-0d7f-4d48-91fa-8f00cd33f785 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:24:13.112067 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-b44463c0-0d7f-4d48-91fa-8f00cd33f785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:13.208300 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 496/1008] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:24:13.492876 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14166e8-59a6-48bf-bf80-787b81616960 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:13.494421 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-f14166e8-59a6-48bf-bf80-787b81616960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:13.598639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14166e8-59a6-48bf-bf80-787b81616960 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:13.671872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056d3a4-a8a1-48a2-baf7-059075db8457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:13.672464 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056d3a4-a8a1-48a2-baf7-059075db8457 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:13.672738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056d3a4-a8a1-48a2-baf7-059075db8457 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:13.673006 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056d3a4-a8a1-48a2-baf7-059075db8457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:13.674580 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-1056d3a4-a8a1-48a2-baf7-059075db8457 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:13.702664 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:13.784252 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056d3a4-a8a1-48a2-baf7-059075db8457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:13.785604 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056d3a4-a8a1-48a2-baf7-059075db8457 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:13.805360 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 513/1009] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:24:16.004938 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e59d11-6f54-4d02-908c-4db024e82d0f None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:16.005446 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e59d11-6f54-4d02-908c-4db024e82d0f None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:16.005446 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e59d11-6f54-4d02-908c-4db024e82d0f None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:16.007002 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 497/1010] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:24:16.012271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4700d6-c7ff-4bcf-9e10-a5d278868a66 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:16.012704 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4700d6-c7ff-4bcf-9e10-a5d278868a66 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:16.012807 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4700d6-c7ff-4bcf-9e10-a5d278868a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:16.078578 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-3d4700d6-c7ff-4bcf-9e10-a5d278868a66 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:24:16.079817 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-3d4700d6-c7ff-4bcf-9e10-a5d278868a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:16.157220 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:16.180800 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 514/1011] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:24:16.469668 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e59d11-6f54-4d02-908c-4db024e82d0f None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:16.471244 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-94e59d11-6f54-4d02-908c-4db024e82d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:16.511880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:16.576694 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e59d11-6f54-4d02-908c-4db024e82d0f None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:16.650118 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae42a19-d7ea-497e-9a35-29843d058bac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:16.650643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae42a19-d7ea-497e-9a35-29843d058bac service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:16.650943 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae42a19-d7ea-497e-9a35-29843d058bac service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:16.651210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae42a19-d7ea-497e-9a35-29843d058bac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:16.652777 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-3ae42a19-d7ea-497e-9a35-29843d058bac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:16.735805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:16.761876 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae42a19-d7ea-497e-9a35-29843d058bac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:16.763331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae42a19-d7ea-497e-9a35-29843d058bac service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:16.781556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 498/1012] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:24:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:24:19.483191 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242c0dd-d2f6-4b00-81fb-7921f5f5b0a0 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:19.483700 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242c0dd-d2f6-4b00-81fb-7921f5f5b0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:19.483700 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242c0dd-d2f6-4b00-81fb-7921f5f5b0a0 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:19.484976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 515/1013] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:24:19.490176 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f18a5-2bd7-4f4e-8a70-1467436093ad None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:19.490601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f18a5-2bd7-4f4e-8a70-1467436093ad None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:19.490740 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f18a5-2bd7-4f4e-8a70-1467436093ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:19.556990 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-671f18a5-2bd7-4f4e-8a70-1467436093ad None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:24:19.558189 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-671f18a5-2bd7-4f4e-8a70-1467436093ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:19.653611 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 499/1014] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:24:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:24:19.937347 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242c0dd-d2f6-4b00-81fb-7921f5f5b0a0 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:19.938906 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-7242c0dd-d2f6-4b00-81fb-7921f5f5b0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:20.043835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242c0dd-d2f6-4b00-81fb-7921f5f5b0a0 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:20.117829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee3909-dc1d-4082-bcf3-226d60c1af20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:20.120744 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee3909-dc1d-4082-bcf3-226d60c1af20 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:20.120744 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee3909-dc1d-4082-bcf3-226d60c1af20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:20.120744 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee3909-dc1d-4082-bcf3-226d60c1af20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:20.121081 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-9dee3909-dc1d-4082-bcf3-226d60c1af20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:20.157343 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:20.231831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee3909-dc1d-4082-bcf3-226d60c1af20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:20.233355 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee3909-dc1d-4082-bcf3-226d60c1af20 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:20.252928 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 516/1015] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:24:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:24:24.588030 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f723c-ae71-407b-95d9-4e82b21c1320 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:24.588543 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f723c-ae71-407b-95d9-4e82b21c1320 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:24.588543 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f723c-ae71-407b-95d9-4e82b21c1320 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:24.590053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 500/1016] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:24:24.595132 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c9e2d-b296-4d3e-b08b-05640af2b678 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:24.595529 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c9e2d-b296-4d3e-b08b-05640af2b678 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:24.595672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c9e2d-b296-4d3e-b08b-05640af2b678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:24.670662 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-039c9e2d-b296-4d3e-b08b-05640af2b678 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:24:24.671888 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-039c9e2d-b296-4d3e-b08b-05640af2b678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:24.761567 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:24.773284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 517/1017] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:24:25.078736 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853190d9-0270-4134-9a4a-a03a063858e5 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:25.079169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853190d9-0270-4134-9a4a-a03a063858e5 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:25.079516 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853190d9-0270-4134-9a4a-a03a063858e5 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:25.080947 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 501/1018] 10.222.0.16 () {54 vars in 964 bytes} [Wed Oct 19 02:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:24:25.087539 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fda6f-b76b-4e1a-ac4c-7125960d4fb5 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:25.087896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fda6f-b76b-4e1a-ac4c-7125960d4fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:25.088252 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fda6f-b76b-4e1a-ac4c-7125960d4fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:25.167910 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-c30fda6f-b76b-4e1a-ac4c-7125960d4fb5 None None] MFA Rules not processed for user `e7e4640bd879468d81ec0281827687ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:24:25.169127 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-c30fda6f-b76b-4e1a-ac4c-7125960d4fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:25.251769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 518/1019] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Oct 19 02:24:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:24:25.261502 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853190d9-0270-4134-9a4a-a03a063858e5 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:25.263178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-853190d9-0270-4134-9a4a-a03a063858e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:25.312085 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:25.367662 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853190d9-0270-4134-9a4a-a03a063858e5 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:25.442158 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8da58-5c2c-4fd6-ab8f-12e68cbbc744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:25.442789 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8da58-5c2c-4fd6-ab8f-12e68cbbc744 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:25.443106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8da58-5c2c-4fd6-ab8f-12e68cbbc744 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:25.443376 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8da58-5c2c-4fd6-ab8f-12e68cbbc744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:25.445462 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-8ec8da58-5c2c-4fd6-ab8f-12e68cbbc744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:25.540161 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:25.557306 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8da58-5c2c-4fd6-ab8f-12e68cbbc744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:25.559735 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8da58-5c2c-4fd6-ab8f-12e68cbbc744 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:25.579798 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 502/1020] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:24:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:24:29.318863 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbafc8-c8e0-4ec4-ac99-d5db8a087aaf None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:29.319337 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbafc8-c8e0-4ec4-ac99-d5db8a087aaf None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:29.319428 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbafc8-c8e0-4ec4-ac99-d5db8a087aaf None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:29.320785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 519/1021] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:24:29.325905 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84ee46-680e-4b03-8fc2-8cb45c58db0b None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:29.326338 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84ee46-680e-4b03-8fc2-8cb45c58db0b None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:29.326432 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84ee46-680e-4b03-8fc2-8cb45c58db0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:29.401329 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-0f84ee46-680e-4b03-8fc2-8cb45c58db0b None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:24:29.402556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-0f84ee46-680e-4b03-8fc2-8cb45c58db0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:29.506995 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 503/1022] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:24:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:24:29.793288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbafc8-c8e0-4ec4-ac99-d5db8a087aaf None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:29.794882 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-befbafc8-c8e0-4ec4-ac99-d5db8a087aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:29.890098 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:29.907459 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbafc8-c8e0-4ec4-ac99-d5db8a087aaf None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:29.983043 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524e0a8-f81e-4822-a103-35a99ef07e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:29.983650 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524e0a8-f81e-4822-a103-35a99ef07e0f service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:29.983930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524e0a8-f81e-4822-a103-35a99ef07e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:29.984203 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524e0a8-f81e-4822-a103-35a99ef07e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:29.985804 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-7524e0a8-f81e-4822-a103-35a99ef07e0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:30.097462 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524e0a8-f81e-4822-a103-35a99ef07e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:30.098924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524e0a8-f81e-4822-a103-35a99ef07e0f service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:30.119156 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 520/1023] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:24:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:24:34.881615 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f9bbb-8e13-4c81-8f37-8db6aacdca76 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:34.882290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f9bbb-8e13-4c81-8f37-8db6aacdca76 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:34.882290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f9bbb-8e13-4c81-8f37-8db6aacdca76 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:34.883526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 504/1024] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:24:34.888994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8caea-9641-4c8b-9057-488ba4afd270 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:34.889412 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8caea-9641-4c8b-9057-488ba4afd270 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:34.889509 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8caea-9641-4c8b-9057-488ba4afd270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:34.905535 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:34.961490 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-34d8caea-9641-4c8b-9057-488ba4afd270 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:24:34.962731 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-34d8caea-9641-4c8b-9057-488ba4afd270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:35.066913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 521/1025] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:24:35.354496 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f9bbb-8e13-4c81-8f37-8db6aacdca76 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:35.356099 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-2b6f9bbb-8e13-4c81-8f37-8db6aacdca76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:35.414052 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:35.459992 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f9bbb-8e13-4c81-8f37-8db6aacdca76 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:35.531940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8dfb30-56dc-4499-9100-3feea0c652cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:35.532535 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dfb30-56dc-4499-9100-3feea0c652cb service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:35.532809 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dfb30-56dc-4499-9100-3feea0c652cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:35.533073 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dfb30-56dc-4499-9100-3feea0c652cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:35.534646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-db8dfb30-56dc-4499-9100-3feea0c652cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:35.639087 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:35.642255 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8dfb30-56dc-4499-9100-3feea0c652cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:35.643696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8dfb30-56dc-4499-9100-3feea0c652cb service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:35.662664 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 505/1026] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:24:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:24:40.596256 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d6a6c-89a2-4aa9-ace6-58c7ede5fd48 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:40.597279 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d6a6c-89a2-4aa9-ace6-58c7ede5fd48 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:40.597885 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d6a6c-89a2-4aa9-ace6-58c7ede5fd48 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:40.599738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 522/1027] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 19 02:24:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:24:40.606442 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebdca2-e29a-409a-9039-ad145c9ea010 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:40.606963 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebdca2-e29a-409a-9039-ad145c9ea010 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:40.607046 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebdca2-e29a-409a-9039-ad145c9ea010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:40.708324 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-e9ebdca2-e29a-409a-9039-ad145c9ea010 None None] MFA Rules not processed for user `a66b9bc695b44877a06f17ea6bbeb27a`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:24:40.710429 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-e9ebdca2-e29a-409a-9039-ad145c9ea010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:40.890153 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 506/1028] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 19 02:24:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:24:45.065345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=59 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:45.330873 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8966e98-50ee-4c0e-aa2b-a1efc1ca28e5 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:45.331077 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8966e98-50ee-4c0e-aa2b-a1efc1ca28e5 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:45.331396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8966e98-50ee-4c0e-aa2b-a1efc1ca28e5 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:45.332897 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 523/1029] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 19 02:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:24:45.338553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a1977-d26a-42e5-a29f-1611f7dbca44 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:45.339074 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a1977-d26a-42e5-a29f-1611f7dbca44 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:45.339194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a1977-d26a-42e5-a29f-1611f7dbca44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:45.398604 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:45.422381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-206a1977-d26a-42e5-a29f-1611f7dbca44 None None] MFA Rules not processed for user `a66b9bc695b44877a06f17ea6bbeb27a`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:24:45.423623 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-206a1977-d26a-42e5-a29f-1611f7dbca44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:45.544542 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 507/1030] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 19 02:24:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:24:46.531812 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688f013-9442-4e57-9b41-7dd344a1447c None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:46.532384 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688f013-9442-4e57-9b41-7dd344a1447c None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:46.532569 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688f013-9442-4e57-9b41-7dd344a1447c None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:46.534050 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 524/1031] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 19 02:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:24:46.539980 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065e1bc-64a3-4beb-8f3d-9be377f3a46c None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:46.540444 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065e1bc-64a3-4beb-8f3d-9be377f3a46c None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:46.540549 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065e1bc-64a3-4beb-8f3d-9be377f3a46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:46.620532 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-c065e1bc-64a3-4beb-8f3d-9be377f3a46c None None] MFA Rules not processed for user `a66b9bc695b44877a06f17ea6bbeb27a`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:24:46.621731 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c065e1bc-64a3-4beb-8f3d-9be377f3a46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:46.665506 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:46.733238 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 508/1032] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 19 02:24:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:24:50.479657 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93d796-6c73-4f3a-9910-2ea540fe96d0 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:50.480642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93d796-6c73-4f3a-9910-2ea540fe96d0 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:50.480911 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93d796-6c73-4f3a-9910-2ea540fe96d0 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:50.482432 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 525/1033] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:24:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:24:50.488520 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7718cae-a3d4-4515-a88e-386e857ca692 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:50.488971 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7718cae-a3d4-4515-a88e-386e857ca692 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:50.489051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7718cae-a3d4-4515-a88e-386e857ca692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:50.564699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-b7718cae-a3d4-4515-a88e-386e857ca692 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:24:50.566098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-b7718cae-a3d4-4515-a88e-386e857ca692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:50.669721 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 509/1034] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:24:50.971537 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46fbc3-0969-4e18-a7df-cbc048fd084f None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:50.972095 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46fbc3-0969-4e18-a7df-cbc048fd084f None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:50.972583 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46fbc3-0969-4e18-a7df-cbc048fd084f None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:50.975254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 526/1035] 10.222.0.16 () {54 vars in 961 bytes} [Wed Oct 19 02:24:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:24:50.982196 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ab680-b3ec-4148-b480-5732cc9b362a None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:50.982485 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ab680-b3ec-4148-b480-5732cc9b362a None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:50.982760 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ab680-b3ec-4148-b480-5732cc9b362a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:51.003652 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:51.070301 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-018ab680-b3ec-4148-b480-5732cc9b362a None None] MFA Rules not processed for user `58a78f75a63e4d258a4afbeb748e59f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:24:51.071859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-018ab680-b3ec-4148-b480-5732cc9b362a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:51.221092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 510/1036] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 19 02:24:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:24:51.229161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46fbc3-0969-4e18-a7df-cbc048fd084f None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:51.231505 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-7e46fbc3-0969-4e18-a7df-cbc048fd084f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:51.391390 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46fbc3-0969-4e18-a7df-cbc048fd084f None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:51.471653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:51.519151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9faed85-86d6-4bd5-89bf-f0f58dcc9a79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:51.519795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faed85-86d6-4bd5-89bf-f0f58dcc9a79 service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:51.520056 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faed85-86d6-4bd5-89bf-f0f58dcc9a79 service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:51.520334 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faed85-86d6-4bd5-89bf-f0f58dcc9a79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:51.522844 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-c9faed85-86d6-4bd5-89bf-f0f58dcc9a79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:51.625925 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9faed85-86d6-4bd5-89bf-f0f58dcc9a79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:51.627563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9faed85-86d6-4bd5-89bf-f0f58dcc9a79 service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:51.648831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 527/1037] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:24:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:24:54.037490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9118f1-40fb-4e20-81fe-28ce01c79f15 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:54.038062 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9118f1-40fb-4e20-81fe-28ce01c79f15 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:54.038161 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9118f1-40fb-4e20-81fe-28ce01c79f15 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:54.039491 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 511/1038] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:24:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:24:54.045051 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fb8c5-1bcb-48b6-8111-8d68e21d53b7 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:54.045497 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fb8c5-1bcb-48b6-8111-8d68e21d53b7 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:54.045579 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fb8c5-1bcb-48b6-8111-8d68e21d53b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:54.149539 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-044fb8c5-1bcb-48b6-8111-8d68e21d53b7 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:24:54.150885 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-044fb8c5-1bcb-48b6-8111-8d68e21d53b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:54.191778 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:54.266598 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 528/1039] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:24:54.568285 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9118f1-40fb-4e20-81fe-28ce01c79f15 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:54.569780 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-9d9118f1-40fb-4e20-81fe-28ce01c79f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:54.642428 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:54.745741 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9118f1-40fb-4e20-81fe-28ce01c79f15 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:54.894716 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb648b76-9b72-49c1-b3a7-eb9f4ab852f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:54.895362 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb648b76-9b72-49c1-b3a7-eb9f4ab852f8 service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:54.896224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb648b76-9b72-49c1-b3a7-eb9f4ab852f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:54.896531 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb648b76-9b72-49c1-b3a7-eb9f4ab852f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:54.898333 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-cb648b76-9b72-49c1-b3a7-eb9f4ab852f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:54.921933 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:54.992665 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb648b76-9b72-49c1-b3a7-eb9f4ab852f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:54.994389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb648b76-9b72-49c1-b3a7-eb9f4ab852f8 service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:55.012562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 512/1040] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:24:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:24:57.666591 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d6265-3787-495f-b1c6-da12e26bc08b None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:57.667152 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d6265-3787-495f-b1c6-da12e26bc08b None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:57.667152 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d6265-3787-495f-b1c6-da12e26bc08b None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:57.668755 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 529/1041] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:24:57.673876 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2eb15-beb2-4cd2-8454-c2080ed929db None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:57.674292 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2eb15-beb2-4cd2-8454-c2080ed929db None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:57.674475 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2eb15-beb2-4cd2-8454-c2080ed929db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:57.747198 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-fcc2eb15-beb2-4cd2-8454-c2080ed929db None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:24:57.748573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-fcc2eb15-beb2-4cd2-8454-c2080ed929db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:57.852547 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:57.858861 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 513/1042] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:24:58.150926 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a46871-66b9-4a20-a83a-9229a2a38166 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:58.151404 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a46871-66b9-4a20-a83a-9229a2a38166 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:58.151882 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a46871-66b9-4a20-a83a-9229a2a38166 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:58.153472 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 530/1043] 10.222.0.16 () {54 vars in 961 bytes} [Wed Oct 19 02:24:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:24:58.159105 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed769d-0e38-4c67-b461-b21595fac3c2 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:58.159515 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed769d-0e38-4c67-b461-b21595fac3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:58.159845 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed769d-0e38-4c67-b461-b21595fac3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:58.249455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-28ed769d-0e38-4c67-b461-b21595fac3c2 None None] MFA Rules not processed for user `58a78f75a63e4d258a4afbeb748e59f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:24:58.250868 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-28ed769d-0e38-4c67-b461-b21595fac3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:58.377494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 514/1044] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 19 02:24:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:24:58.386453 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a46871-66b9-4a20-a83a-9229a2a38166 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:58.388115 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-36a46871-66b9-4a20-a83a-9229a2a38166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:58.549060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a46871-66b9-4a20-a83a-9229a2a38166 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:58.572466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:58.674738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c34327-858c-449b-a8a8-6e3f7dbb0500 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:58.675474 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c34327-858c-449b-a8a8-6e3f7dbb0500 service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:58.675777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c34327-858c-449b-a8a8-6e3f7dbb0500 service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:58.676057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c34327-858c-449b-a8a8-6e3f7dbb0500 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:58.678613 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-b0c34327-858c-449b-a8a8-6e3f7dbb0500 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:58.780802 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c34327-858c-449b-a8a8-6e3f7dbb0500 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:58.782540 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c34327-858c-449b-a8a8-6e3f7dbb0500 service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:58.783204 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7988d9-4fa6-47c5-9861-31008decaefb None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:58.783646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7988d9-4fa6-47c5-9861-31008decaefb None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:58.783834 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7988d9-4fa6-47c5-9861-31008decaefb None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:58.785336 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 515/1045] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 02:24:58.790476 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbad26-735f-4938-8689-7cf741925983 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:58.791014 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbad26-735f-4938-8689-7cf741925983 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:58.791475 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbad26-735f-4938-8689-7cf741925983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:58.802854 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 531/1046] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:24:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:24:58.857055 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:58.865359 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-9dfbad26-735f-4938-8689-7cf741925983 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:24:58.866602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-9dfbad26-735f-4938-8689-7cf741925983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:58.978869 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 516/1047] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:24:59.321631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b649e-7c09-45ef-a915-92784f6134e6 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:59.321631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b649e-7c09-45ef-a915-92784f6134e6 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:59.321953 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b649e-7c09-45ef-a915-92784f6134e6 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:59.326626 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 532/1048] 10.222.0.16 () {54 vars in 963 bytes} [Wed Oct 19 02:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:24:59.328611 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d666f-bc2f-4c9e-8202-22288f3bf3e8 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:59.328902 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d666f-bc2f-4c9e-8202-22288f3bf3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:59.329178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d666f-bc2f-4c9e-8202-22288f3bf3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:59.416882 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-a98d666f-bc2f-4c9e-8202-22288f3bf3e8 None None] MFA Rules not processed for user `0f1f37f8136349edac3a52793e2fef8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:24:59.418097 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-a98d666f-bc2f-4c9e-8202-22288f3bf3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:59.498308 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:59.504691 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 517/1049] 10.222.0.16 () {58 vars in 1060 bytes} [Wed Oct 19 02:24:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:24:59.512682 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b649e-7c09-45ef-a915-92784f6134e6 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:24:59.514173 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-534b649e-7c09-45ef-a915-92784f6134e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:59.549265 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:59.630584 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b649e-7c09-45ef-a915-92784f6134e6 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:24:59.717142 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7be492-b40e-4e96-be07-76fa9ba32e74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:24:59.718433 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be492-b40e-4e96-be07-76fa9ba32e74 service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:24:59.718890 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be492-b40e-4e96-be07-76fa9ba32e74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:24:59.719334 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be492-b40e-4e96-be07-76fa9ba32e74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:24:59.721039 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-6c7be492-b40e-4e96-be07-76fa9ba32e74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:24:59.808455 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:59.846599 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7be492-b40e-4e96-be07-76fa9ba32e74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:24:59.847517 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7be492-b40e-4e96-be07-76fa9ba32e74 service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:24:59.881887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 533/1050] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:24:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:25:01.318138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82248376-7ee1-4266-abfb-4f077f516c8f None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:01.318699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82248376-7ee1-4266-abfb-4f077f516c8f None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:01.318699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82248376-7ee1-4266-abfb-4f077f516c8f None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:01.320222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 518/1051] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:25:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:25:01.325771 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c44b4a-7aa6-4bf0-a9db-e5e8b6af853f None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:01.326235 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c44b4a-7aa6-4bf0-a9db-e5e8b6af853f None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:01.326343 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c44b4a-7aa6-4bf0-a9db-e5e8b6af853f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:01.396500 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-81c44b4a-7aa6-4bf0-a9db-e5e8b6af853f None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:01.397742 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-81c44b4a-7aa6-4bf0-a9db-e5e8b6af853f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:01.506154 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 534/1052] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:25:01.803018 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82248376-7ee1-4266-abfb-4f077f516c8f None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:01.804549 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-82248376-7ee1-4266-abfb-4f077f516c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:01.988978 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82248376-7ee1-4266-abfb-4f077f516c8f None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:02.079132 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:02.131127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4664318-f1cb-4f2c-b710-562a52ec5d5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:02.131742 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4664318-f1cb-4f2c-b710-562a52ec5d5c service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:02.132018 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4664318-f1cb-4f2c-b710-562a52ec5d5c service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:02.132287 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4664318-f1cb-4f2c-b710-562a52ec5d5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:02.133892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-e4664318-f1cb-4f2c-b710-562a52ec5d5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:02.246876 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4664318-f1cb-4f2c-b710-562a52ec5d5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:02.249212 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4664318-f1cb-4f2c-b710-562a52ec5d5c service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:02.270086 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 519/1053] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:25:04.653068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45323940-fc82-4a9c-bfce-71652bf7188f None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:04.653681 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45323940-fc82-4a9c-bfce-71652bf7188f None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:04.653681 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45323940-fc82-4a9c-bfce-71652bf7188f None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:04.655183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 535/1054] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:25:04.660328 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7b73a-d6c2-42d3-ac62-293ec91eb6f2 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:04.660815 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7b73a-d6c2-42d3-ac62-293ec91eb6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:04.661710 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7b73a-d6c2-42d3-ac62-293ec91eb6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:04.732464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-7bc7b73a-d6c2-42d3-ac62-293ec91eb6f2 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:04.733727 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-7bc7b73a-d6c2-42d3-ac62-293ec91eb6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:04.765390 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:04.837190 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 520/1055] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:25:05.126900 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45323940-fc82-4a9c-bfce-71652bf7188f None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:05.128433 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-45323940-fc82-4a9c-bfce-71652bf7188f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:05.169426 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:05.300083 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45323940-fc82-4a9c-bfce-71652bf7188f None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:05.421029 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:05.427286 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb05781-12c7-44c7-b6d8-2435e0275dd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:05.427998 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb05781-12c7-44c7-b6d8-2435e0275dd0 service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:05.428240 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb05781-12c7-44c7-b6d8-2435e0275dd0 service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:05.428519 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb05781-12c7-44c7-b6d8-2435e0275dd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:05.430141 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-ccb05781-12c7-44c7-b6d8-2435e0275dd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:05.531704 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb05781-12c7-44c7-b6d8-2435e0275dd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:05.533543 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb05781-12c7-44c7-b6d8-2435e0275dd0 service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:05.555103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 536/1056] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:25:07.945977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caacd7-d4ac-45e2-a884-2e31d692c699 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:07.946611 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caacd7-d4ac-45e2-a884-2e31d692c699 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:07.946760 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caacd7-d4ac-45e2-a884-2e31d692c699 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:07.948599 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 521/1057] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:25:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:25:07.954121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caf45f-f2a0-4c00-a05d-41c3f62a1716 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:07.954554 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caf45f-f2a0-4c00-a05d-41c3f62a1716 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:07.954742 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caf45f-f2a0-4c00-a05d-41c3f62a1716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:08.022917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-69caf45f-f2a0-4c00-a05d-41c3f62a1716 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:08.024049 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-69caf45f-f2a0-4c00-a05d-41c3f62a1716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:08.089884 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:08.122037 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 537/1058] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:25:08.415410 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52caacd7-d4ac-45e2-a884-2e31d692c699 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:08.416927 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-52caacd7-d4ac-45e2-a884-2e31d692c699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:08.567838 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52caacd7-d4ac-45e2-a884-2e31d692c699 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:08.581393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:08.689680 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53489c48-7209-4cd2-8d36-637cc927ffd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:08.690485 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53489c48-7209-4cd2-8d36-637cc927ffd5 service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:08.690759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53489c48-7209-4cd2-8d36-637cc927ffd5 service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:08.691047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53489c48-7209-4cd2-8d36-637cc927ffd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:08.693762 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-53489c48-7209-4cd2-8d36-637cc927ffd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:08.784529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53489c48-7209-4cd2-8d36-637cc927ffd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:08.787139 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53489c48-7209-4cd2-8d36-637cc927ffd5 service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:08.805923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 522/1059] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:25:11.099577 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdafb1-3c4c-4fd2-8581-c2488dd967d5 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:11.100302 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdafb1-3c4c-4fd2-8581-c2488dd967d5 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:11.100302 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdafb1-3c4c-4fd2-8581-c2488dd967d5 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:11.101698 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 538/1060] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:25:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:25:11.106890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6be9d-edf4-46a9-a42a-932a08bbfe9a None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:11.107405 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6be9d-edf4-46a9-a42a-932a08bbfe9a None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:11.107405 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6be9d-edf4-46a9-a42a-932a08bbfe9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:11.130419 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:11.183132 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-5ca6be9d-edf4-46a9-a42a-932a08bbfe9a None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:11.184804 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-5ca6be9d-edf4-46a9-a42a-932a08bbfe9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:11.325109 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 523/1061] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:25:11.612797 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdafb1-3c4c-4fd2-8581-c2488dd967d5 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:11.615535 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-84cdafb1-3c4c-4fd2-8581-c2488dd967d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:11.801265 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdafb1-3c4c-4fd2-8581-c2488dd967d5 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:11.859248 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:11.920981 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9092f0-0e9d-4664-9f9f-d67673834c80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:11.921594 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9092f0-0e9d-4664-9f9f-d67673834c80 service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:11.921874 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9092f0-0e9d-4664-9f9f-d67673834c80 service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:11.922145 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9092f0-0e9d-4664-9f9f-d67673834c80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:11.923801 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-4d9092f0-0e9d-4664-9f9f-d67673834c80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:12.017942 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9092f0-0e9d-4664-9f9f-d67673834c80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:12.019578 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9092f0-0e9d-4664-9f9f-d67673834c80 service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:12.039556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 539/1062] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:25:14.501574 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc81ad8-0ab4-441f-b639-a4681a5dd354 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:14.502101 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc81ad8-0ab4-441f-b639-a4681a5dd354 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:14.502101 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc81ad8-0ab4-441f-b639-a4681a5dd354 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:14.503482 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 524/1063] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:25:14.509487 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23382cd-8645-4fdc-9dbe-4ccc435f736c None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:14.509939 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23382cd-8645-4fdc-9dbe-4ccc435f736c None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:14.510083 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23382cd-8645-4fdc-9dbe-4ccc435f736c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:14.579426 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-e23382cd-8645-4fdc-9dbe-4ccc435f736c None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:14.580638 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-e23382cd-8645-4fdc-9dbe-4ccc435f736c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:14.589246 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:14.680729 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 540/1064] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:25:14.989675 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc81ad8-0ab4-441f-b639-a4681a5dd354 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:14.991323 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-6cc81ad8-0ab4-441f-b639-a4681a5dd354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:15.086889 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:15.149911 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc81ad8-0ab4-441f-b639-a4681a5dd354 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:15.275320 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b60cb0-9c46-440c-b98a-083442469bea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:15.275871 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b60cb0-9c46-440c-b98a-083442469bea service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:15.276149 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b60cb0-9c46-440c-b98a-083442469bea service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:15.276416 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b60cb0-9c46-440c-b98a-083442469bea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:15.278004 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-a5b60cb0-9c46-440c-b98a-083442469bea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:15.340640 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:15.371301 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b60cb0-9c46-440c-b98a-083442469bea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:15.372943 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b60cb0-9c46-440c-b98a-083442469bea service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:15.393687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 525/1065] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:25:15.499271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1858d2-7d3e-460b-a020-e102947bc2df None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:15.499561 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1858d2-7d3e-460b-a020-e102947bc2df None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:15.499831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1858d2-7d3e-460b-a020-e102947bc2df None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:15.501582 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 541/1066] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:25:15.507676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3914f-cdd9-4811-b3bd-8fab39bb2d4a None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:15.508404 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3914f-cdd9-4811-b3bd-8fab39bb2d4a None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:15.508404 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3914f-cdd9-4811-b3bd-8fab39bb2d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:15.578138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-62a3914f-cdd9-4811-b3bd-8fab39bb2d4a None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:15.579428 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-62a3914f-cdd9-4811-b3bd-8fab39bb2d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:15.699166 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 526/1067] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:25:16.006828 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbe9bc-7ca1-4558-b7a6-ad30b956a4c5 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:16.007322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbe9bc-7ca1-4558-b7a6-ad30b956a4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:16.007427 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbe9bc-7ca1-4558-b7a6-ad30b956a4c5 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:16.008700 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 542/1068] 10.222.0.16 () {54 vars in 962 bytes} [Wed Oct 19 02:25:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:25:16.014044 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc159330-082d-4236-85e9-e4d95b6b642c None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:16.014398 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc159330-082d-4236-85e9-e4d95b6b642c None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:16.014740 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc159330-082d-4236-85e9-e4d95b6b642c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:16.060541 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:16.091869 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-cc159330-082d-4236-85e9-e4d95b6b642c None None] MFA Rules not processed for user `d9e8a7a5b8944272a2d1bd2140819ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:16.093068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-cc159330-082d-4236-85e9-e4d95b6b642c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:16.170985 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 527/1069] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Oct 19 02:25:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:25:16.181193 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbe9bc-7ca1-4558-b7a6-ad30b956a4c5 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:16.182686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-79fbe9bc-7ca1-4558-b7a6-ad30b956a4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:16.292806 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbe9bc-7ca1-4558-b7a6-ad30b956a4c5 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:16.331426 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:16.369487 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce57ddf-e6db-454a-a78b-42763dbf311d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9e8a7a5b8944272a2d1bd2140819ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:16.370095 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce57ddf-e6db-454a-a78b-42763dbf311d service glance] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:16.370373 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce57ddf-e6db-454a-a78b-42763dbf311d service glance] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:16.370651 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce57ddf-e6db-454a-a78b-42763dbf311d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:16.372277 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-8ce57ddf-e6db-454a-a78b-42763dbf311d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:16.490265 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce57ddf-e6db-454a-a78b-42763dbf311d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:16.491753 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce57ddf-e6db-454a-a78b-42763dbf311d service glance] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:16.511021 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 543/1070] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:25:17.449529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94935198-9fe9-4926-b7d8-9d51692a55a8 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:17.450012 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94935198-9fe9-4926-b7d8-9d51692a55a8 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:17.450276 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94935198-9fe9-4926-b7d8-9d51692a55a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:17.521453 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-94935198-9fe9-4926-b7d8-9d51692a55a8 None None] MFA Rules not processed for user `e58cdf090af44b508767e821be2f379f`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:17.522600 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-94935198-9fe9-4926-b7d8-9d51692a55a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:17.604114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:17.611793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 528/1071] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 02:25:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:25:17.654747 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ad8f0-6f69-4098-b283-e670d982cdfb None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:17.655362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ad8f0-6f69-4098-b283-e670d982cdfb None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:17.655512 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ad8f0-6f69-4098-b283-e670d982cdfb None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:17.656980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 544/1072] 10.222.0.16 () {54 vars in 943 bytes} [Wed Oct 19 02:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:25:17.665379 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae7653-9f20-4778-beb0-fcf4da6da3f4 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:17.665690 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae7653-9f20-4778-beb0-fcf4da6da3f4 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:17.665958 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae7653-9f20-4778-beb0-fcf4da6da3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:17.743875 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-3aae7653-9f20-4778-beb0-fcf4da6da3f4 None None] MFA Rules not processed for user `f906e9835f5c4e709915c6553b41aeff`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:17.745065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-3aae7653-9f20-4778-beb0-fcf4da6da3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:17.781415 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa13737-1d68-4cb4-b3e7-3e3739669e13 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:17.781606 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa13737-1d68-4cb4-b3e7-3e3739669e13 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:17.781875 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa13737-1d68-4cb4-b3e7-3e3739669e13 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:17.783245 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 545/1073] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:25:17.789411 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154b655-b32e-4db0-8830-f9110f07b9be None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:17.789689 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154b655-b32e-4db0-8830-f9110f07b9be None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:17.789960 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154b655-b32e-4db0-8830-f9110f07b9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:17.858882 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-c154b655-b32e-4db0-8830-f9110f07b9be None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:17.860110 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-c154b655-b32e-4db0-8830-f9110f07b9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:17.862612 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 529/1074] 10.222.0.16 () {58 vars in 1040 bytes} [Wed Oct 19 02:25:17 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:25:17.872562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae7653-9f20-4778-beb0-fcf4da6da3f4 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:17.878840 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:17.883268 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae7653-9f20-4778-beb0-fcf4da6da3f4 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:17.932255 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:17.964214 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 546/1075] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:25:17.995462 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b602b43-ad06-4dc5-a69e-1e10ee2a6f10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906e9835f5c4e709915c6553b41aeff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:17.996130 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b602b43-ad06-4dc5-a69e-1e10ee2a6f10 service swift] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:17.996429 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b602b43-ad06-4dc5-a69e-1e10ee2a6f10 service swift] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:17.996724 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b602b43-ad06-4dc5-a69e-1e10ee2a6f10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:17.999426 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-8b602b43-ad06-4dc5-a69e-1e10ee2a6f10 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:18.089684 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b602b43-ad06-4dc5-a69e-1e10ee2a6f10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:18.091326 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b602b43-ad06-4dc5-a69e-1e10ee2a6f10 service swift] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:18.099592 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 530/1076] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 02:25:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 02:25:18.258722 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154b655-b32e-4db0-8830-f9110f07b9be None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:18.259981 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-c154b655-b32e-4db0-8830-f9110f07b9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:18.373293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154b655-b32e-4db0-8830-f9110f07b9be None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:18.412613 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:18.492259 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d93f34-147d-4124-b1ed-1b7e8b8519ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:18.492892 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d93f34-147d-4124-b1ed-1b7e8b8519ff service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:18.493173 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d93f34-147d-4124-b1ed-1b7e8b8519ff service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:18.493456 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d93f34-147d-4124-b1ed-1b7e8b8519ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:18.495148 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-22d93f34-147d-4124-b1ed-1b7e8b8519ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:18.593352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d93f34-147d-4124-b1ed-1b7e8b8519ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:18.595342 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d93f34-147d-4124-b1ed-1b7e8b8519ff service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:18.615981 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 547/1077] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:25:21.027155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca21ff-df55-4cac-8dd8-098b783dbc7a None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:21.027663 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca21ff-df55-4cac-8dd8-098b783dbc7a None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:21.027663 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca21ff-df55-4cac-8dd8-098b783dbc7a None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:21.028942 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 531/1078] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:25:21.034406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9484f-3c39-46ff-a135-aff4d225f48e None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:21.034877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9484f-3c39-46ff-a135-aff4d225f48e None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:21.035056 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9484f-3c39-46ff-a135-aff4d225f48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:21.089919 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:21.110488 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-9bd9484f-3c39-46ff-a135-aff4d225f48e None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:21.111813 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-9bd9484f-3c39-46ff-a135-aff4d225f48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:21.226869 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 548/1079] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:25:21.526711 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca21ff-df55-4cac-8dd8-098b783dbc7a None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:21.528419 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-78ca21ff-df55-4cac-8dd8-098b783dbc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:21.621343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:21.696694 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca21ff-df55-4cac-8dd8-098b783dbc7a None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:21.822579 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b16d4-6bde-493b-b85f-cc273af4fbe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:21.823135 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b16d4-6bde-493b-b85f-cc273af4fbe3 service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:21.823411 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b16d4-6bde-493b-b85f-cc273af4fbe3 service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:21.823678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b16d4-6bde-493b-b85f-cc273af4fbe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:21.825261 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-751b16d4-6bde-493b-b85f-cc273af4fbe3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:21.876270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:21.929436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b16d4-6bde-493b-b85f-cc273af4fbe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:21.931460 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b16d4-6bde-493b-b85f-cc273af4fbe3 service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:21.952810 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 532/1080] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:25:24.248159 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ad003-1a29-488e-99ed-99c9abc6e0b6 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:24.248159 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ad003-1a29-488e-99ed-99c9abc6e0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:24.248159 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ad003-1a29-488e-99ed-99c9abc6e0b6 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:24.249021 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 549/1081] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:25:24.256483 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164a6ea-8b3f-4258-a0a9-e0a48bae0a09 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:24.256941 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164a6ea-8b3f-4258-a0a9-e0a48bae0a09 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:24.257044 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164a6ea-8b3f-4258-a0a9-e0a48bae0a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:24.331754 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-a164a6ea-8b3f-4258-a0a9-e0a48bae0a09 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:24.333125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-a164a6ea-8b3f-4258-a0a9-e0a48bae0a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:24.441254 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 533/1082] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:25:24.737676 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ad003-1a29-488e-99ed-99c9abc6e0b6 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:24.740119 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-479ad003-1a29-488e-99ed-99c9abc6e0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:24.865849 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:24.902035 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ad003-1a29-488e-99ed-99c9abc6e0b6 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:25.029504 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44495c60-ac06-4da0-886f-2724361c0815 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:25.030028 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44495c60-ac06-4da0-886f-2724361c0815 service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:25.030292 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44495c60-ac06-4da0-886f-2724361c0815 service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:25.030589 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44495c60-ac06-4da0-886f-2724361c0815 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:25.032199 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-44495c60-ac06-4da0-886f-2724361c0815 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:25.124902 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:25.138640 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44495c60-ac06-4da0-886f-2724361c0815 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:25.145454 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44495c60-ac06-4da0-886f-2724361c0815 service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:25.166970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 550/1083] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:25:27.586891 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95295a46-eb63-4ff7-af10-b7361dca9e7f None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:27.587459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95295a46-eb63-4ff7-af10-b7361dca9e7f None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:27.587459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95295a46-eb63-4ff7-af10-b7361dca9e7f None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:27.588960 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 534/1084] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:25:27.594255 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25075271-30e9-4355-9c13-9fe82742e2b7 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:27.594676 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25075271-30e9-4355-9c13-9fe82742e2b7 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:27.594905 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25075271-30e9-4355-9c13-9fe82742e2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:27.668523 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-25075271-30e9-4355-9c13-9fe82742e2b7 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:27.669752 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-25075271-30e9-4355-9c13-9fe82742e2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:27.787917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 551/1085] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:25:28.082364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95295a46-eb63-4ff7-af10-b7361dca9e7f None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:28.083969 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-95295a46-eb63-4ff7-af10-b7361dca9e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:28.106725 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:28.259291 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95295a46-eb63-4ff7-af10-b7361dca9e7f None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:28.363100 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:28.387110 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87746bf7-acca-4d29-ab5a-95bc9cd49d2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:28.387882 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87746bf7-acca-4d29-ab5a-95bc9cd49d2d service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:28.388224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87746bf7-acca-4d29-ab5a-95bc9cd49d2d service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:28.388570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87746bf7-acca-4d29-ab5a-95bc9cd49d2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:28.390236 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-87746bf7-acca-4d29-ab5a-95bc9cd49d2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:28.493420 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87746bf7-acca-4d29-ab5a-95bc9cd49d2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:28.495290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87746bf7-acca-4d29-ab5a-95bc9cd49d2d service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:28.515397 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 535/1086] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:25:37.786594 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=74 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:38.512814 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=54 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:42.616532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57d595-bddd-40f3-b39f-8e2142e28ab1 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:42.617109 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57d595-bddd-40f3-b39f-8e2142e28ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:42.617109 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57d595-bddd-40f3-b39f-8e2142e28ab1 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:42.618430 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 552/1087] 10.222.0.16 () {54 vars in 918 bytes} [Wed Oct 19 02:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:25:42.623431 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b2ac8-f968-40a4-a76f-021f04643f0c None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:42.623899 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b2ac8-f968-40a4-a76f-021f04643f0c None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:42.624005 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b2ac8-f968-40a4-a76f-021f04643f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:42.702111 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-c42b2ac8-f968-40a4-a76f-021f04643f0c None None] MFA Rules not processed for user `a66b9bc695b44877a06f17ea6bbeb27a`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:42.703275 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c42b2ac8-f968-40a4-a76f-021f04643f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:42.810684 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 536/1088] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Oct 19 02:25:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:25:42.825238 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecb018-b74f-45f9-866f-080888b19d27 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:42.825518 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecb018-b74f-45f9-866f-080888b19d27 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:42.825785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecb018-b74f-45f9-866f-080888b19d27 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:42.827166 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 553/1089] 10.222.0.16 () {54 vars in 918 bytes} [Wed Oct 19 02:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:25:42.831703 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5ff49-78f9-4052-b554-ff717d46c902 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:42.832006 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5ff49-78f9-4052-b554-ff717d46c902 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:42.832275 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5ff49-78f9-4052-b554-ff717d46c902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:42.904422 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:42.906928 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-69f5ff49-78f9-4052-b554-ff717d46c902 None None] MFA Rules not processed for user `58a78f75a63e4d258a4afbeb748e59f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:42.908120 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-69f5ff49-78f9-4052-b554-ff717d46c902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:43.023065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 537/1090] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Oct 19 02:25:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:25:45.617179 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1618a8f-fac5-4773-95f8-3390130c89be None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:45.617731 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1618a8f-fac5-4773-95f8-3390130c89be None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:45.617840 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1618a8f-fac5-4773-95f8-3390130c89be None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:45.619219 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 554/1091] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 02:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:25:45.624573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac360ff-bfa6-4d06-a4fc-d33141bd89c0 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:45.625017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac360ff-bfa6-4d06-a4fc-d33141bd89c0 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:45.625124 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac360ff-bfa6-4d06-a4fc-d33141bd89c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:45.692566 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-7ac360ff-bfa6-4d06-a4fc-d33141bd89c0 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:45.693805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-7ac360ff-bfa6-4d06-a4fc-d33141bd89c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:45.750651 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:45.792714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 538/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 02:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:25:46.084004 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1618a8f-fac5-4773-95f8-3390130c89be None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:46.085530 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-d1618a8f-fac5-4773-95f8-3390130c89be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:46.234787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1618a8f-fac5-4773-95f8-3390130c89be None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:46.307396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:46.348266 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb84c2d-6542-4ba9-b34a-c559337968db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:46.348810 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb84c2d-6542-4ba9-b34a-c559337968db service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:46.349080 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb84c2d-6542-4ba9-b34a-c559337968db service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:46.349348 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb84c2d-6542-4ba9-b34a-c559337968db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:46.350966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-adb84c2d-6542-4ba9-b34a-c559337968db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:46.440495 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb84c2d-6542-4ba9-b34a-c559337968db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:46.442625 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb84c2d-6542-4ba9-b34a-c559337968db service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:46.461900 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 555/1093] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:25:47.603543 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ed053-f61c-4552-90ee-0eb45c7e2720 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:47.604101 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ed053-f61c-4552-90ee-0eb45c7e2720 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:47.604101 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ed053-f61c-4552-90ee-0eb45c7e2720 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:47.605446 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 539/1094] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 02:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:25:47.611701 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ac007-8486-4653-9e3e-29f726726898 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:47.612147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ac007-8486-4653-9e3e-29f726726898 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:47.612263 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ac007-8486-4653-9e3e-29f726726898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:47.687847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-d34ac007-8486-4653-9e3e-29f726726898 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:47.689047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-d34ac007-8486-4653-9e3e-29f726726898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:47.716093 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:47.787376 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 556/1095] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 02:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:25:47.943553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ed053-f61c-4552-90ee-0eb45c7e2720 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:47.945003 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-981ed053-f61c-4552-90ee-0eb45c7e2720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:48.093423 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ed053-f61c-4552-90ee-0eb45c7e2720 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:48.135546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:48.209694 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4f569-04a1-4945-a498-e06ee0f46e05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:48.210220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4f569-04a1-4945-a498-e06ee0f46e05 service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:48.210489 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4f569-04a1-4945-a498-e06ee0f46e05 service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:48.210757 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4f569-04a1-4945-a498-e06ee0f46e05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:48.212379 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-cfc4f569-04a1-4945-a498-e06ee0f46e05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:48.300582 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4f569-04a1-4945-a498-e06ee0f46e05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:48.302732 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4f569-04a1-4945-a498-e06ee0f46e05 service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:48.321108 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 540/1096] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:25:49.453146 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6313de5-d9eb-42d7-8c35-7cc98d6fb73f None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:49.454073 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6313de5-d9eb-42d7-8c35-7cc98d6fb73f None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:49.454073 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6313de5-d9eb-42d7-8c35-7cc98d6fb73f None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:49.455628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 557/1097] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 02:25:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:25:49.462467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccedfd-cedd-4af0-aafd-c9ba2befad28 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:49.462950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccedfd-cedd-4af0-aafd-c9ba2befad28 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:49.463092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccedfd-cedd-4af0-aafd-c9ba2befad28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:49.517168 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:49.538947 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-45ccedfd-cedd-4af0-aafd-c9ba2befad28 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:49.540171 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-45ccedfd-cedd-4af0-aafd-c9ba2befad28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:49.637576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 541/1098] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 02:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:25:49.790155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6313de5-d9eb-42d7-8c35-7cc98d6fb73f None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:49.791659 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-c6313de5-d9eb-42d7-8c35-7cc98d6fb73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:49.939884 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6313de5-d9eb-42d7-8c35-7cc98d6fb73f None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:49.951724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:50.050440 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31bd08-5fde-47bf-8b75-74ab999dcb5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:50.051583 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31bd08-5fde-47bf-8b75-74ab999dcb5c service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:50.052055 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31bd08-5fde-47bf-8b75-74ab999dcb5c service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:50.052179 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31bd08-5fde-47bf-8b75-74ab999dcb5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:50.053706 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-ff31bd08-5fde-47bf-8b75-74ab999dcb5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:50.141442 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31bd08-5fde-47bf-8b75-74ab999dcb5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:50.143069 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31bd08-5fde-47bf-8b75-74ab999dcb5c service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:50.161466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 558/1099] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:25:51.276088 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15961ecb-0d2e-4d75-bff3-763dd75b3d4f None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:51.276636 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15961ecb-0d2e-4d75-bff3-763dd75b3d4f None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:51.276636 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15961ecb-0d2e-4d75-bff3-763dd75b3d4f None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:51.278041 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 542/1100] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 02:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 02:25:51.284313 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950fede-d584-44b4-9fa4-75c71ae86384 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:51.284823 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950fede-d584-44b4-9fa4-75c71ae86384 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:51.284823 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950fede-d584-44b4-9fa4-75c71ae86384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:51.305535 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:51.362575 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-b950fede-d584-44b4-9fa4-75c71ae86384 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:51.363877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-b950fede-d584-44b4-9fa4-75c71ae86384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:51.460968 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 559/1101] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 02:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:25:51.614005 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15961ecb-0d2e-4d75-bff3-763dd75b3d4f None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:51.615110 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-15961ecb-0d2e-4d75-bff3-763dd75b3d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:51.725972 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:51.762424 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15961ecb-0d2e-4d75-bff3-763dd75b3d4f None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:51.875481 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0898c71-9d7e-487e-8821-0346e52a2145 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:51.876009 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0898c71-9d7e-487e-8821-0346e52a2145 service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:51.876283 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0898c71-9d7e-487e-8821-0346e52a2145 service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:51.876551 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0898c71-9d7e-487e-8821-0346e52a2145 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:51.878139 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-f0898c71-9d7e-487e-8821-0346e52a2145 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:51.955721 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:51.968635 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0898c71-9d7e-487e-8821-0346e52a2145 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:51.970287 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0898c71-9d7e-487e-8821-0346e52a2145 service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:51.989085 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 543/1102] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:25:53.094345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd62975-a804-44e8-9d1e-4c64399541df None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:53.094345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd62975-a804-44e8-9d1e-4c64399541df None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:53.094811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd62975-a804-44e8-9d1e-4c64399541df None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:53.095933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 560/1103] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 02:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:25:53.103062 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946466b-9ed3-40e6-939e-9b6175fac827 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:53.103512 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946466b-9ed3-40e6-939e-9b6175fac827 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:53.103702 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946466b-9ed3-40e6-939e-9b6175fac827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:53.181875 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-b946466b-9ed3-40e6-939e-9b6175fac827 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:53.183104 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-b946466b-9ed3-40e6-939e-9b6175fac827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:53.280956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 544/1104] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 02:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:25:53.431709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd62975-a804-44e8-9d1e-4c64399541df None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:53.433244 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-ddd62975-a804-44e8-9d1e-4c64399541df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:53.517690 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:53.579100 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd62975-a804-44e8-9d1e-4c64399541df None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:53.692615 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e338a4-1f8e-4b5a-a895-24c193237267 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:53.693202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e338a4-1f8e-4b5a-a895-24c193237267 service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:53.693480 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e338a4-1f8e-4b5a-a895-24c193237267 service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:53.693755 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e338a4-1f8e-4b5a-a895-24c193237267 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:53.695363 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-d9e338a4-1f8e-4b5a-a895-24c193237267 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:53.743273 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:53.784620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e338a4-1f8e-4b5a-a895-24c193237267 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:53.786386 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e338a4-1f8e-4b5a-a895-24c193237267 service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:53.804310 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 561/1105] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:25:54.922778 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fed962-32e9-45fe-b757-20ab67540468 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:54.923377 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fed962-32e9-45fe-b757-20ab67540468 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:54.923377 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fed962-32e9-45fe-b757-20ab67540468 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:54.924719 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 545/1106] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 02:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:25:54.931959 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362034ff-34e1-4c4a-a143-7b71fa7902ce None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:54.932418 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362034ff-34e1-4c4a-a143-7b71fa7902ce None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:54.952963 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362034ff-34e1-4c4a-a143-7b71fa7902ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:55.010671 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-362034ff-34e1-4c4a-a143-7b71fa7902ce None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:55.011909 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-362034ff-34e1-4c4a-a143-7b71fa7902ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:55.108532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 562/1107] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 02:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:25:55.263457 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fed962-32e9-45fe-b757-20ab67540468 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:55.265136 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-b1fed962-32e9-45fe-b757-20ab67540468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:55.315220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:55.409844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fed962-32e9-45fe-b757-20ab67540468 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:55.523727 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd9ab2-e7cb-472c-92c2-f9c70b10c242 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:55.524233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd9ab2-e7cb-472c-92c2-f9c70b10c242 service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:55.524519 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd9ab2-e7cb-472c-92c2-f9c70b10c242 service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:55.524773 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd9ab2-e7cb-472c-92c2-f9c70b10c242 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:55.526343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c3fd9ab2-e7cb-472c-92c2-f9c70b10c242 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:55.533124 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:55.617224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd9ab2-e7cb-472c-92c2-f9c70b10c242 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:55.618809 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd9ab2-e7cb-472c-92c2-f9c70b10c242 service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:55.636685 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 546/1108] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:25:56.753669 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e8bd0-c7ea-4987-9b75-a9f9f472cbdb None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:56.754849 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e8bd0-c7ea-4987-9b75-a9f9f472cbdb None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:56.754960 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e8bd0-c7ea-4987-9b75-a9f9f472cbdb None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:56.756325 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 563/1109] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 02:25:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:25:56.762576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3314d5-667e-467b-837b-111151d4c075 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:56.763037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3314d5-667e-467b-837b-111151d4c075 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:56.763157 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3314d5-667e-467b-837b-111151d4c075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:56.840735 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-9d3314d5-667e-467b-837b-111151d4c075 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:56.841948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-9d3314d5-667e-467b-837b-111151d4c075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:56.909243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:56.937658 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 547/1110] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 02:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:25:57.088494 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e8bd0-c7ea-4987-9b75-a9f9f472cbdb None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:57.089956 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-df0e8bd0-c7ea-4987-9b75-a9f9f472cbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:57.108242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:57.239187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e8bd0-c7ea-4987-9b75-a9f9f472cbdb None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:57.327081 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:57.352738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8e03d-db84-41e4-af44-f3b723fe5deb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:57.353341 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8e03d-db84-41e4-af44-f3b723fe5deb service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:57.353613 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8e03d-db84-41e4-af44-f3b723fe5deb service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:57.353879 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8e03d-db84-41e4-af44-f3b723fe5deb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:57.355488 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-e8f8e03d-db84-41e4-af44-f3b723fe5deb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:57.445281 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8e03d-db84-41e4-af44-f3b723fe5deb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:57.446891 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8e03d-db84-41e4-af44-f3b723fe5deb service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:57.464569 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 564/1111] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:25:58.568439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2305f3-9f0d-4198-bea8-948610fd3d02 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:58.568997 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2305f3-9f0d-4198-bea8-948610fd3d02 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:58.568997 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2305f3-9f0d-4198-bea8-948610fd3d02 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:58.570238 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 548/1112] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 02:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:25:58.576556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a632e0a-db30-4f7b-81b6-7950754663c6 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:58.577044 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a632e0a-db30-4f7b-81b6-7950754663c6 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:58.577151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a632e0a-db30-4f7b-81b6-7950754663c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:58.652731 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-3a632e0a-db30-4f7b-81b6-7950754663c6 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:25:58.653925 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-3a632e0a-db30-4f7b-81b6-7950754663c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:58.695532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:58.749449 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 565/1113] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 02:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:25:58.903447 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2305f3-9f0d-4198-bea8-948610fd3d02 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:25:58.904938 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ef2305f3-9f0d-4198-bea8-948610fd3d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:59.048976 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2305f3-9f0d-4198-bea8-948610fd3d02 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:25:59.102617 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:59.161287 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ea1e9-98ec-4967-9986-9fa45b446033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:25:59.161815 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ea1e9-98ec-4967-9986-9fa45b446033 service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:25:59.162093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ea1e9-98ec-4967-9986-9fa45b446033 service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:25:59.162363 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ea1e9-98ec-4967-9986-9fa45b446033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:25:59.163999 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-0a0ea1e9-98ec-4967-9986-9fa45b446033 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:25:59.254436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ea1e9-98ec-4967-9986-9fa45b446033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:25:59.256071 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ea1e9-98ec-4967-9986-9fa45b446033 service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:25:59.274312 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 549/1114] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:25:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:26:00.368933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c9fc2-4f43-49a0-95ba-70230e37a676 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:00.369504 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c9fc2-4f43-49a0-95ba-70230e37a676 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:00.369504 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c9fc2-4f43-49a0-95ba-70230e37a676 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:00.370833 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 566/1115] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 02:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:26:00.376903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d033c8-3270-4b49-b2b6-5d7d6d243db3 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:00.377356 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d033c8-3270-4b49-b2b6-5d7d6d243db3 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:00.377461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d033c8-3270-4b49-b2b6-5d7d6d243db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:00.455340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-94d033c8-3270-4b49-b2b6-5d7d6d243db3 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:26:00.456577 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-94d033c8-3270-4b49-b2b6-5d7d6d243db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:00.459097 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:00.555741 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 550/1116] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 02:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:26:00.705309 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c9fc2-4f43-49a0-95ba-70230e37a676 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:26:00.706886 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-a19c9fc2-4f43-49a0-95ba-70230e37a676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:00.855023 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c9fc2-4f43-49a0-95ba-70230e37a676 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:26:00.881619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:00.967478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c82f8-1ae2-4433-9320-43cbad7a5034 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:26:00.968078 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c82f8-1ae2-4433-9320-43cbad7a5034 service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:00.968352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c82f8-1ae2-4433-9320-43cbad7a5034 service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:00.968618 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c82f8-1ae2-4433-9320-43cbad7a5034 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:00.970199 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-625c82f8-1ae2-4433-9320-43cbad7a5034 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:01.058939 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c82f8-1ae2-4433-9320-43cbad7a5034 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:26:01.060509 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c82f8-1ae2-4433-9320-43cbad7a5034 service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:26:01.080380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 567/1117] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:26:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:26:03.150350 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4089414-0505-4149-993f-37837f179951 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:03.150977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4089414-0505-4149-993f-37837f179951 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:03.150977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4089414-0505-4149-993f-37837f179951 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:03.152250 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 551/1118] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 02:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:26:03.157732 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe58bd-2162-45d8-b357-6f49a0750651 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:03.158197 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe58bd-2162-45d8-b357-6f49a0750651 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:03.158311 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe58bd-2162-45d8-b357-6f49a0750651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:03.200069 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:03.226299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-1abe58bd-2162-45d8-b357-6f49a0750651 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:26:03.227599 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-1abe58bd-2162-45d8-b357-6f49a0750651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:03.325751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 568/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 02:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:26:03.609667 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4089414-0505-4149-993f-37837f179951 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:26:03.611235 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-f4089414-0505-4149-993f-37837f179951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:03.713924 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4089414-0505-4149-993f-37837f179951 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:26:03.746000 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:03.788089 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a5422-4a2a-452c-a432-fd27e1ab6ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:26:03.788690 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a5422-4a2a-452c-a432-fd27e1ab6ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:03.788968 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a5422-4a2a-452c-a432-fd27e1ab6ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:03.789240 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a5422-4a2a-452c-a432-fd27e1ab6ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:03.790851 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-b11a5422-4a2a-452c-a432-fd27e1ab6ee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:03.899988 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a5422-4a2a-452c-a432-fd27e1ab6ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:26:03.901344 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a5422-4a2a-452c-a432-fd27e1ab6ee8 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:26:03.920813 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 552/1120] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:26:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:26:06.300943 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304935a0-562e-42d6-bb67-b9c902741d8a None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:06.301519 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304935a0-562e-42d6-bb67-b9c902741d8a None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:06.301671 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304935a0-562e-42d6-bb67-b9c902741d8a None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:06.303063 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 569/1121] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 02:26:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:26:06.308345 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f1cc9-eb56-4b19-8fdd-abade3eb84cf None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:06.308734 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f1cc9-eb56-4b19-8fdd-abade3eb84cf None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:06.310364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f1cc9-eb56-4b19-8fdd-abade3eb84cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:06.374958 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-d99f1cc9-eb56-4b19-8fdd-abade3eb84cf None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:26:06.376159 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-d99f1cc9-eb56-4b19-8fdd-abade3eb84cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:06.389540 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:06.476341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 553/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 02:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:26:06.766092 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304935a0-562e-42d6-bb67-b9c902741d8a None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:26:06.767723 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-304935a0-562e-42d6-bb67-b9c902741d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:06.872345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304935a0-562e-42d6-bb67-b9c902741d8a None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:26:06.886242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:06.948156 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afa90a-40fe-41ae-b529-3dfef89a91a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:26:06.948759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afa90a-40fe-41ae-b529-3dfef89a91a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:06.949033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afa90a-40fe-41ae-b529-3dfef89a91a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:06.949304 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afa90a-40fe-41ae-b529-3dfef89a91a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:06.950927 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-96afa90a-40fe-41ae-b529-3dfef89a91a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:07.058657 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96afa90a-40fe-41ae-b529-3dfef89a91a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:26:07.060054 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96afa90a-40fe-41ae-b529-3dfef89a91a0 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:26:07.080657 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 570/1123] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:26:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:26:09.739627 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090ab7f-c112-4b9b-9f90-45f35e632b5d None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:09.740228 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090ab7f-c112-4b9b-9f90-45f35e632b5d None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:09.740228 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090ab7f-c112-4b9b-9f90-45f35e632b5d None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:09.741512 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 554/1124] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 02:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:26:09.746759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4964ea-fd24-43be-acdd-90ed95cc93e7 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:09.747229 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4964ea-fd24-43be-acdd-90ed95cc93e7 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:09.747333 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4964ea-fd24-43be-acdd-90ed95cc93e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:09.795795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:09.814892 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-9b4964ea-fd24-43be-acdd-90ed95cc93e7 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:26:09.816711 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-9b4964ea-fd24-43be-acdd-90ed95cc93e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:09.912468 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 571/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 02:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:26:10.198187 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090ab7f-c112-4b9b-9f90-45f35e632b5d None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:26:10.199755 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-3090ab7f-c112-4b9b-9f90-45f35e632b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:10.305863 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090ab7f-c112-4b9b-9f90-45f35e632b5d None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:26:10.346540 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:10.379482 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78081109-a0e4-4fa6-a1eb-47e040524c36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:26:10.380087 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78081109-a0e4-4fa6-a1eb-47e040524c36 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:10.380358 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78081109-a0e4-4fa6-a1eb-47e040524c36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:10.380624 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78081109-a0e4-4fa6-a1eb-47e040524c36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:10.382206 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-78081109-a0e4-4fa6-a1eb-47e040524c36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:10.491360 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78081109-a0e4-4fa6-a1eb-47e040524c36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:26:10.492786 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78081109-a0e4-4fa6-a1eb-47e040524c36 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:26:10.510494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 555/1126] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:26:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:26:12.790611 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dab650-40f5-47ec-b67d-5bfa68c57dbd None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:12.791160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dab650-40f5-47ec-b67d-5bfa68c57dbd None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:12.791160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dab650-40f5-47ec-b67d-5bfa68c57dbd None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:12.792435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 572/1127] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 02:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:26:12.797771 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4cde1-377d-4365-a60a-cf4c0f29adb9 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:12.798197 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4cde1-377d-4365-a60a-cf4c0f29adb9 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:12.798322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4cde1-377d-4365-a60a-cf4c0f29adb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:12.866370 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-fba4cde1-377d-4365-a60a-cf4c0f29adb9 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:26:12.867615 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-fba4cde1-377d-4365-a60a-cf4c0f29adb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:12.888665 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:12.963804 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 556/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 02:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:26:13.250028 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dab650-40f5-47ec-b67d-5bfa68c57dbd None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:26:13.251635 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-67dab650-40f5-47ec-b67d-5bfa68c57dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:13.355663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dab650-40f5-47ec-b67d-5bfa68c57dbd None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:26:13.375998 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:13.430118 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1ff14-b3e2-40f7-b65d-00b3f9d16924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:26:13.430741 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1ff14-b3e2-40f7-b65d-00b3f9d16924 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:13.431044 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1ff14-b3e2-40f7-b65d-00b3f9d16924 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:13.431313 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1ff14-b3e2-40f7-b65d-00b3f9d16924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:13.432890 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-03c1ff14-b3e2-40f7-b65d-00b3f9d16924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:13.541246 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1ff14-b3e2-40f7-b65d-00b3f9d16924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:26:13.542632 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1ff14-b3e2-40f7-b65d-00b3f9d16924 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:26:13.560834 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 573/1129] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:26:15.776793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b95d3e-8ed9-4914-abab-aed03603cc9c None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:15.777352 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b95d3e-8ed9-4914-abab-aed03603cc9c None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:15.777352 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b95d3e-8ed9-4914-abab-aed03603cc9c None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:15.778699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 557/1130] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 02:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:26:15.784134 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d95c9-6a7e-4372-a540-e67ff78ff3cc None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:15.785121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d95c9-6a7e-4372-a540-e67ff78ff3cc None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:15.785121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d95c9-6a7e-4372-a540-e67ff78ff3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:15.849854 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:15.852492 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-f85d95c9-6a7e-4372-a540-e67ff78ff3cc None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:26:15.853694 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-f85d95c9-6a7e-4372-a540-e67ff78ff3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:15.951401 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 574/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 02:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:26:16.246360 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b95d3e-8ed9-4914-abab-aed03603cc9c None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:26:16.247934 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-22b95d3e-8ed9-4914-abab-aed03603cc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:16.351785 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b95d3e-8ed9-4914-abab-aed03603cc9c None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:26:16.400520 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:16.424982 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd62911-29ea-4535-86fc-db5a9aca2745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:26:16.425687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd62911-29ea-4535-86fc-db5a9aca2745 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:16.425966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd62911-29ea-4535-86fc-db5a9aca2745 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:16.426237 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd62911-29ea-4535-86fc-db5a9aca2745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:16.427853 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-7fd62911-29ea-4535-86fc-db5a9aca2745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:16.538581 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd62911-29ea-4535-86fc-db5a9aca2745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:26:16.540076 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd62911-29ea-4535-86fc-db5a9aca2745 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:26:16.559044 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 558/1132] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:26:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:26:18.792494 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6b139-3c55-4826-8c9c-49decc554a24 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:18.793035 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6b139-3c55-4826-8c9c-49decc554a24 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:18.793035 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6b139-3c55-4826-8c9c-49decc554a24 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:18.794330 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 575/1133] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 02:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:26:18.799598 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70405c85-7bcc-4fa3-97df-3997155a7fa1 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:18.800578 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70405c85-7bcc-4fa3-97df-3997155a7fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:18.800935 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70405c85-7bcc-4fa3-97df-3997155a7fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:18.867814 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-70405c85-7bcc-4fa3-97df-3997155a7fa1 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:26:18.869026 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-70405c85-7bcc-4fa3-97df-3997155a7fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:18.898165 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:18.965510 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 559/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 02:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:26:19.262177 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6b139-3c55-4826-8c9c-49decc554a24 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:26:19.270262 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-faf6b139-3c55-4826-8c9c-49decc554a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:19.369215 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6b139-3c55-4826-8c9c-49decc554a24 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:26:19.398261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:19.444680 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92316a-07e5-4604-b6bf-f322470d09ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:26:19.445275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92316a-07e5-4604-b6bf-f322470d09ae service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:19.445547 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92316a-07e5-4604-b6bf-f322470d09ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:19.445812 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92316a-07e5-4604-b6bf-f322470d09ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:19.447423 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-6d92316a-07e5-4604-b6bf-f322470d09ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:19.556994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92316a-07e5-4604-b6bf-f322470d09ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:26:19.558411 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92316a-07e5-4604-b6bf-f322470d09ae service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:26:19.576583 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 576/1135] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:26:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:26:21.774928 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041e16b-5588-4459-bfaf-6b2f60926e16 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:21.775556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041e16b-5588-4459-bfaf-6b2f60926e16 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:21.775556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041e16b-5588-4459-bfaf-6b2f60926e16 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:21.776810 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 560/1136] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 02:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:26:21.782126 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46b194-d303-4078-adf2-2fced32242c2 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:21.782575 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46b194-d303-4078-adf2-2fced32242c2 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:21.782699 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46b194-d303-4078-adf2-2fced32242c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:21.850809 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-5e46b194-d303-4078-adf2-2fced32242c2 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:26:21.852052 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-5e46b194-d303-4078-adf2-2fced32242c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:21.860187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:21.947997 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 577/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 02:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:26:22.240642 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041e16b-5588-4459-bfaf-6b2f60926e16 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:26:22.242162 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-1041e16b-5588-4459-bfaf-6b2f60926e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:22.348568 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041e16b-5588-4459-bfaf-6b2f60926e16 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:26:22.403904 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:22.421703 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eed770-e94f-42c1-83a7-ab902b21f3d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:26:22.422304 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eed770-e94f-42c1-83a7-ab902b21f3d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:22.422591 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eed770-e94f-42c1-83a7-ab902b21f3d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:22.422870 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eed770-e94f-42c1-83a7-ab902b21f3d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:22.425256 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-50eed770-e94f-42c1-83a7-ab902b21f3d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:22.535595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eed770-e94f-42c1-83a7-ab902b21f3d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:26:22.537059 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eed770-e94f-42c1-83a7-ab902b21f3d6 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:26:22.556170 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 561/1138] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:26:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:26:24.772096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b3db5-d364-4d5e-b56a-c9d3490570eb None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:24.772631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b3db5-d364-4d5e-b56a-c9d3490570eb None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:24.772631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b3db5-d364-4d5e-b56a-c9d3490570eb None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:24.773902 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 578/1139] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 02:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:26:24.779349 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0748e-8f64-4107-b230-1709473834dc None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:24.779751 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0748e-8f64-4107-b230-1709473834dc None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:24.779886 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0748e-8f64-4107-b230-1709473834dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:24.847703 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-1aa0748e-8f64-4107-b230-1709473834dc None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:26:24.848911 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-1aa0748e-8f64-4107-b230-1709473834dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:24.886665 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:24.944355 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 562/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 02:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:26:25.235435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b3db5-d364-4d5e-b56a-c9d3490570eb None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:26:25.237018 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-1e9b3db5-d364-4d5e-b56a-c9d3490570eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:25.342102 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b3db5-d364-4d5e-b56a-c9d3490570eb None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:26:25.380506 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:25.416926 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161f90b-40a8-4071-b627-8fa1a5677563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:26:25.417537 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161f90b-40a8-4071-b627-8fa1a5677563 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:25.417814 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161f90b-40a8-4071-b627-8fa1a5677563 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:25.418082 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161f90b-40a8-4071-b627-8fa1a5677563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:25.419717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-3161f90b-40a8-4071-b627-8fa1a5677563 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:25.527994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161f90b-40a8-4071-b627-8fa1a5677563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:26:25.529402 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161f90b-40a8-4071-b627-8fa1a5677563 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:26:25.547724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 579/1141] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:26:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:26:27.741873 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03279377-3a36-4884-b0de-157fbb6e55a1 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:27.742466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03279377-3a36-4884-b0de-157fbb6e55a1 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:27.742466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03279377-3a36-4884-b0de-157fbb6e55a1 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:27.743861 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 563/1142] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 02:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:26:27.749245 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12310e-10fd-4a28-9651-f1385ec0a8dc None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:27.749665 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12310e-10fd-4a28-9651-f1385ec0a8dc None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:27.749760 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12310e-10fd-4a28-9651-f1385ec0a8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:27.815799 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-0f12310e-10fd-4a28-9651-f1385ec0a8dc None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:26:27.817015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-0f12310e-10fd-4a28-9651-f1385ec0a8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:27.835816 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:27.915402 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 580/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 02:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:26:28.207340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03279377-3a36-4884-b0de-157fbb6e55a1 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:26:28.208895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-03279377-3a36-4884-b0de-157fbb6e55a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:28.312279 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03279377-3a36-4884-b0de-157fbb6e55a1 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:26:28.380652 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:28.387143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9976f4e-c7d8-4172-82ce-6829dabfcdae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:26:28.387742 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9976f4e-c7d8-4172-82ce-6829dabfcdae service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:28.388015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9976f4e-c7d8-4172-82ce-6829dabfcdae service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:28.388283 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9976f4e-c7d8-4172-82ce-6829dabfcdae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:28.389894 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-e9976f4e-c7d8-4172-82ce-6829dabfcdae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:28.499877 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9976f4e-c7d8-4172-82ce-6829dabfcdae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:26:28.501312 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9976f4e-c7d8-4172-82ce-6829dabfcdae service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:26:28.520730 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 564/1144] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:26:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:26:30.679260 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d922f92-9d17-4ca1-a06f-7c37e5b8c66d None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:30.679795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d922f92-9d17-4ca1-a06f-7c37e5b8c66d None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:30.679795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d922f92-9d17-4ca1-a06f-7c37e5b8c66d None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:30.681120 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 581/1145] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 02:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:26:30.686340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6dab25-aa9d-4c5c-9406-b5d6b459d5cc None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:30.686760 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6dab25-aa9d-4c5c-9406-b5d6b459d5cc None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:30.686915 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6dab25-aa9d-4c5c-9406-b5d6b459d5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:30.754933 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-3a6dab25-aa9d-4c5c-9406-b5d6b459d5cc None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:26:30.756092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-3a6dab25-aa9d-4c5c-9406-b5d6b459d5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:30.805447 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:30.852863 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 565/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 02:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:26:31.141279 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d922f92-9d17-4ca1-a06f-7c37e5b8c66d None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:26:31.143061 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-0d922f92-9d17-4ca1-a06f-7c37e5b8c66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:31.255234 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d922f92-9d17-4ca1-a06f-7c37e5b8c66d None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:26:31.304817 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:31.330904 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc9265-d849-468c-a10d-fbed960cc757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:26:31.331586 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc9265-d849-468c-a10d-fbed960cc757 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:31.331861 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc9265-d849-468c-a10d-fbed960cc757 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:31.332133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc9265-d849-468c-a10d-fbed960cc757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:31.333734 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-51bc9265-d849-468c-a10d-fbed960cc757 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:31.446290 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc9265-d849-468c-a10d-fbed960cc757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:26:31.447894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc9265-d849-468c-a10d-fbed960cc757 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:26:31.467115 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 582/1147] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:26:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:26:40.876219 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=22 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:41.464719 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=66 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:51.640481 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fd73d-2dca-4057-a73e-aae1da8ff345 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:51.641039 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fd73d-2dca-4057-a73e-aae1da8ff345 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:51.641039 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fd73d-2dca-4057-a73e-aae1da8ff345 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:51.642552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 566/1148] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:26:51.648227 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9553ce9-e18a-4c55-8cee-ca7f8bd89d07 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:51.648665 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9553ce9-e18a-4c55-8cee-ca7f8bd89d07 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:51.648776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9553ce9-e18a-4c55-8cee-ca7f8bd89d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:51.714021 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-b9553ce9-e18a-4c55-8cee-ca7f8bd89d07 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:26:51.715246 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-b9553ce9-e18a-4c55-8cee-ca7f8bd89d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:51.814796 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 583/1149] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:26:52.113460 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492a04c-abd1-4361-8f25-18310e873852 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:52.113743 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492a04c-abd1-4361-8f25-18310e873852 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:52.114017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492a04c-abd1-4361-8f25-18310e873852 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:52.115423 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 567/1150] 10.222.0.16 () {54 vars in 962 bytes} [Wed Oct 19 02:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:26:52.120313 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af7b96-0e5b-48d1-906e-41b2bd5517c2 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:52.120601 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af7b96-0e5b-48d1-906e-41b2bd5517c2 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:52.120873 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af7b96-0e5b-48d1-906e-41b2bd5517c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:52.199978 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-e2af7b96-0e5b-48d1-906e-41b2bd5517c2 None None] MFA Rules not processed for user `d9e8a7a5b8944272a2d1bd2140819ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:26:52.201182 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-e2af7b96-0e5b-48d1-906e-41b2bd5517c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:52.224144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:52.280068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 584/1151] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Oct 19 02:26:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:26:52.288599 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492a04c-abd1-4361-8f25-18310e873852 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:26:52.290094 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c492a04c-abd1-4361-8f25-18310e873852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:52.394923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492a04c-abd1-4361-8f25-18310e873852 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:26:52.468604 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b0928-de38-4a2b-b4b7-0233085fe3f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9e8a7a5b8944272a2d1bd2140819ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:26:52.469203 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b0928-de38-4a2b-b4b7-0233085fe3f6 service glance] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:52.469483 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b0928-de38-4a2b-b4b7-0233085fe3f6 service glance] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:52.469753 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b0928-de38-4a2b-b4b7-0233085fe3f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:52.472098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-e41b0928-de38-4a2b-b4b7-0233085fe3f6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:52.526720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:52.582102 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b0928-de38-4a2b-b4b7-0233085fe3f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:26:52.583565 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b0928-de38-4a2b-b4b7-0233085fe3f6 service glance] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:26:52.602089 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 568/1152] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:26:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:26:54.843377 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe8652-602d-4d9b-9026-884ed7bcab2d None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:54.843895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe8652-602d-4d9b-9026-884ed7bcab2d None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:54.843895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe8652-602d-4d9b-9026-884ed7bcab2d None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:54.845247 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 585/1153] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:26:54.850488 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8049c-8fcb-4e35-b21a-78781e4c2bf1 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:54.850978 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8049c-8fcb-4e35-b21a-78781e4c2bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:54.851089 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8049c-8fcb-4e35-b21a-78781e4c2bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:54.916633 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-fda8049c-8fcb-4e35-b21a-78781e4c2bf1 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:26:54.917815 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-fda8049c-8fcb-4e35-b21a-78781e4c2bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:55.013977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 569/1154] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:26:55.289993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe8652-602d-4d9b-9026-884ed7bcab2d None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:26:55.291597 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-aabe8652-602d-4d9b-9026-884ed7bcab2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:55.417399 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe8652-602d-4d9b-9026-884ed7bcab2d None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:26:55.467417 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:55.511901 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51aa183-57f9-4554-92ac-a7a15cc8b9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:26:55.512502 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51aa183-57f9-4554-92ac-a7a15cc8b9ce admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:55.512784 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51aa183-57f9-4554-92ac-a7a15cc8b9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:55.513054 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51aa183-57f9-4554-92ac-a7a15cc8b9ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:55.513699 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51aa183-57f9-4554-92ac-a7a15cc8b9ce admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:26:55.514796 dv-cinder-861491-4-smb devstack@keystone.service[81670]: WARNING py.warnings [None req-f51aa183-57f9-4554-92ac-a7a15cc8b9ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 02:26:55.514796 dv-cinder-861491-4-smb devstack@keystone.service[81670]: warnings.warn(msg) Oct 19 02:26:55.514796 dv-cinder-861491-4-smb devstack@keystone.service[81670]: Oct 19 02:26:55.515961 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51aa183-57f9-4554-92ac-a7a15cc8b9ce admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:26:55.535872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 586/1155] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 19 02:26:55 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:26:57.758168 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f10e9-e571-4d9c-ae2f-fbf80971c35f None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:57.758743 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f10e9-e571-4d9c-ae2f-fbf80971c35f None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:57.758743 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f10e9-e571-4d9c-ae2f-fbf80971c35f None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:57.760119 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 570/1156] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:26:57.765603 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634eb2d-6e5d-4da3-9906-19e4f448679c None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:57.765986 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634eb2d-6e5d-4da3-9906-19e4f448679c None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:57.766157 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634eb2d-6e5d-4da3-9906-19e4f448679c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:57.834665 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-1634eb2d-6e5d-4da3-9906-19e4f448679c None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:26:57.835907 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-1634eb2d-6e5d-4da3-9906-19e4f448679c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:57.932899 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 587/1157] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:26:58.226902 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f10e9-e571-4d9c-ae2f-fbf80971c35f None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:26:58.228403 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-240f10e9-e571-4d9c-ae2f-fbf80971c35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:58.238647 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:58.375646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f10e9-e571-4d9c-ae2f-fbf80971c35f None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:26:58.456861 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:26:58.489130 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220dec6-d7f8-4fcb-b005-7a71b6a1ff23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:26:58.489673 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220dec6-d7f8-4fcb-b005-7a71b6a1ff23 service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:26:58.489946 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220dec6-d7f8-4fcb-b005-7a71b6a1ff23 service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:26:58.490212 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220dec6-d7f8-4fcb-b005-7a71b6a1ff23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:26:58.491819 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-4220dec6-d7f8-4fcb-b005-7a71b6a1ff23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:26:58.580025 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220dec6-d7f8-4fcb-b005-7a71b6a1ff23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:26:58.581592 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220dec6-d7f8-4fcb-b005-7a71b6a1ff23 service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:26:58.599289 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 571/1158] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:26:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:27:00.945306 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f523a-6e0b-4828-a002-0b53264a06c9 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:27:00.945900 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f523a-6e0b-4828-a002-0b53264a06c9 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:27:00.945900 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f523a-6e0b-4828-a002-0b53264a06c9 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:27:00.947257 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 588/1159] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:27:00.952512 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e168d3-aaea-468a-a0dd-a565d9946226 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:27:00.952948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e168d3-aaea-468a-a0dd-a565d9946226 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:27:00.953051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e168d3-aaea-468a-a0dd-a565d9946226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:27:01.022540 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-c8e168d3-aaea-468a-a0dd-a565d9946226 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:27:01.023691 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c8e168d3-aaea-468a-a0dd-a565d9946226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:27:01.070982 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:27:01.121852 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 572/1160] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:27:01.410214 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f523a-6e0b-4828-a002-0b53264a06c9 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:27:01.411809 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-f91f523a-6e0b-4828-a002-0b53264a06c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:27:01.435856 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:27:01.515965 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f523a-6e0b-4828-a002-0b53264a06c9 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:27:01.589990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003c194-8298-48f1-baa6-36d93738934c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:27:01.590591 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003c194-8298-48f1-baa6-36d93738934c service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:27:01.590898 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003c194-8298-48f1-baa6-36d93738934c service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:27:01.591173 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003c194-8298-48f1-baa6-36d93738934c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:27:01.592771 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-f003c194-8298-48f1-baa6-36d93738934c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:27:01.667074 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:27:01.701844 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003c194-8298-48f1-baa6-36d93738934c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:27:01.703318 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003c194-8298-48f1-baa6-36d93738934c service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:27:01.722481 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 589/1161] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:27:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:27:03.936445 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d359041-91c1-4dbc-9b56-81ee2b026ac3 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:27:03.937110 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d359041-91c1-4dbc-9b56-81ee2b026ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:27:03.937110 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d359041-91c1-4dbc-9b56-81ee2b026ac3 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:27:03.938385 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 573/1162] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:27:03.943803 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c20b7-327f-433a-862a-fcf2cdda03d2 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:27:03.944265 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c20b7-327f-433a-862a-fcf2cdda03d2 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:27:03.944374 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c20b7-327f-433a-862a-fcf2cdda03d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:27:04.010353 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-f33c20b7-327f-433a-862a-fcf2cdda03d2 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:27:04.011589 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-f33c20b7-327f-433a-862a-fcf2cdda03d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:27:04.108630 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 590/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:27:04.399984 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d359041-91c1-4dbc-9b56-81ee2b026ac3 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:27:04.401658 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-8d359041-91c1-4dbc-9b56-81ee2b026ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:27:04.506858 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d359041-91c1-4dbc-9b56-81ee2b026ac3 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:27:04.578220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:27:04.580454 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522fbdb-a2b8-4181-b8e8-4355ec9a7ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:27:04.581057 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522fbdb-a2b8-4181-b8e8-4355ec9a7ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:27:04.581332 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522fbdb-a2b8-4181-b8e8-4355ec9a7ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:27:04.581601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522fbdb-a2b8-4181-b8e8-4355ec9a7ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:27:04.583216 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c522fbdb-a2b8-4181-b8e8-4355ec9a7ce3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:27:04.699786 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522fbdb-a2b8-4181-b8e8-4355ec9a7ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:27:04.701225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522fbdb-a2b8-4181-b8e8-4355ec9a7ce3 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:27:04.719761 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 574/1164] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:27:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:27:07.005796 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574585f-6bb5-4409-b9b2-b8a523466a58 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:27:07.006387 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574585f-6bb5-4409-b9b2-b8a523466a58 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:27:07.006387 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574585f-6bb5-4409-b9b2-b8a523466a58 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:27:07.007741 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 591/1165] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:27:07.013091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b7b5e-10cf-43f1-bd0a-7bfc9bc38e8a None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:27:07.013535 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b7b5e-10cf-43f1-bd0a-7bfc9bc38e8a None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:27:07.013640 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b7b5e-10cf-43f1-bd0a-7bfc9bc38e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:27:07.080977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-166b7b5e-10cf-43f1-bd0a-7bfc9bc38e8a None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:27:07.082182 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-166b7b5e-10cf-43f1-bd0a-7bfc9bc38e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:27:07.136236 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:27:07.180741 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 575/1166] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:27:07.478658 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574585f-6bb5-4409-b9b2-b8a523466a58 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:27:07.480266 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-c574585f-6bb5-4409-b9b2-b8a523466a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:27:07.516272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:27:07.584949 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574585f-6bb5-4409-b9b2-b8a523466a58 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:27:07.658327 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6298933-a5d9-4722-84b6-076423244a62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:27:07.658959 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6298933-a5d9-4722-84b6-076423244a62 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:27:07.659239 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6298933-a5d9-4722-84b6-076423244a62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:27:07.659510 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6298933-a5d9-4722-84b6-076423244a62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:27:07.661123 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-b6298933-a5d9-4722-84b6-076423244a62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:27:07.742134 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:27:07.770885 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6298933-a5d9-4722-84b6-076423244a62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:27:07.772324 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6298933-a5d9-4722-84b6-076423244a62 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:27:07.791321 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 592/1167] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:27:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:27:10.318210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c0641-64e8-45c7-b53d-95be8f6b2396 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:27:10.318791 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c0641-64e8-45c7-b53d-95be8f6b2396 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:27:10.318791 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c0641-64e8-45c7-b53d-95be8f6b2396 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:27:10.320208 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 576/1168] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 19 02:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:27:10.325629 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1772db-96f9-4d12-b6f9-fa7ddfc13b36 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:27:10.326062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1772db-96f9-4d12-b6f9-fa7ddfc13b36 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:27:10.326168 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1772db-96f9-4d12-b6f9-fa7ddfc13b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:27:10.392847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-bd1772db-96f9-4d12-b6f9-fa7ddfc13b36 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:27:10.394164 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-bd1772db-96f9-4d12-b6f9-fa7ddfc13b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:27:10.493547 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 593/1169] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 19 02:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:27:10.786936 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c0641-64e8-45c7-b53d-95be8f6b2396 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:27:10.788478 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-026c0641-64e8-45c7-b53d-95be8f6b2396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:27:10.892709 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c0641-64e8-45c7-b53d-95be8f6b2396 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:27:10.966914 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be5f69-07b5-4ffa-9a34-a65377dc78ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:27:10.967525 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be5f69-07b5-4ffa-9a34-a65377dc78ca service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:27:10.967806 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be5f69-07b5-4ffa-9a34-a65377dc78ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:27:10.968080 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be5f69-07b5-4ffa-9a34-a65377dc78ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:27:10.970129 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-58be5f69-07b5-4ffa-9a34-a65377dc78ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:27:10.979023 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:27:11.079874 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be5f69-07b5-4ffa-9a34-a65377dc78ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:27:11.081235 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be5f69-07b5-4ffa-9a34-a65377dc78ca service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:27:11.099071 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 577/1170] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:27:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:27:20.492001 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=82 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:27:21.096847 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=50 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:28:46.666650 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70257f9e-a86c-4f75-b887-c5ae851d49da None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:28:46.667242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70257f9e-a86c-4f75-b887-c5ae851d49da None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:28:46.667242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70257f9e-a86c-4f75-b887-c5ae851d49da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:28:46.742000 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-70257f9e-a86c-4f75-b887-c5ae851d49da None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:28:46.743236 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-70257f9e-a86c-4f75-b887-c5ae851d49da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:28:46.841025 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 594/1171] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:28:46.849590 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f03f4-9780-4827-8a3a-af86e3901caf None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:28:46.850105 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f03f4-9780-4827-8a3a-af86e3901caf None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:28:46.850222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f03f4-9780-4827-8a3a-af86e3901caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:28:46.926522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-014f03f4-9780-4827-8a3a-af86e3901caf None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:28:46.927747 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-014f03f4-9780-4827-8a3a-af86e3901caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:28:47.024350 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 578/1172] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:28:47.028988 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70257f9e-a86c-4f75-b887-c5ae851d49da None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:28:47.030678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-70257f9e-a86c-4f75-b887-c5ae851d49da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:28:47.042160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70257f9e-a86c-4f75-b887-c5ae851d49da None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:28:47.103925 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:28:47.138180 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e85b77-f712-4ad9-a0b7-3d07d07bdcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:28:47.138809 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e85b77-f712-4ad9-a0b7-3d07d07bdcac admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:28:47.139137 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e85b77-f712-4ad9-a0b7-3d07d07bdcac admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:28:47.139389 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e85b77-f712-4ad9-a0b7-3d07d07bdcac admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:28:47.140032 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e85b77-f712-4ad9-a0b7-3d07d07bdcac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:28:47.140336 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e85b77-f712-4ad9-a0b7-3d07d07bdcac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:28:47.141350 dv-cinder-861491-4-smb devstack@keystone.service[81670]: WARNING py.warnings [None req-e0e85b77-f712-4ad9-a0b7-3d07d07bdcac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 02:28:47.141350 dv-cinder-861491-4-smb devstack@keystone.service[81670]: warnings.warn(msg) Oct 19 02:28:47.141350 dv-cinder-861491-4-smb devstack@keystone.service[81670]: Oct 19 02:28:47.142259 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e85b77-f712-4ad9-a0b7-3d07d07bdcac admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:28:47.153577 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 595/1173] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:28:47.163329 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f03f4-9780-4827-8a3a-af86e3901caf None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:28:47.174017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f03f4-9780-4827-8a3a-af86e3901caf None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:28:47.235998 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:28:47.268530 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641170ba-0456-4bc8-b431-63814fc70ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:28:47.269129 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641170ba-0456-4bc8-b431-63814fc70ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:28:47.269404 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641170ba-0456-4bc8-b431-63814fc70ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:28:47.269669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641170ba-0456-4bc8-b431-63814fc70ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:28:47.270292 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641170ba-0456-4bc8-b431-63814fc70ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:28:47.271393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: WARNING py.warnings [None req-641170ba-0456-4bc8-b431-63814fc70ea5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 02:28:47.271393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: warnings.warn(msg) Oct 19 02:28:47.271393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: Oct 19 02:28:47.272579 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641170ba-0456-4bc8-b431-63814fc70ea5 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:28:47.420000 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 579/1174] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:28:47 2022] POST /identity/v3/projects => generated 379 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:28:47.424353 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e85b77-f712-4ad9-a0b7-3d07d07bdcac admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:28:47.425869 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-e0e85b77-f712-4ad9-a0b7-3d07d07bdcac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:28:47.460216 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e85b77-f712-4ad9-a0b7-3d07d07bdcac admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:28:47.553362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea04dd-353e-45de-beb4-a2602547581e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:28:47.553981 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea04dd-353e-45de-beb4-a2602547581e admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:28:47.554239 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea04dd-353e-45de-beb4-a2602547581e admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:28:47.554507 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea04dd-353e-45de-beb4-a2602547581e admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:28:47.555154 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea04dd-353e-45de-beb4-a2602547581e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:28:47.556148 dv-cinder-861491-4-smb devstack@keystone.service[81670]: WARNING py.warnings [None req-bbea04dd-353e-45de-beb4-a2602547581e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 02:28:47.556148 dv-cinder-861491-4-smb devstack@keystone.service[81670]: warnings.warn(msg) Oct 19 02:28:47.556148 dv-cinder-861491-4-smb devstack@keystone.service[81670]: Oct 19 02:28:47.557357 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea04dd-353e-45de-beb4-a2602547581e admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:28:47.664031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 596/1175] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:28:47 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:28:47.668060 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641170ba-0456-4bc8-b431-63814fc70ea5 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:28:47.669645 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-641170ba-0456-4bc8-b431-63814fc70ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:28:47.730933 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641170ba-0456-4bc8-b431-63814fc70ea5 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:28:47.814072 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:28:47.824050 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447c520-5a36-4c1c-b376-87b1b26f1782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:28:47.828565 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447c520-5a36-4c1c-b376-87b1b26f1782 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:28:47.828565 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447c520-5a36-4c1c-b376-87b1b26f1782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:28:47.828565 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447c520-5a36-4c1c-b376-87b1b26f1782 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:28:47.828565 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447c520-5a36-4c1c-b376-87b1b26f1782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:28:47.828565 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447c520-5a36-4c1c-b376-87b1b26f1782 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:28:47.841116 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 580/1176] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:28:47.845358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea04dd-353e-45de-beb4-a2602547581e admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:28:47.846907 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-bbea04dd-353e-45de-beb4-a2602547581e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:28:47.858749 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea04dd-353e-45de-beb4-a2602547581e admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:28:47.884307 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:28:47.957865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d859a-9665-48aa-b025-6214f3e9f135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:28:47.958420 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d859a-9665-48aa-b025-6214f3e9f135 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:28:47.958697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d859a-9665-48aa-b025-6214f3e9f135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:28:47.959000 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d859a-9665-48aa-b025-6214f3e9f135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:28:47.959646 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d859a-9665-48aa-b025-6214f3e9f135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:28:47.961235 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d859a-9665-48aa-b025-6214f3e9f135 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:28:47.973592 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 597/1177] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:28:47.977748 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447c520-5a36-4c1c-b376-87b1b26f1782 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:28:47.979286 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c447c520-5a36-4c1c-b376-87b1b26f1782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:28:48.013337 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447c520-5a36-4c1c-b376-87b1b26f1782 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:28:48.112566 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00592d2-685b-4294-8e32-501041cc91bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:28:48.113231 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00592d2-685b-4294-8e32-501041cc91bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:28:48.113510 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00592d2-685b-4294-8e32-501041cc91bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:28:48.113782 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00592d2-685b-4294-8e32-501041cc91bd admin admin] PATH_INFO: `/v3/projects/fa796276914047cfba229a013844b82b/users/af6855a7c5b94cd0b3384889d819edbd/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:28:48.137396 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00592d2-685b-4294-8e32-501041cc91bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa796276914047cfba229a013844b82b, user_id=af6855a7c5b94cd0b3384889d819edbd, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:28:48.140909 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00592d2-685b-4294-8e32-501041cc91bd admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:28:48.258791 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 581/1178] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:28:47 2022] PUT /identity/v3/projects/fa796276914047cfba229a013844b82b/users/af6855a7c5b94cd0b3384889d819edbd/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:28:48.270374 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d6d56-765e-4513-9755-a4463ff51d5c None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:28:48.270724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d6d56-765e-4513-9755-a4463ff51d5c None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:28:48.271049 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d6d56-765e-4513-9755-a4463ff51d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:28:48.330875 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-264d6d56-765e-4513-9755-a4463ff51d5c None None] MFA Rules not processed for user `af6855a7c5b94cd0b3384889d819edbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:28:48.332128 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-264d6d56-765e-4513-9755-a4463ff51d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:28:48.410233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 598/1179] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:28:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:28:48.423563 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1101d8-7f75-44ab-8afd-fcc75641e7db None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:28:48.423848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1101d8-7f75-44ab-8afd-fcc75641e7db None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:28:48.424121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1101d8-7f75-44ab-8afd-fcc75641e7db None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:28:48.425452 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 582/1180] 10.222.0.16 () {54 vars in 963 bytes} [Wed Oct 19 02:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:28:48.430335 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6390596-be82-4f84-ae29-dbdb5184e4ad None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:28:48.430625 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6390596-be82-4f84-ae29-dbdb5184e4ad None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:28:48.430931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6390596-be82-4f84-ae29-dbdb5184e4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:28:48.463405 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:28:48.507831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-e6390596-be82-4f84-ae29-dbdb5184e4ad None None] MFA Rules not processed for user `0f1f37f8136349edac3a52793e2fef8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:28:48.509636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-e6390596-be82-4f84-ae29-dbdb5184e4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:28:48.586320 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 599/1181] 10.222.0.16 () {58 vars in 1060 bytes} [Wed Oct 19 02:28:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:28:48.594235 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1101d8-7f75-44ab-8afd-fcc75641e7db None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:28:48.595832 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-3e1101d8-7f75-44ab-8afd-fcc75641e7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:28:48.647162 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:28:48.700402 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1101d8-7f75-44ab-8afd-fcc75641e7db None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:28:48.774031 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be19c43-8421-4890-b73b-ac6e7b4c5777 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:28:48.774558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be19c43-8421-4890-b73b-ac6e7b4c5777 service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:28:48.774860 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be19c43-8421-4890-b73b-ac6e7b4c5777 service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:28:48.775137 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be19c43-8421-4890-b73b-ac6e7b4c5777 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:28:48.776724 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-5be19c43-8421-4890-b73b-ac6e7b4c5777 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:28:48.876060 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be19c43-8421-4890-b73b-ac6e7b4c5777 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:28:48.877503 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be19c43-8421-4890-b73b-ac6e7b4c5777 service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:28:48.881027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:28:48.895616 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 583/1182] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:28:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:28:48.943484 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75205f75-c957-4e10-bd5f-e6252a7bee4f None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:28:48.943922 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75205f75-c957-4e10-bd5f-e6252a7bee4f None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:28:48.944024 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75205f75-c957-4e10-bd5f-e6252a7bee4f None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:28:48.945269 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 600/1183] 10.222.0.16 () {52 vars in 830 bytes} [Wed Oct 19 02:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:28:48.948770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be19c43-8421-4890-b73b-ac6e7b4c5777 service cinder] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:28:48.949969 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-5be19c43-8421-4890-b73b-ac6e7b4c5777 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:28:49.050302 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be19c43-8421-4890-b73b-ac6e7b4c5777 service cinder] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:28:49.144674 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4d4da-327c-4a0b-9da3-e1387e2d06b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:28:49.145305 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4d4da-327c-4a0b-9da3-e1387e2d06b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:28:49.145582 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4d4da-327c-4a0b-9da3-e1387e2d06b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:28:49.145853 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4d4da-327c-4a0b-9da3-e1387e2d06b8 admin admin] PATH_INFO: `/v3/users/af6855a7c5b94cd0b3384889d819edbd` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:28:49.159038 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4d4da-327c-4a0b-9da3-e1387e2d06b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af6855a7c5b94cd0b3384889d819edbd)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:28:49.160073 dv-cinder-861491-4-smb devstack@keystone.service[81671]: WARNING py.warnings [None req-b6f4d4da-327c-4a0b-9da3-e1387e2d06b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 02:28:49.160073 dv-cinder-861491-4-smb devstack@keystone.service[81671]: warnings.warn(msg) Oct 19 02:28:49.160073 dv-cinder-861491-4-smb devstack@keystone.service[81671]: Oct 19 02:28:49.161305 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4d4da-327c-4a0b-9da3-e1387e2d06b8 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:28:49.172068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:28:49.415646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b6f4d4da-327c-4a0b-9da3-e1387e2d06b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af6855a7c5b94cd0b3384889d819edbd'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:28:49.416175 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b6f4d4da-327c-4a0b-9da3-e1387e2d06b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af6855a7c5b94cd0b3384889d819edbd'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:28:49.514901 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b6f4d4da-327c-4a0b-9da3-e1387e2d06b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af6855a7c5b94cd0b3384889d819edbd'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:28:49.529674 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b6f4d4da-327c-4a0b-9da3-e1387e2d06b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af6855a7c5b94cd0b3384889d819edbd'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:28:49.531091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b6f4d4da-327c-4a0b-9da3-e1387e2d06b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af6855a7c5b94cd0b3384889d819edbd'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:28:49.559587 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 584/1184] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:28:48 2022] DELETE /identity/v3/users/af6855a7c5b94cd0b3384889d819edbd => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:28:49.564326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f5233-5ed1-4ddb-97a2-af827a915488 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:28:49.565014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f5233-5ed1-4ddb-97a2-af827a915488 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:28:49.565014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f5233-5ed1-4ddb-97a2-af827a915488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:28:49.626640 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-866f5233-5ed1-4ddb-97a2-af827a915488 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:28:49.627865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-866f5233-5ed1-4ddb-97a2-af827a915488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:28:49.709851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:28:49.724655 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 601/1185] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:28:49.734632 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4d4da-327c-4a0b-9da3-e1387e2d06b8 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:28:49.735898 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-b6f4d4da-327c-4a0b-9da3-e1387e2d06b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:28:49.834783 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4d4da-327c-4a0b-9da3-e1387e2d06b8 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:28:49.888680 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:28:49.909120 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01232fd2-38c8-41e2-ab0e-3c220bd5a910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:28:49.909729 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01232fd2-38c8-41e2-ab0e-3c220bd5a910 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:28:49.910063 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01232fd2-38c8-41e2-ab0e-3c220bd5a910 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:28:49.910312 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01232fd2-38c8-41e2-ab0e-3c220bd5a910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:28:50.002153 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01232fd2-38c8-41e2-ab0e-3c220bd5a910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:28:50.003560 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01232fd2-38c8-41e2-ab0e-3c220bd5a910 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:28:50.013240 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 585/1186] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:28:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:28:50.564709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f5233-5ed1-4ddb-97a2-af827a915488 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:28:50.566149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-866f5233-5ed1-4ddb-97a2-af827a915488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:28:50.580916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f5233-5ed1-4ddb-97a2-af827a915488 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:28:50.585643 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829a014-540c-46e3-b960-37c596246aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:28:50.586273 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829a014-540c-46e3-b960-37c596246aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:28:50.586549 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829a014-540c-46e3-b960-37c596246aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:28:50.586837 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829a014-540c-46e3-b960-37c596246aea admin admin] PATH_INFO: `/v3/projects/fa796276914047cfba229a013844b82b` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:28:50.599685 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829a014-540c-46e3-b960-37c596246aea admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa796276914047cfba229a013844b82b)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:28:50.600712 dv-cinder-861491-4-smb devstack@keystone.service[81670]: WARNING py.warnings [None req-a829a014-540c-46e3-b960-37c596246aea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 02:28:50.600712 dv-cinder-861491-4-smb devstack@keystone.service[81670]: warnings.warn(msg) Oct 19 02:28:50.600712 dv-cinder-861491-4-smb devstack@keystone.service[81670]: Oct 19 02:28:50.601917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829a014-540c-46e3-b960-37c596246aea admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:28:50.756322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a829a014-540c-46e3-b960-37c596246aea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa796276914047cfba229a013844b82b', 'request_id': 'req-a829a014-540c-46e3-b960-37c596246aea'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:28:50.762476 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a829a014-540c-46e3-b960-37c596246aea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa796276914047cfba229a013844b82b', 'request_id': 'req-a829a014-540c-46e3-b960-37c596246aea'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:28:50.842739 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a829a014-540c-46e3-b960-37c596246aea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa796276914047cfba229a013844b82b', 'request_id': 'req-a829a014-540c-46e3-b960-37c596246aea'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:28:50.861950 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a829a014-540c-46e3-b960-37c596246aea admin admin] The token cache is being invalidate because project fa796276914047cfba229a013844b82b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:28:50.862239 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a829a014-540c-46e3-b960-37c596246aea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:28:50.863028 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a829a014-540c-46e3-b960-37c596246aea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:28:50.864592 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 602/1187] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:28:50 2022] DELETE /identity/v3/projects/fa796276914047cfba229a013844b82b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:29:00.008797 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=49 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:29:00.859117 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:30:26.193665 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1eb5a-1c21-4921-8b5a-8016b18dad30 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:26.194274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1eb5a-1c21-4921-8b5a-8016b18dad30 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:26.194274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1eb5a-1c21-4921-8b5a-8016b18dad30 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:26.195614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 586/1188] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 02:30:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:30:26.200567 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6df8a-f79c-4ea1-8b32-01f6c866b427 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:26.201023 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6df8a-f79c-4ea1-8b32-01f6c866b427 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:26.201127 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6df8a-f79c-4ea1-8b32-01f6c866b427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:26.252436 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-8aa6df8a-f79c-4ea1-8b32-01f6c866b427 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:30:26.253631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-8aa6df8a-f79c-4ea1-8b32-01f6c866b427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:30:26.312181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 603/1189] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 02:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:30:26.467993 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1eb5a-1c21-4921-8b5a-8016b18dad30 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:30:26.470046 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-7eb1eb5a-1c21-4921-8b5a-8016b18dad30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:30:26.589298 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1eb5a-1c21-4921-8b5a-8016b18dad30 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:30:26.595326 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4219a7-dd65-48eb-89b1-de0e7779992b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:30:26.595946 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4219a7-dd65-48eb-89b1-de0e7779992b service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:26.596231 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4219a7-dd65-48eb-89b1-de0e7779992b service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:26.596502 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4219a7-dd65-48eb-89b1-de0e7779992b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:26.605271 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4219a7-dd65-48eb-89b1-de0e7779992b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:30:26.606933 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4219a7-dd65-48eb-89b1-de0e7779992b service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:30:26.616975 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 587/1190] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:30:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:30:27.265342 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdafe2-867a-4789-88f5-9b94c5d66641 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:27.265879 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdafe2-867a-4789-88f5-9b94c5d66641 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:27.265879 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdafe2-867a-4789-88f5-9b94c5d66641 None None] PATH_INFO: `/v3` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:27.267208 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 604/1191] 10.222.0.39 () {54 vars in 925 bytes} [Wed Oct 19 02:30:27 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:30:27.273746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626c570-d3cc-4e95-a551-1b3c5eca8b68 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:27.274201 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626c570-d3cc-4e95-a551-1b3c5eca8b68 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:27.274298 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626c570-d3cc-4e95-a551-1b3c5eca8b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:27.333750 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-1626c570-d3cc-4e95-a551-1b3c5eca8b68 None None] MFA Rules not processed for user `a66b9bc695b44877a06f17ea6bbeb27a`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:30:27.335017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-1626c570-d3cc-4e95-a551-1b3c5eca8b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:30:27.402803 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:30:27.408104 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 588/1192] 10.222.0.39 () {58 vars in 1015 bytes} [Wed Oct 19 02:30:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:30:27.703476 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba3565-1652-4858-b707-f3176393386e None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:27.703765 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba3565-1652-4858-b707-f3176393386e None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:27.704044 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba3565-1652-4858-b707-f3176393386e None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:27.705461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 605/1193] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 02:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:30:27.711825 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdbc50-5e69-4a61-817e-425c2002f89b None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:27.712108 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdbc50-5e69-4a61-817e-425c2002f89b None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:27.712380 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdbc50-5e69-4a61-817e-425c2002f89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:27.732595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-00cdbc50-5e69-4a61-817e-425c2002f89b None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:30:27.733779 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-00cdbc50-5e69-4a61-817e-425c2002f89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:30:27.742417 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 589/1194] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 02:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:30:27.892919 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba3565-1652-4858-b707-f3176393386e None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:30:27.907725 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba3565-1652-4858-b707-f3176393386e None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:30:27.913916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229330e-59f0-44fe-a333-843a70be8d1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:30:27.914502 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229330e-59f0-44fe-a333-843a70be8d1c service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:27.914780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229330e-59f0-44fe-a333-843a70be8d1c service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:27.915078 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229330e-59f0-44fe-a333-843a70be8d1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:27.923051 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229330e-59f0-44fe-a333-843a70be8d1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:30:27.924634 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229330e-59f0-44fe-a333-843a70be8d1c service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:30:27.933895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 606/1195] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:30:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:30:36.306480 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec92f2-9bd7-4236-8fe6-2a0c6794a410 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:36.306981 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec92f2-9bd7-4236-8fe6-2a0c6794a410 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:36.307091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec92f2-9bd7-4236-8fe6-2a0c6794a410 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:36.308432 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 590/1196] 10.222.0.16 () {54 vars in 961 bytes} [Wed Oct 19 02:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:30:36.313838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaf1cb-d828-4ca9-b082-712d4a87846a None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:36.314269 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaf1cb-d828-4ca9-b082-712d4a87846a None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:36.314374 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaf1cb-d828-4ca9-b082-712d4a87846a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:36.334978 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-6abaf1cb-d828-4ca9-b082-712d4a87846a None None] MFA Rules not processed for user `a66b9bc695b44877a06f17ea6bbeb27a`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:30:36.336800 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-6abaf1cb-d828-4ca9-b082-712d4a87846a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:30:36.345389 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 607/1197] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 19 02:30:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:30:36.353092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec92f2-9bd7-4236-8fe6-2a0c6794a410 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:30:36.366356 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec92f2-9bd7-4236-8fe6-2a0c6794a410 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:30:36.371996 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c07fa3-6d72-4bf8-8b62-6e421d132f8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66b9bc695b44877a06f17ea6bbeb27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:30:36.372581 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c07fa3-6d72-4bf8-8b62-6e421d132f8d service placement] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:36.372860 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c07fa3-6d72-4bf8-8b62-6e421d132f8d service placement] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:36.373134 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c07fa3-6d72-4bf8-8b62-6e421d132f8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:36.381320 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c07fa3-6d72-4bf8-8b62-6e421d132f8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:30:36.383670 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c07fa3-6d72-4bf8-8b62-6e421d132f8d service placement] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:30:36.393423 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 591/1198] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:30:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:30:39.421405 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d41a7-879e-44b6-af57-ccda19fbfbe6 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:39.422011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d41a7-879e-44b6-af57-ccda19fbfbe6 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:39.422011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d41a7-879e-44b6-af57-ccda19fbfbe6 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:39.423314 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 608/1199] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 02:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:30:39.429441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b4529-d351-4f40-8d30-453048aa519e None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:39.429892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b4529-d351-4f40-8d30-453048aa519e None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:39.430005 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b4529-d351-4f40-8d30-453048aa519e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:39.449846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-468b4529-d351-4f40-8d30-453048aa519e None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:30:39.451082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-468b4529-d351-4f40-8d30-453048aa519e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:30:39.458958 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 592/1200] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 02:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:30:39.615433 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d41a7-879e-44b6-af57-ccda19fbfbe6 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:30:39.629803 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d41a7-879e-44b6-af57-ccda19fbfbe6 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:30:39.636002 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5340b30-bd42-4510-91e1-8a847180602b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:30:39.636588 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5340b30-bd42-4510-91e1-8a847180602b service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:39.636864 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5340b30-bd42-4510-91e1-8a847180602b service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:39.637181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5340b30-bd42-4510-91e1-8a847180602b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:39.645275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5340b30-bd42-4510-91e1-8a847180602b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:30:39.646883 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5340b30-bd42-4510-91e1-8a847180602b service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:30:39.656938 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 609/1201] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:30:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:30:40.723715 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045004d-0cae-4504-b715-3cee0384406c None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:40.724290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045004d-0cae-4504-b715-3cee0384406c None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:40.724290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045004d-0cae-4504-b715-3cee0384406c None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:40.725586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 593/1202] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 02:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:30:40.732338 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a32630-6897-4dbc-a9b1-b52985e6f01f None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:40.732780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a32630-6897-4dbc-a9b1-b52985e6f01f None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:40.732883 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a32630-6897-4dbc-a9b1-b52985e6f01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:40.752493 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-53a32630-6897-4dbc-a9b1-b52985e6f01f None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:30:40.753699 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-53a32630-6897-4dbc-a9b1-b52985e6f01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:30:40.762202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 610/1203] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 02:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:30:40.915336 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045004d-0cae-4504-b715-3cee0384406c None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:30:40.930186 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045004d-0cae-4504-b715-3cee0384406c None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:30:40.935628 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40086878-c3c0-4e05-b747-0747a7b7a741 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:30:40.936479 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40086878-c3c0-4e05-b747-0747a7b7a741 service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:40.936754 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40086878-c3c0-4e05-b747-0747a7b7a741 service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:40.937020 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40086878-c3c0-4e05-b747-0747a7b7a741 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:40.945184 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40086878-c3c0-4e05-b747-0747a7b7a741 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:30:40.946761 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40086878-c3c0-4e05-b747-0747a7b7a741 service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:30:40.956058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 594/1204] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:30:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:30:45.011907 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49176b-6c33-4bff-ba27-1af132f6c8ad None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:45.012428 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49176b-6c33-4bff-ba27-1af132f6c8ad None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:45.012428 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49176b-6c33-4bff-ba27-1af132f6c8ad None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:45.013715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 611/1205] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 02:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:30:45.018887 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9358fce-f11a-48bc-beac-43ba0c45c72e None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:45.019290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9358fce-f11a-48bc-beac-43ba0c45c72e None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:45.019432 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9358fce-f11a-48bc-beac-43ba0c45c72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:45.038997 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-b9358fce-f11a-48bc-beac-43ba0c45c72e None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:30:45.040193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-b9358fce-f11a-48bc-beac-43ba0c45c72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:30:45.048057 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 595/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 02:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:30:45.333752 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49176b-6c33-4bff-ba27-1af132f6c8ad None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:30:45.336300 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-ef49176b-6c33-4bff-ba27-1af132f6c8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:30:45.414701 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49176b-6c33-4bff-ba27-1af132f6c8ad None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:30:45.418311 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4130a4-6605-4875-8bfd-bb606bca5855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:30:45.418942 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4130a4-6605-4875-8bfd-bb606bca5855 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:45.419223 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4130a4-6605-4875-8bfd-bb606bca5855 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:45.419495 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4130a4-6605-4875-8bfd-bb606bca5855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:45.428389 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4130a4-6605-4875-8bfd-bb606bca5855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:30:45.430132 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4130a4-6605-4875-8bfd-bb606bca5855 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:30:45.439716 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 612/1207] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:30:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:30:47.585879 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af9f1c-45ec-41ec-b330-c7e413eeb59f None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:47.586454 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af9f1c-45ec-41ec-b330-c7e413eeb59f None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:47.586454 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af9f1c-45ec-41ec-b330-c7e413eeb59f None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:47.587777 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 596/1208] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 02:30:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:30:47.593188 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748fb7f-858a-4eaa-92d1-67f4256a1f87 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:47.593613 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748fb7f-858a-4eaa-92d1-67f4256a1f87 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:47.593704 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748fb7f-858a-4eaa-92d1-67f4256a1f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:47.615301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-5748fb7f-858a-4eaa-92d1-67f4256a1f87 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:30:47.616517 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-5748fb7f-858a-4eaa-92d1-67f4256a1f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:30:47.624434 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 613/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 02:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:30:47.911782 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af9f1c-45ec-41ec-b330-c7e413eeb59f None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:30:47.922955 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af9f1c-45ec-41ec-b330-c7e413eeb59f None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:30:47.926373 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86faf8d-5b55-4cb0-ac18-1bb2a5e4aa65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:30:47.926992 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86faf8d-5b55-4cb0-ac18-1bb2a5e4aa65 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:47.927265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86faf8d-5b55-4cb0-ac18-1bb2a5e4aa65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:47.927531 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86faf8d-5b55-4cb0-ac18-1bb2a5e4aa65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:47.936949 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86faf8d-5b55-4cb0-ac18-1bb2a5e4aa65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:30:47.938360 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86faf8d-5b55-4cb0-ac18-1bb2a5e4aa65 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:30:47.948710 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 597/1210] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:30:51.513649 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43b14d-a41f-46ef-b5b3-f905c782f99d None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:51.514185 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43b14d-a41f-46ef-b5b3-f905c782f99d None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:51.514185 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43b14d-a41f-46ef-b5b3-f905c782f99d None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:51.515499 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 614/1211] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 02:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:30:51.520654 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c32e34-eee4-4de3-ad1b-8762d4cdabd9 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:51.521089 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c32e34-eee4-4de3-ad1b-8762d4cdabd9 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:51.521187 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c32e34-eee4-4de3-ad1b-8762d4cdabd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:51.541506 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-a4c32e34-eee4-4de3-ad1b-8762d4cdabd9 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:30:51.542721 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-a4c32e34-eee4-4de3-ad1b-8762d4cdabd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:30:51.550630 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 598/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 02:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:30:51.855389 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43b14d-a41f-46ef-b5b3-f905c782f99d None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:30:51.857108 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-ef43b14d-a41f-46ef-b5b3-f905c782f99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:30:51.861218 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=95 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:30:51.936978 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43b14d-a41f-46ef-b5b3-f905c782f99d None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:30:51.940521 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fa669-090e-4976-b044-f4a588e8005b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:30:51.941120 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fa669-090e-4976-b044-f4a588e8005b service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:51.941400 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fa669-090e-4976-b044-f4a588e8005b service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:51.941670 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fa669-090e-4976-b044-f4a588e8005b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:51.951249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fa669-090e-4976-b044-f4a588e8005b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:30:51.955113 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fa669-090e-4976-b044-f4a588e8005b service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:30:51.962097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 615/1213] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:30:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:30:54.127795 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc1500-0c14-42b5-88f1-43f58d79571e None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:54.128406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc1500-0c14-42b5-88f1-43f58d79571e None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:54.128406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc1500-0c14-42b5-88f1-43f58d79571e None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:54.129913 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 599/1214] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 02:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:30:54.136339 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a6b7e-e74d-44a1-8460-060fa120ce3a None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:54.136821 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a6b7e-e74d-44a1-8460-060fa120ce3a None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:54.136987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a6b7e-e74d-44a1-8460-060fa120ce3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:54.157920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-6f0a6b7e-e74d-44a1-8460-060fa120ce3a None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:30:54.159159 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-6f0a6b7e-e74d-44a1-8460-060fa120ce3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:30:54.167440 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 616/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 02:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:30:54.480765 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc1500-0c14-42b5-88f1-43f58d79571e None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:30:54.482452 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-12cc1500-0c14-42b5-88f1-43f58d79571e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:30:54.496060 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc1500-0c14-42b5-88f1-43f58d79571e None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:30:54.499701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4f90e-6741-47a1-aaf6-359be9f01e10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:30:54.500306 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4f90e-6741-47a1-aaf6-359be9f01e10 service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:30:54.500591 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4f90e-6741-47a1-aaf6-359be9f01e10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:30:54.500865 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4f90e-6741-47a1-aaf6-359be9f01e10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:30:54.509963 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4f90e-6741-47a1-aaf6-359be9f01e10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:30:54.511429 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4f90e-6741-47a1-aaf6-359be9f01e10 service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:30:54.520819 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 600/1216] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:31:04.152830 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=37 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:31:04.516756 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=37 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:28.586841 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c15963-c455-4efe-a56c-5da9a3266dfc None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:28.588626 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c15963-c455-4efe-a56c-5da9a3266dfc None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:28.588626 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c15963-c455-4efe-a56c-5da9a3266dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:28.620324 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-46c15963-c455-4efe-a56c-5da9a3266dfc None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:28.622096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-46c15963-c455-4efe-a56c-5da9a3266dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:28.636415 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 617/1217] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:28.647829 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d0674-64b4-4d3e-8e61-cae01f3dab94 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:28.648448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d0674-64b4-4d3e-8e61-cae01f3dab94 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:28.648448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d0674-64b4-4d3e-8e61-cae01f3dab94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:28.685490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-131d0674-64b4-4d3e-8e61-cae01f3dab94 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:28.686779 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-131d0674-64b4-4d3e-8e61-cae01f3dab94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:28.696641 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 601/1218] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:28.701448 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dfbe4-c601-43b5-89aa-ac5d9d04e62a None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:28.701966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d0674-64b4-4d3e-8e61-cae01f3dab94 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:28.702232 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dfbe4-c601-43b5-89aa-ac5d9d04e62a None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:28.702725 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dfbe4-c601-43b5-89aa-ac5d9d04e62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:28.713024 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d0674-64b4-4d3e-8e61-cae01f3dab94 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:28.721679 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace7352-5862-4452-88f8-fc38dd62397d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:28.722415 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace7352-5862-4452-88f8-fc38dd62397d admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:28.722693 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace7352-5862-4452-88f8-fc38dd62397d admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:28.722991 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace7352-5862-4452-88f8-fc38dd62397d admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:28.723637 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace7352-5862-4452-88f8-fc38dd62397d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:32:28.723936 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace7352-5862-4452-88f8-fc38dd62397d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:28.725054 dv-cinder-861491-4-smb devstack@keystone.service[81671]: WARNING py.warnings [None req-3ace7352-5862-4452-88f8-fc38dd62397d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 02:32:28.725054 dv-cinder-861491-4-smb devstack@keystone.service[81671]: warnings.warn(msg) Oct 19 02:32:28.725054 dv-cinder-861491-4-smb devstack@keystone.service[81671]: Oct 19 02:32:28.725935 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace7352-5862-4452-88f8-fc38dd62397d admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:28.745449 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-5f1dfbe4-c601-43b5-89aa-ac5d9d04e62a None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:28.747251 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-5f1dfbe4-c601-43b5-89aa-ac5d9d04e62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:28.751942 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 602/1219] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:32:28.758449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace7352-5862-4452-88f8-fc38dd62397d admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:28.765098 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 618/1220] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:28.770229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace7352-5862-4452-88f8-fc38dd62397d admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:28.778110 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f0d43-ba7b-4ef5-be5e-3a75c6983ed0 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:28.778713 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f0d43-ba7b-4ef5-be5e-3a75c6983ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:28.779249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f0d43-ba7b-4ef5-be5e-3a75c6983ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:28.787187 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d221dc-03cf-4afa-a7d5-58a915591a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:28.787806 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d221dc-03cf-4afa-a7d5-58a915591a24 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:28.788098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d221dc-03cf-4afa-a7d5-58a915591a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:28.788349 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d221dc-03cf-4afa-a7d5-58a915591a24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:28.788976 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d221dc-03cf-4afa-a7d5-58a915591a24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:28.791255 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d221dc-03cf-4afa-a7d5-58a915591a24 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:28.819488 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-d49f0d43-ba7b-4ef5-be5e-3a75c6983ed0 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:28.821486 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-d49f0d43-ba7b-4ef5-be5e-3a75c6983ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:28.836509 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 619/1221] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:28.841802 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f0d43-ba7b-4ef5-be5e-3a75c6983ed0 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:28.852973 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f0d43-ba7b-4ef5-be5e-3a75c6983ed0 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:28.865669 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414bd2e-51cb-4742-823a-14f97e87ef1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:28.866606 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414bd2e-51cb-4742-823a-14f97e87ef1c admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:28.867103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414bd2e-51cb-4742-823a-14f97e87ef1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:28.867584 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414bd2e-51cb-4742-823a-14f97e87ef1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:28.869249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414bd2e-51cb-4742-823a-14f97e87ef1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:32:28.870446 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414bd2e-51cb-4742-823a-14f97e87ef1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:28.872391 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414bd2e-51cb-4742-823a-14f97e87ef1c admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:28.893459 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 620/1222] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:32:28.894829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b6dc2-40d9-4b82-a2c9-a7f7ed5e2d15 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:28.895137 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b6dc2-40d9-4b82-a2c9-a7f7ed5e2d15 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:28.895416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b6dc2-40d9-4b82-a2c9-a7f7ed5e2d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:28.936184 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-2e7b6dc2-40d9-4b82-a2c9-a7f7ed5e2d15 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:28.937480 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-2e7b6dc2-40d9-4b82-a2c9-a7f7ed5e2d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:28.952993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 621/1223] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:28.953845 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b6dc2-40d9-4b82-a2c9-a7f7ed5e2d15 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:28.955671 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 603/1224] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:32:28 2022] POST /identity/v3/projects => generated 389 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:28.960008 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d221dc-03cf-4afa-a7d5-58a915591a24 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:28.968824 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b6dc2-40d9-4b82-a2c9-a7f7ed5e2d15 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:29.051556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ebeeb-a0c7-4ac8-b2f9-aa5698b4f7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:29.052260 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ebeeb-a0c7-4ac8-b2f9-aa5698b4f7b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.052609 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ebeeb-a0c7-4ac8-b2f9-aa5698b4f7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.052892 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ebeeb-a0c7-4ac8-b2f9-aa5698b4f7b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.053528 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ebeeb-a0c7-4ac8-b2f9-aa5698b4f7b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:29.054562 dv-cinder-861491-4-smb devstack@keystone.service[81670]: WARNING py.warnings [None req-6c1ebeeb-a0c7-4ac8-b2f9-aa5698b4f7b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 02:32:29.054562 dv-cinder-861491-4-smb devstack@keystone.service[81670]: warnings.warn(msg) Oct 19 02:32:29.054562 dv-cinder-861491-4-smb devstack@keystone.service[81670]: Oct 19 02:32:29.055836 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ebeeb-a0c7-4ac8-b2f9-aa5698b4f7b4 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:29.063681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d221dc-03cf-4afa-a7d5-58a915591a24 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:29.070765 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8098db-debd-4a41-a0f2-797931d1af7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:29.071511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8098db-debd-4a41-a0f2-797931d1af7b admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.071904 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8098db-debd-4a41-a0f2-797931d1af7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.072848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8098db-debd-4a41-a0f2-797931d1af7b admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.073548 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8098db-debd-4a41-a0f2-797931d1af7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:29.074549 dv-cinder-861491-4-smb devstack@keystone.service[81671]: WARNING py.warnings [None req-3f8098db-debd-4a41-a0f2-797931d1af7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 02:32:29.074549 dv-cinder-861491-4-smb devstack@keystone.service[81671]: warnings.warn(msg) Oct 19 02:32:29.074549 dv-cinder-861491-4-smb devstack@keystone.service[81671]: Oct 19 02:32:29.075891 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8098db-debd-4a41-a0f2-797931d1af7b admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:29.140580 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 622/1225] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:32:28 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:29.142009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f964-3bc9-409c-bc23-d326682b5c7d None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.142276 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f964-3bc9-409c-bc23-d326682b5c7d None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.142579 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f964-3bc9-409c-bc23-d326682b5c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.162496 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-6d62f964-3bc9-409c-bc23-d326682b5c7d None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:29.164073 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-6d62f964-3bc9-409c-bc23-d326682b5c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:29.167824 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 604/1226] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:32:28 2022] POST /identity/v3/users => generated 295 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:29.169882 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbadc9-4af1-4b03-b4f5-31a27f6fe7b4 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.170180 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbadc9-4af1-4b03-b4f5-31a27f6fe7b4 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.171075 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbadc9-4af1-4b03-b4f5-31a27f6fe7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.191916 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-a4bbadc9-4af1-4b03-b4f5-31a27f6fe7b4 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:29.193138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-a4bbadc9-4af1-4b03-b4f5-31a27f6fe7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:29.237534 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 623/1227] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:29.238832 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7278aa2-ccee-4c50-bc8c-67fff33ea6b2 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.239117 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7278aa2-ccee-4c50-bc8c-67fff33ea6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.239392 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7278aa2-ccee-4c50-bc8c-67fff33ea6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.258711 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-a7278aa2-ccee-4c50-bc8c-67fff33ea6b2 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:29.258951 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 605/1228] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:29.264698 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-a7278aa2-ccee-4c50-bc8c-67fff33ea6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:29.264808 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8687a-b1b2-47ad-8c7d-ebb0b0ad5fd8 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.264808 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8687a-b1b2-47ad-8c7d-ebb0b0ad5fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.264808 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8687a-b1b2-47ad-8c7d-ebb0b0ad5fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.271994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 624/1229] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:29.273206 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32fff3-4b6e-4143-b42e-31dd6df07365 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.273485 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32fff3-4b6e-4143-b42e-31dd6df07365 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.273758 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32fff3-4b6e-4143-b42e-31dd6df07365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.282350 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-81a8687a-b1b2-47ad-8c7d-ebb0b0ad5fd8 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:29.283579 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-81a8687a-b1b2-47ad-8c7d-ebb0b0ad5fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:29.291961 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 606/1230] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:29.293036 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b4ffa-9e41-4c99-9d72-2de3c0b94110 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.293312 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b4ffa-9e41-4c99-9d72-2de3c0b94110 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.293578 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b4ffa-9e41-4c99-9d72-2de3c0b94110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.301684 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-ea32fff3-4b6e-4143-b42e-31dd6df07365 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:29.303263 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-ea32fff3-4b6e-4143-b42e-31dd6df07365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:29.311775 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 625/1231] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:29.312703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32fff3-4b6e-4143-b42e-31dd6df07365 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:29.319918 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-8d9b4ffa-9e41-4c99-9d72-2de3c0b94110 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:29.321177 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-8d9b4ffa-9e41-4c99-9d72-2de3c0b94110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:29.323426 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32fff3-4b6e-4143-b42e-31dd6df07365 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:29.327947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c68a9-a54f-4364-82d5-58832c765829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:29.328539 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c68a9-a54f-4364-82d5-58832c765829 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.328812 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c68a9-a54f-4364-82d5-58832c765829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.329077 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c68a9-a54f-4364-82d5-58832c765829 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.329702 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c68a9-a54f-4364-82d5-58832c765829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:29.329819 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 607/1232] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:29.330572 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b4ffa-9e41-4c99-9d72-2de3c0b94110 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:29.331646 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c68a9-a54f-4364-82d5-58832c765829 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:29.343780 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b4ffa-9e41-4c99-9d72-2de3c0b94110 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:29.348800 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdf260-6af8-4263-9b86-c68404a81013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:29.349421 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdf260-6af8-4263-9b86-c68404a81013 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.349693 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdf260-6af8-4263-9b86-c68404a81013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.349958 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdf260-6af8-4263-9b86-c68404a81013 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.350595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdf260-6af8-4263-9b86-c68404a81013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:29.352326 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdf260-6af8-4263-9b86-c68404a81013 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:29.363000 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 608/1233] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:29.363712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdf260-6af8-4263-9b86-c68404a81013 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:29.373580 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdf260-6af8-4263-9b86-c68404a81013 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:29.378319 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5c4fb-bfd1-4f5b-8ac1-b5ae36428de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:29.378939 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5c4fb-bfd1-4f5b-8ac1-b5ae36428de9 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.379212 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5c4fb-bfd1-4f5b-8ac1-b5ae36428de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.379476 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5c4fb-bfd1-4f5b-8ac1-b5ae36428de9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.380086 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5c4fb-bfd1-4f5b-8ac1-b5ae36428de9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:32:29.380379 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5c4fb-bfd1-4f5b-8ac1-b5ae36428de9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:29.381899 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5c4fb-bfd1-4f5b-8ac1-b5ae36428de9 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:29.393738 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 609/1234] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:32:29.394862 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c888632-bf16-4604-8712-ba5fbd616394 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.395145 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c888632-bf16-4604-8712-ba5fbd616394 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.395411 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c888632-bf16-4604-8712-ba5fbd616394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.403070 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:29.414864 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-9c888632-bf16-4604-8712-ba5fbd616394 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:29.416778 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-9c888632-bf16-4604-8712-ba5fbd616394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:29.424883 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 626/1235] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:32:29 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:29.426263 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6be57-5057-45b3-9f4c-60984fd411c7 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.426576 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6be57-5057-45b3-9f4c-60984fd411c7 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.426865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6be57-5057-45b3-9f4c-60984fd411c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.428247 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 610/1236] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:29.429445 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25331f1-54a1-47b6-9f87-98ea904dbef7 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.429751 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25331f1-54a1-47b6-9f87-98ea904dbef7 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.430018 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25331f1-54a1-47b6-9f87-98ea904dbef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.450460 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-5dd6be57-5057-45b3-9f4c-60984fd411c7 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:29.452880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-d25331f1-54a1-47b6-9f87-98ea904dbef7 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:29.453057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-5dd6be57-5057-45b3-9f4c-60984fd411c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:29.453161 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-d25331f1-54a1-47b6-9f87-98ea904dbef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:29.459616 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 627/1237] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:29.464173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 611/1238] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:29.464348 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21417780-22dd-44da-9436-f045b2c94816 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.464348 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21417780-22dd-44da-9436-f045b2c94816 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.464348 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21417780-22dd-44da-9436-f045b2c94816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.464623 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e74ed-ebda-4249-9bae-7cc572bd4154 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.464623 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e74ed-ebda-4249-9bae-7cc572bd4154 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.464623 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e74ed-ebda-4249-9bae-7cc572bd4154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.482208 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-f21e74ed-ebda-4249-9bae-7cc572bd4154 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:29.482393 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-21417780-22dd-44da-9436-f045b2c94816 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:29.483455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-f21e74ed-ebda-4249-9bae-7cc572bd4154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:29.483602 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-21417780-22dd-44da-9436-f045b2c94816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:29.491383 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 612/1239] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:29.491655 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 628/1240] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:29.492242 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e74ed-ebda-4249-9bae-7cc572bd4154 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:29.492425 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21417780-22dd-44da-9436-f045b2c94816 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:29.498176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:29.503041 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21417780-22dd-44da-9436-f045b2c94816 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:29.503274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e74ed-ebda-4249-9bae-7cc572bd4154 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:29.507906 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738876a9-cdb9-499f-b17c-531d986bcebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:29.510206 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee7e59-057d-44f6-adb0-2a5bde23dd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:29.510333 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738876a9-cdb9-499f-b17c-531d986bcebb admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.510333 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738876a9-cdb9-499f-b17c-531d986bcebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.510333 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738876a9-cdb9-499f-b17c-531d986bcebb admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.510608 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee7e59-057d-44f6-adb0-2a5bde23dd3e admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.510608 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee7e59-057d-44f6-adb0-2a5bde23dd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.510794 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738876a9-cdb9-499f-b17c-531d986bcebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:29.510912 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee7e59-057d-44f6-adb0-2a5bde23dd3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.510912 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee7e59-057d-44f6-adb0-2a5bde23dd3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:29.511580 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738876a9-cdb9-499f-b17c-531d986bcebb admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:29.512471 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee7e59-057d-44f6-adb0-2a5bde23dd3e admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:29.526048 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 613/1241] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:29.526048 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738876a9-cdb9-499f-b17c-531d986bcebb admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:29.537443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738876a9-cdb9-499f-b17c-531d986bcebb admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:29.542360 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8320cb6-92de-4df2-88d1-265ac4364644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:29.545536 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8320cb6-92de-4df2-88d1-265ac4364644 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.545536 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8320cb6-92de-4df2-88d1-265ac4364644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.545536 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8320cb6-92de-4df2-88d1-265ac4364644 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.545536 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8320cb6-92de-4df2-88d1-265ac4364644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:29.546470 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8320cb6-92de-4df2-88d1-265ac4364644 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:29.560052 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 614/1242] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:29.560052 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8320cb6-92de-4df2-88d1-265ac4364644 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:29.567514 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8320cb6-92de-4df2-88d1-265ac4364644 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:29.572152 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f65a26-1ad1-47d9-95c6-115b9d6d8f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:29.572745 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f65a26-1ad1-47d9-95c6-115b9d6d8f5c admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.573006 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f65a26-1ad1-47d9-95c6-115b9d6d8f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.573281 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f65a26-1ad1-47d9-95c6-115b9d6d8f5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.573911 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f65a26-1ad1-47d9-95c6-115b9d6d8f5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:32:29.574210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f65a26-1ad1-47d9-95c6-115b9d6d8f5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:29.575815 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f65a26-1ad1-47d9-95c6-115b9d6d8f5c admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:29.588504 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 615/1243] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:32:29.589304 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f65a26-1ad1-47d9-95c6-115b9d6d8f5c admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:29.604022 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f65a26-1ad1-47d9-95c6-115b9d6d8f5c admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:29.608705 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6062fd-7dc0-4967-b091-03e0b26e3e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:29.613421 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6062fd-7dc0-4967-b091-03e0b26e3e25 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.613421 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6062fd-7dc0-4967-b091-03e0b26e3e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.613421 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6062fd-7dc0-4967-b091-03e0b26e3e25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.613421 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6062fd-7dc0-4967-b091-03e0b26e3e25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:32:29.613421 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6062fd-7dc0-4967-b091-03e0b26e3e25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:29.613421 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6062fd-7dc0-4967-b091-03e0b26e3e25 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:29.623952 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 616/1244] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:32:29.624760 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6062fd-7dc0-4967-b091-03e0b26e3e25 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:29.634068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6062fd-7dc0-4967-b091-03e0b26e3e25 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:29.638646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5929222-a73c-47f4-a9f3-fdbcd2face1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:29.645497 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5929222-a73c-47f4-a9f3-fdbcd2face1f admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.645497 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5929222-a73c-47f4-a9f3-fdbcd2face1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.645497 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5929222-a73c-47f4-a9f3-fdbcd2face1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.645497 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5929222-a73c-47f4-a9f3-fdbcd2face1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:32:29.645497 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5929222-a73c-47f4-a9f3-fdbcd2face1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:29.645497 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5929222-a73c-47f4-a9f3-fdbcd2face1f admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:29.646031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 629/1245] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:32:29 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:29.646031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee7e59-057d-44f6-adb0-2a5bde23dd3e admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:29.662047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 617/1246] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:32:29.662047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5929222-a73c-47f4-a9f3-fdbcd2face1f admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:29.665308 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5929222-a73c-47f4-a9f3-fdbcd2face1f admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:29.722843 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee7e59-057d-44f6-adb0-2a5bde23dd3e admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:29.725420 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b474825-0e9a-4dcf-95d4-aa2dd6912ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:29.726031 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b474825-0e9a-4dcf-95d4-aa2dd6912ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.726303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b474825-0e9a-4dcf-95d4-aa2dd6912ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.726569 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b474825-0e9a-4dcf-95d4-aa2dd6912ef2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.727225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b474825-0e9a-4dcf-95d4-aa2dd6912ef2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:32:29.727522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b474825-0e9a-4dcf-95d4-aa2dd6912ef2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:29.727620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f2167-eb7e-4989-9799-99301db0aef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:29.728210 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f2167-eb7e-4989-9799-99301db0aef6 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.728547 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f2167-eb7e-4989-9799-99301db0aef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.728872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f2167-eb7e-4989-9799-99301db0aef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.729518 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f2167-eb7e-4989-9799-99301db0aef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:32:29.729615 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b474825-0e9a-4dcf-95d4-aa2dd6912ef2 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:29.729822 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f2167-eb7e-4989-9799-99301db0aef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:29.731520 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f2167-eb7e-4989-9799-99301db0aef6 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:29.741494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 618/1247] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:32:29.742266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b474825-0e9a-4dcf-95d4-aa2dd6912ef2 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:29.750488 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 630/1248] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:32:29.750488 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f2167-eb7e-4989-9799-99301db0aef6 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:29.759654 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b474825-0e9a-4dcf-95d4-aa2dd6912ef2 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:29.762673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f2167-eb7e-4989-9799-99301db0aef6 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:29.764371 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd54e3d-31c8-4785-81a3-20d574b39044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:29.765019 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd54e3d-31c8-4785-81a3-20d574b39044 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.771484 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd54e3d-31c8-4785-81a3-20d574b39044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.771484 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd54e3d-31c8-4785-81a3-20d574b39044 admin admin] PATH_INFO: `/v3/projects/e840ffd2c4ab4157aff7dcb9725818cb/users/5eabc00f209a48f88e8e2ca28dd3e8df/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.771774 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24b4a3-57db-4bb8-a22f-295bd75bd652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:29.771774 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24b4a3-57db-4bb8-a22f-295bd75bd652 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.771774 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24b4a3-57db-4bb8-a22f-295bd75bd652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.771774 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24b4a3-57db-4bb8-a22f-295bd75bd652 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.772127 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24b4a3-57db-4bb8-a22f-295bd75bd652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:29.773410 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24b4a3-57db-4bb8-a22f-295bd75bd652 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:29.782494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd54e3d-31c8-4785-81a3-20d574b39044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e840ffd2c4ab4157aff7dcb9725818cb, user_id=5eabc00f209a48f88e8e2ca28dd3e8df, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:29.785183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd54e3d-31c8-4785-81a3-20d574b39044 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:29.785636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 631/1249] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:29.786411 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24b4a3-57db-4bb8-a22f-295bd75bd652 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:29.797257 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24b4a3-57db-4bb8-a22f-295bd75bd652 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:29.802002 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97c669-9143-498d-8438-11a6098108e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:29.802581 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97c669-9143-498d-8438-11a6098108e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.802896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97c669-9143-498d-8438-11a6098108e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.803170 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97c669-9143-498d-8438-11a6098108e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:29.803793 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97c669-9143-498d-8438-11a6098108e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:29.805669 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97c669-9143-498d-8438-11a6098108e9 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:29.892287 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 619/1250] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:32:29 2022] PUT /identity/v3/projects/e840ffd2c4ab4157aff7dcb9725818cb/users/5eabc00f209a48f88e8e2ca28dd3e8df/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:29.893071 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd54e3d-31c8-4785-81a3-20d574b39044 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:29.922421 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 632/1251] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:32:29 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:29.922421 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97c669-9143-498d-8438-11a6098108e9 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:29.945159 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:29.961850 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd54e3d-31c8-4785-81a3-20d574b39044 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:29.993811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97c669-9143-498d-8438-11a6098108e9 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:29.998528 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869052f6-ab5b-400c-a20e-fa65d3368910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:29.999165 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869052f6-ab5b-400c-a20e-fa65d3368910 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:29.999443 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869052f6-ab5b-400c-a20e-fa65d3368910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:29.999711 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869052f6-ab5b-400c-a20e-fa65d3368910 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:30.000335 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869052f6-ab5b-400c-a20e-fa65d3368910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:30.002296 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869052f6-ab5b-400c-a20e-fa65d3368910 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:30.025111 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71099b1f-45eb-49de-83cb-eaa841e42bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:30.025722 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71099b1f-45eb-49de-83cb-eaa841e42bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:30.025999 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71099b1f-45eb-49de-83cb-eaa841e42bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:30.026270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71099b1f-45eb-49de-83cb-eaa841e42bc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:30.026930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71099b1f-45eb-49de-83cb-eaa841e42bc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:30.028844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71099b1f-45eb-49de-83cb-eaa841e42bc6 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:30.086847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 633/1252] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:32:29 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:30.087712 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869052f6-ab5b-400c-a20e-fa65d3368910 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:30.097497 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869052f6-ab5b-400c-a20e-fa65d3368910 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:30.102310 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f1bbb-6392-4a8a-80e5-d9d46bd94d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:30.103541 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f1bbb-6392-4a8a-80e5-d9d46bd94d96 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:30.104347 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f1bbb-6392-4a8a-80e5-d9d46bd94d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:30.104625 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f1bbb-6392-4a8a-80e5-d9d46bd94d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:30.105251 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f1bbb-6392-4a8a-80e5-d9d46bd94d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:30.107225 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f1bbb-6392-4a8a-80e5-d9d46bd94d96 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:30.122803 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 620/1253] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:32:29 2022] POST /identity/v3/projects => generated 373 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:30.123642 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71099b1f-45eb-49de-83cb-eaa841e42bc6 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:30.186387 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71099b1f-45eb-49de-83cb-eaa841e42bc6 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:30.191108 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74854ae-ac0e-41aa-9250-8c0ebb65a9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:30.191714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74854ae-ac0e-41aa-9250-8c0ebb65a9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:30.191993 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74854ae-ac0e-41aa-9250-8c0ebb65a9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:30.192265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74854ae-ac0e-41aa-9250-8c0ebb65a9b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:30.192957 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74854ae-ac0e-41aa-9250-8c0ebb65a9b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:30.194910 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74854ae-ac0e-41aa-9250-8c0ebb65a9b0 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:30.221354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 634/1254] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:32:30 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:30.222057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f1bbb-6392-4a8a-80e5-d9d46bd94d96 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:30.232761 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:30.274425 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 621/1255] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:32:30 2022] POST /identity/v3/projects => generated 393 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:30.274425 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74854ae-ac0e-41aa-9250-8c0ebb65a9b0 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:30.289549 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f1bbb-6392-4a8a-80e5-d9d46bd94d96 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:30.335764 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74854ae-ac0e-41aa-9250-8c0ebb65a9b0 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:30.340927 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee4d78-62ad-4f7c-bb98-0b60c8077752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:30.341632 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee4d78-62ad-4f7c-bb98-0b60c8077752 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:30.341914 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee4d78-62ad-4f7c-bb98-0b60c8077752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:30.342180 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee4d78-62ad-4f7c-bb98-0b60c8077752 admin admin] PATH_INFO: `/v3/projects/aef20a912464440f86c4660de7c8a1ac/users/c1bb331f86884db48dbe8d2d2f70d15f/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:30.349175 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18347e08-02b0-45e8-84c1-f02198df46e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:30.349783 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18347e08-02b0-45e8-84c1-f02198df46e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:30.350058 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18347e08-02b0-45e8-84c1-f02198df46e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:30.350329 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18347e08-02b0-45e8-84c1-f02198df46e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:30.350987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18347e08-02b0-45e8-84c1-f02198df46e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:30.352945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18347e08-02b0-45e8-84c1-f02198df46e1 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:30.358512 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:30.358512 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee4d78-62ad-4f7c-bb98-0b60c8077752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef20a912464440f86c4660de7c8a1ac, user_id=c1bb331f86884db48dbe8d2d2f70d15f, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:30.360356 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee4d78-62ad-4f7c-bb98-0b60c8077752 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:30.486389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 622/1256] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:32:30 2022] PUT /identity/v3/projects/aef20a912464440f86c4660de7c8a1ac/users/c1bb331f86884db48dbe8d2d2f70d15f/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:30.491051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dead973-6ff8-463c-a6ca-3cdc382f6499 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:30.491228 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 635/1257] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:32:30 2022] POST /identity/v3/projects => generated 363 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:30.491335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dead973-6ff8-463c-a6ca-3cdc382f6499 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:30.491335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dead973-6ff8-463c-a6ca-3cdc382f6499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:30.491555 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18347e08-02b0-45e8-84c1-f02198df46e1 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:30.508549 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-3dead973-6ff8-463c-a6ca-3cdc382f6499 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:30.510739 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-3dead973-6ff8-463c-a6ca-3cdc382f6499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:30.553952 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18347e08-02b0-45e8-84c1-f02198df46e1 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:30.560951 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737412cf-e525-4389-95ef-447c7932d0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:30.564724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737412cf-e525-4389-95ef-447c7932d0e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:30.564724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737412cf-e525-4389-95ef-447c7932d0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:30.564724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737412cf-e525-4389-95ef-447c7932d0e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:30.564724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737412cf-e525-4389-95ef-447c7932d0e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:30.565113 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737412cf-e525-4389-95ef-447c7932d0e8 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:30.569323 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 623/1258] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:30.570154 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dead973-6ff8-463c-a6ca-3cdc382f6499 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:30.580690 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dead973-6ff8-463c-a6ca-3cdc382f6499 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:30.585429 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d50a9-a485-429d-b2cf-1e94ed7849e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:30.586024 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d50a9-a485-429d-b2cf-1e94ed7849e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:30.586300 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d50a9-a485-429d-b2cf-1e94ed7849e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:30.586569 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d50a9-a485-429d-b2cf-1e94ed7849e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:30.587268 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d50a9-a485-429d-b2cf-1e94ed7849e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:30.588878 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d50a9-a485-429d-b2cf-1e94ed7849e0 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:30.598685 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 624/1259] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:30.599516 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d50a9-a485-429d-b2cf-1e94ed7849e0 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:30.608821 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d50a9-a485-429d-b2cf-1e94ed7849e0 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:30.613393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29284f1-ef95-46af-b10f-59f9abf3f2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:30.616281 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29284f1-ef95-46af-b10f-59f9abf3f2c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:30.616281 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29284f1-ef95-46af-b10f-59f9abf3f2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:30.616281 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29284f1-ef95-46af-b10f-59f9abf3f2c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:30.616281 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29284f1-ef95-46af-b10f-59f9abf3f2c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:30.616926 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29284f1-ef95-46af-b10f-59f9abf3f2c1 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:30.721398 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 636/1260] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:32:30 2022] POST /identity/v3/users => generated 292 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:30.722429 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737412cf-e525-4389-95ef-447c7932d0e8 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:30.732692 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737412cf-e525-4389-95ef-447c7932d0e8 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:30.737621 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf2c5d-cf0c-4e84-a6ce-2b69c762aaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:30.738229 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf2c5d-cf0c-4e84-a6ce-2b69c762aaf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:30.738538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf2c5d-cf0c-4e84-a6ce-2b69c762aaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:30.738809 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf2c5d-cf0c-4e84-a6ce-2b69c762aaf4 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:30.739483 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf2c5d-cf0c-4e84-a6ce-2b69c762aaf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:30.741399 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf2c5d-cf0c-4e84-a6ce-2b69c762aaf4 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:30.746337 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 625/1261] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:32:30 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:30.746337 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29284f1-ef95-46af-b10f-59f9abf3f2c1 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:30.756301 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29284f1-ef95-46af-b10f-59f9abf3f2c1 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:30.761535 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc8721-e342-460b-be2c-2c1de4e2b21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:30.762113 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc8721-e342-460b-be2c-2c1de4e2b21c admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:30.762385 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc8721-e342-460b-be2c-2c1de4e2b21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:30.762650 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc8721-e342-460b-be2c-2c1de4e2b21c admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:30.763311 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc8721-e342-460b-be2c-2c1de4e2b21c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:30.765282 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc8721-e342-460b-be2c-2c1de4e2b21c admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:30.814319 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 637/1262] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:32:30 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:30.815618 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66f98e-bb12-498d-8134-7a56fa973e13 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:30.815898 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66f98e-bb12-498d-8134-7a56fa973e13 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:30.816167 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66f98e-bb12-498d-8134-7a56fa973e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:30.835752 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-1e66f98e-bb12-498d-8134-7a56fa973e13 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:30.836958 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-1e66f98e-bb12-498d-8134-7a56fa973e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:30.841252 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 626/1263] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:32:30 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:30.842144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc8721-e342-460b-be2c-2c1de4e2b21c admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:30.846341 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 638/1264] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:30.847147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66f98e-bb12-498d-8134-7a56fa973e13 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:30.850169 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-1e66f98e-bb12-498d-8134-7a56fa973e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:30.858937 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:30.859920 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc8721-e342-460b-be2c-2c1de4e2b21c admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:30.864710 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf518ba6-7f43-49cc-b7cc-584dc7da458a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:30.865309 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf518ba6-7f43-49cc-b7cc-584dc7da458a admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:30.865588 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf518ba6-7f43-49cc-b7cc-584dc7da458a admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:30.865861 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf518ba6-7f43-49cc-b7cc-584dc7da458a admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:30.866490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf518ba6-7f43-49cc-b7cc-584dc7da458a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:30.869153 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf518ba6-7f43-49cc-b7cc-584dc7da458a admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:30.907283 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66f98e-bb12-498d-8134-7a56fa973e13 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:30.910866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e21bb5-83a8-4a55-8472-16d89689d199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:30.911467 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e21bb5-83a8-4a55-8472-16d89689d199 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:30.911759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e21bb5-83a8-4a55-8472-16d89689d199 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:30.912008 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e21bb5-83a8-4a55-8472-16d89689d199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:30.921918 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e21bb5-83a8-4a55-8472-16d89689d199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:30.923380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e21bb5-83a8-4a55-8472-16d89689d199 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:30.933660 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 639/1265] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:32:30.934682 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e21bb5-83a8-4a55-8472-16d89689d199 service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:30.943514 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e21bb5-83a8-4a55-8472-16d89689d199 service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:30.948831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361be829-a9e0-4423-9ee3-00299b9fc2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:30.949415 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361be829-a9e0-4423-9ee3-00299b9fc2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:30.949688 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361be829-a9e0-4423-9ee3-00299b9fc2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:30.949956 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361be829-a9e0-4423-9ee3-00299b9fc2a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:30.950586 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361be829-a9e0-4423-9ee3-00299b9fc2a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:30.952040 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 627/1266] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:32:30 2022] POST /identity/v3/users => generated 282 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:30.952583 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361be829-a9e0-4423-9ee3-00299b9fc2a3 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:30.953409 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf518ba6-7f43-49cc-b7cc-584dc7da458a admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:30.966845 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 640/1267] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:30.967082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf518ba6-7f43-49cc-b7cc-584dc7da458a admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:30.968040 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361be829-a9e0-4423-9ee3-00299b9fc2a3 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:30.972383 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af65b9-dc2a-46ed-be94-e753da393903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:30.973012 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af65b9-dc2a-46ed-be94-e753da393903 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:30.973322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af65b9-dc2a-46ed-be94-e753da393903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:30.973600 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af65b9-dc2a-46ed-be94-e753da393903 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:30.974246 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af65b9-dc2a-46ed-be94-e753da393903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:30.975900 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af65b9-dc2a-46ed-be94-e753da393903 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:30.978641 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361be829-a9e0-4423-9ee3-00299b9fc2a3 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:30.983406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1d415-189f-4d44-8a9b-bfdcccf4fa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:30.984003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1d415-189f-4d44-8a9b-bfdcccf4fa3c admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:30.984283 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1d415-189f-4d44-8a9b-bfdcccf4fa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:30.984559 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1d415-189f-4d44-8a9b-bfdcccf4fa3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:30.985195 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1d415-189f-4d44-8a9b-bfdcccf4fa3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:30.986689 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 628/1268] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:30.986892 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1d415-189f-4d44-8a9b-bfdcccf4fa3c admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:30.987585 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af65b9-dc2a-46ed-be94-e753da393903 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:31.000546 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 641/1269] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:31.000546 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1d415-189f-4d44-8a9b-bfdcccf4fa3c admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:31.003258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af65b9-dc2a-46ed-be94-e753da393903 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:31.007953 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe66f14-59ff-4646-be06-66f995a3ee7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:31.008290 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1d415-189f-4d44-8a9b-bfdcccf4fa3c admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:31.008648 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe66f14-59ff-4646-be06-66f995a3ee7c admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:31.008932 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe66f14-59ff-4646-be06-66f995a3ee7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:31.009252 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe66f14-59ff-4646-be06-66f995a3ee7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:31.009898 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe66f14-59ff-4646-be06-66f995a3ee7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:31.011528 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe66f14-59ff-4646-be06-66f995a3ee7c admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:31.013304 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d31224-e82e-4877-b0f0-a51959b94685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:31.013886 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d31224-e82e-4877-b0f0-a51959b94685 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:31.014206 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d31224-e82e-4877-b0f0-a51959b94685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:31.014518 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d31224-e82e-4877-b0f0-a51959b94685 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:31.015313 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d31224-e82e-4877-b0f0-a51959b94685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:31.016942 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d31224-e82e-4877-b0f0-a51959b94685 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:31.023481 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 629/1270] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:31.024271 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe66f14-59ff-4646-be06-66f995a3ee7c admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:31.031680 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 642/1271] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:31.031680 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d31224-e82e-4877-b0f0-a51959b94685 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:31.037309 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe66f14-59ff-4646-be06-66f995a3ee7c admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:31.041487 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79734a90-ad69-4563-9157-ad1530a99c14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:31.042090 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79734a90-ad69-4563-9157-ad1530a99c14 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:31.042365 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79734a90-ad69-4563-9157-ad1530a99c14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:31.042633 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79734a90-ad69-4563-9157-ad1530a99c14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:31.043115 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d31224-e82e-4877-b0f0-a51959b94685 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:31.048047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bec85f-fd3e-4edf-876b-07de8e940f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:31.048714 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bec85f-fd3e-4edf-876b-07de8e940f3d admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:31.049172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bec85f-fd3e-4edf-876b-07de8e940f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:31.049506 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bec85f-fd3e-4edf-876b-07de8e940f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:31.050623 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bec85f-fd3e-4edf-876b-07de8e940f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:31.052309 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bec85f-fd3e-4edf-876b-07de8e940f3d admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:31.052690 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79734a90-ad69-4563-9157-ad1530a99c14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:31.054133 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79734a90-ad69-4563-9157-ad1530a99c14 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:31.064905 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 643/1272] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:31.065725 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 630/1273] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:32:31.065866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bec85f-fd3e-4edf-876b-07de8e940f3d admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:31.066460 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79734a90-ad69-4563-9157-ad1530a99c14 service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:31.077633 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79734a90-ad69-4563-9157-ad1530a99c14 service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:31.078919 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bec85f-fd3e-4edf-876b-07de8e940f3d admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:31.083927 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93880272-2c65-4611-af77-ecfa5c7fdf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:31.084530 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93880272-2c65-4611-af77-ecfa5c7fdf34 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:31.084811 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93880272-2c65-4611-af77-ecfa5c7fdf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:31.085087 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93880272-2c65-4611-af77-ecfa5c7fdf34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:31.085732 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93880272-2c65-4611-af77-ecfa5c7fdf34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:31.087640 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93880272-2c65-4611-af77-ecfa5c7fdf34 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:31.087914 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa152a6-5858-499d-af50-3f0806567424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:31.088741 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa152a6-5858-499d-af50-3f0806567424 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:31.089354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa152a6-5858-499d-af50-3f0806567424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:31.090179 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa152a6-5858-499d-af50-3f0806567424 admin admin] PATH_INFO: `/v3/projects/df05142293ce4544b0a1a042139bcff1/users/4e5c1ceb415a47fb81c7226508f011ce/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:31.098712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 631/1274] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:31.099591 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93880272-2c65-4611-af77-ecfa5c7fdf34 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:31.108516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa152a6-5858-499d-af50-3f0806567424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df05142293ce4544b0a1a042139bcff1, user_id=4e5c1ceb415a47fb81c7226508f011ce, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:31.112425 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa152a6-5858-499d-af50-3f0806567424 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:31.112559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93880272-2c65-4611-af77-ecfa5c7fdf34 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:31.117858 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e155c38-9178-44e7-b3c1-c2870b70c726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:31.119132 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e155c38-9178-44e7-b3c1-c2870b70c726 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:31.124804 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e155c38-9178-44e7-b3c1-c2870b70c726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:31.124804 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e155c38-9178-44e7-b3c1-c2870b70c726 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:31.124804 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e155c38-9178-44e7-b3c1-c2870b70c726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:31.124804 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e155c38-9178-44e7-b3c1-c2870b70c726 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:31.136806 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 632/1275] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:31.136806 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e155c38-9178-44e7-b3c1-c2870b70c726 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:31.146269 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e155c38-9178-44e7-b3c1-c2870b70c726 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:31.151879 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6e386-df35-44bc-b63b-3852817edce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:31.158985 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6e386-df35-44bc-b63b-3852817edce1 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:31.158985 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6e386-df35-44bc-b63b-3852817edce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:31.158985 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6e386-df35-44bc-b63b-3852817edce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:31.158985 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6e386-df35-44bc-b63b-3852817edce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:31.158985 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6e386-df35-44bc-b63b-3852817edce1 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:31.169542 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 633/1276] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:31.169542 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6e386-df35-44bc-b63b-3852817edce1 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:31.177312 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6e386-df35-44bc-b63b-3852817edce1 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:31.182695 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b0cfc-bbe6-4842-b0ab-bf326294e684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:31.183330 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b0cfc-bbe6-4842-b0ab-bf326294e684 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:31.183614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b0cfc-bbe6-4842-b0ab-bf326294e684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:31.183886 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b0cfc-bbe6-4842-b0ab-bf326294e684 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:31.184836 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b0cfc-bbe6-4842-b0ab-bf326294e684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:31.186413 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b0cfc-bbe6-4842-b0ab-bf326294e684 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:31.196384 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 634/1277] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:31.198073 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b0cfc-bbe6-4842-b0ab-bf326294e684 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:31.207458 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b0cfc-bbe6-4842-b0ab-bf326294e684 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:31.212110 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87c1a7-0322-47a6-a89b-0d9b227a2180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:31.212889 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87c1a7-0322-47a6-a89b-0d9b227a2180 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:31.213174 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87c1a7-0322-47a6-a89b-0d9b227a2180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:31.213447 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87c1a7-0322-47a6-a89b-0d9b227a2180 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:31.214082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87c1a7-0322-47a6-a89b-0d9b227a2180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:31.220906 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87c1a7-0322-47a6-a89b-0d9b227a2180 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:31.220906 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:31.224602 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 644/1278] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:32:31 2022] PUT /identity/v3/projects/df05142293ce4544b0a1a042139bcff1/users/4e5c1ceb415a47fb81c7226508f011ce/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:31.229518 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 635/1279] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:31.229518 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87c1a7-0322-47a6-a89b-0d9b227a2180 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:31.229784 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa152a6-5858-499d-af50-3f0806567424 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:31.238998 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87c1a7-0322-47a6-a89b-0d9b227a2180 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:31.298095 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa152a6-5858-499d-af50-3f0806567424 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:31.303570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79008317-181a-44b4-a558-e1b97c3fb73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:31.303835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc6902-96e3-4b17-a57e-48dca559f333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:31.304344 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79008317-181a-44b4-a558-e1b97c3fb73b admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:31.304625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79008317-181a-44b4-a558-e1b97c3fb73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:31.304739 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc6902-96e3-4b17-a57e-48dca559f333 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:31.304898 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79008317-181a-44b4-a558-e1b97c3fb73b admin admin] PATH_INFO: `/v3/projects/2a39a1381f2d46b5adf2b5eaa22401c8/users/73e43b74f01f49dfb18d144f6cf98b5d/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:31.305159 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc6902-96e3-4b17-a57e-48dca559f333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:31.305531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc6902-96e3-4b17-a57e-48dca559f333 admin admin] PATH_INFO: `/v3/projects/ec47d6d0778d46ab9586bcaf8beb29a3/users/77bb955e7c7742af9fae5a3e3ef9a662/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:31.324307 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc6902-96e3-4b17-a57e-48dca559f333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec47d6d0778d46ab9586bcaf8beb29a3, user_id=77bb955e7c7742af9fae5a3e3ef9a662, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:31.324524 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79008317-181a-44b4-a558-e1b97c3fb73b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a39a1381f2d46b5adf2b5eaa22401c8, user_id=73e43b74f01f49dfb18d144f6cf98b5d, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:31.327065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79008317-181a-44b4-a558-e1b97c3fb73b admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:31.327534 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc6902-96e3-4b17-a57e-48dca559f333 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:31.409346 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 636/1281] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:32:31 2022] PUT /identity/v3/projects/2a39a1381f2d46b5adf2b5eaa22401c8/users/73e43b74f01f49dfb18d144f6cf98b5d/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:31.422569 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 645/1281] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:32:31 2022] PUT /identity/v3/projects/ec47d6d0778d46ab9586bcaf8beb29a3/users/77bb955e7c7742af9fae5a3e3ef9a662/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:31.422569 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc6902-96e3-4b17-a57e-48dca559f333 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:31.424506 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79008317-181a-44b4-a558-e1b97c3fb73b admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:31.459179 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:31.518373 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc6902-96e3-4b17-a57e-48dca559f333 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:31.528453 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0279f71-74e4-4b5c-8593-259dbd1f3572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:31.529863 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0279f71-74e4-4b5c-8593-259dbd1f3572 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:31.530567 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0279f71-74e4-4b5c-8593-259dbd1f3572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:31.531344 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0279f71-74e4-4b5c-8593-259dbd1f3572 admin admin] PATH_INFO: `/v3/projects/da4eb48b5e684c83ab0f80f750ff5ce4/users/957c2af4324a43c48637bb2792ca3fe9/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:31.531605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79008317-181a-44b4-a558-e1b97c3fb73b admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:31.538418 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1750c4-788e-4d92-bdab-28b608834ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:31.539487 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1750c4-788e-4d92-bdab-28b608834ebe admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:31.539934 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1750c4-788e-4d92-bdab-28b608834ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:31.540904 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1750c4-788e-4d92-bdab-28b608834ebe admin admin] PATH_INFO: `/v3/projects/e555f689df1f4700897e7e501dc49f7e/users/34ba60c6edb94c27bbd01819da05acd2/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:31.557261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0279f71-74e4-4b5c-8593-259dbd1f3572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da4eb48b5e684c83ab0f80f750ff5ce4, user_id=957c2af4324a43c48637bb2792ca3fe9, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:31.560742 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0279f71-74e4-4b5c-8593-259dbd1f3572 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:31.562803 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1750c4-788e-4d92-bdab-28b608834ebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e555f689df1f4700897e7e501dc49f7e, user_id=34ba60c6edb94c27bbd01819da05acd2, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:31.565566 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1750c4-788e-4d92-bdab-28b608834ebe admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:31.664789 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 646/1282] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:32:31 2022] PUT /identity/v3/projects/da4eb48b5e684c83ab0f80f750ff5ce4/users/957c2af4324a43c48637bb2792ca3fe9/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:31.666588 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343cf71-204c-4cdb-9531-5f8cd6c2b1ee None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:31.667034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343cf71-204c-4cdb-9531-5f8cd6c2b1ee None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:31.667308 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343cf71-204c-4cdb-9531-5f8cd6c2b1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:31.693088 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-4343cf71-204c-4cdb-9531-5f8cd6c2b1ee None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:31.694457 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-4343cf71-204c-4cdb-9531-5f8cd6c2b1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:31.711108 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 637/1283] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:32:31 2022] PUT /identity/v3/projects/e555f689df1f4700897e7e501dc49f7e/users/34ba60c6edb94c27bbd01819da05acd2/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:31.713511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1750c4-788e-4d92-bdab-28b608834ebe admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:31.792644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1750c4-788e-4d92-bdab-28b608834ebe admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:31.795465 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 647/1284] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:31.797345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c52d7b-023d-4383-ae2d-f92758395e7e None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:31.797800 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c52d7b-023d-4383-ae2d-f92758395e7e None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:31.798271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c52d7b-023d-4383-ae2d-f92758395e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:31.800320 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a215035-4965-46c5-b461-e4673412c2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:31.801066 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a215035-4965-46c5-b461-e4673412c2de admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:31.801271 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a215035-4965-46c5-b461-e4673412c2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:31.801546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a215035-4965-46c5-b461-e4673412c2de admin admin] PATH_INFO: `/v3/projects/25a4a058ff574c259474c9105774ce39/users/0e3b3e6d1d1f4c71b8e27b9f6f62979f/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:31.810702 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:31.818687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a215035-4965-46c5-b461-e4673412c2de admin admin] RBAC: Authorizing `identity:create_grant(project_id=25a4a058ff574c259474c9105774ce39, user_id=0e3b3e6d1d1f4c71b8e27b9f6f62979f, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:31.821588 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a215035-4965-46c5-b461-e4673412c2de admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:31.832384 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-a9c52d7b-023d-4383-ae2d-f92758395e7e None None] MFA Rules not processed for user `77bb955e7c7742af9fae5a3e3ef9a662`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:31.833793 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-a9c52d7b-023d-4383-ae2d-f92758395e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:31.900384 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 638/1285] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:32:31 2022] PUT /identity/v3/projects/25a4a058ff574c259474c9105774ce39/users/0e3b3e6d1d1f4c71b8e27b9f6f62979f/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:31.901749 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2869b-c101-40f4-9ff6-1af3e51d7e01 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:31.902017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2869b-c101-40f4-9ff6-1af3e51d7e01 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:31.902299 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2869b-c101-40f4-9ff6-1af3e51d7e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:31.911892 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 648/1286] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:31.927798 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc7811-c812-433e-876f-03dc9ab4ff54 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:31.928136 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc7811-c812-433e-876f-03dc9ab4ff54 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:31.928418 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc7811-c812-433e-876f-03dc9ab4ff54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:31.942255 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-5ff2869b-c101-40f4-9ff6-1af3e51d7e01 None None] MFA Rules not processed for user `73e43b74f01f49dfb18d144f6cf98b5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:31.944051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-5ff2869b-c101-40f4-9ff6-1af3e51d7e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:31.988023 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-8bfc7811-c812-433e-876f-03dc9ab4ff54 None None] MFA Rules not processed for user `957c2af4324a43c48637bb2792ca3fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:31.989512 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-8bfc7811-c812-433e-876f-03dc9ab4ff54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:32.020593 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:32.047720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 639/1287] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:32.049379 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277967d-161b-4e05-966b-96645b5008d9 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:32.049674 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277967d-161b-4e05-966b-96645b5008d9 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:32.050098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277967d-161b-4e05-966b-96645b5008d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:32.075122 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-b277967d-161b-4e05-966b-96645b5008d9 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:32.076569 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-b277967d-161b-4e05-966b-96645b5008d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:32.085195 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 649/1288] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:32.085195 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc7811-c812-433e-876f-03dc9ab4ff54 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:32.148273 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 640/1289] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:32.149377 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976dffe-50d8-4467-aee5-1620c75b4778 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:32.149835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976dffe-50d8-4467-aee5-1620c75b4778 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:32.150170 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976dffe-50d8-4467-aee5-1620c75b4778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:32.162545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc7811-c812-433e-876f-03dc9ab4ff54 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:32.167512 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1cee4c-5a72-4bd2-9deb-ef2d3678e19e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:32.168254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cee4c-5a72-4bd2-9deb-ef2d3678e19e service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:32.168646 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cee4c-5a72-4bd2-9deb-ef2d3678e19e service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:32.168979 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cee4c-5a72-4bd2-9deb-ef2d3678e19e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:32.181041 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1cee4c-5a72-4bd2-9deb-ef2d3678e19e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:32.185850 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1cee4c-5a72-4bd2-9deb-ef2d3678e19e service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:32.185995 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-6976dffe-50d8-4467-aee5-1620c75b4778 None None] MFA Rules not processed for user `0e3b3e6d1d1f4c71b8e27b9f6f62979f`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:32.185995 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-6976dffe-50d8-4467-aee5-1620c75b4778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:32.196059 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 650/1290] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:32:32.197931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355437db-16bf-4126-8b15-38d46679b5ae None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:32.198247 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355437db-16bf-4126-8b15-38d46679b5ae None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:32.198543 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355437db-16bf-4126-8b15-38d46679b5ae None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:32.199980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 651/1291] 10.222.0.16 () {54 vars in 961 bytes} [Wed Oct 19 02:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:32:32.200872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc786e-31f6-4e54-8d05-f0315ec7b012 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:32.201151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc786e-31f6-4e54-8d05-f0315ec7b012 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:32.201421 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc786e-31f6-4e54-8d05-f0315ec7b012 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:32.202850 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 652/1292] 10.222.0.16 () {54 vars in 961 bytes} [Wed Oct 19 02:32:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:32:32.203461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc786e-31f6-4e54-8d05-f0315ec7b012 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:32.231513 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc786e-31f6-4e54-8d05-f0315ec7b012 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:32.235965 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd111a8-153b-402e-afd3-5de4aa2c1566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:32.236576 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd111a8-153b-402e-afd3-5de4aa2c1566 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:32.236879 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd111a8-153b-402e-afd3-5de4aa2c1566 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:32.237166 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd111a8-153b-402e-afd3-5de4aa2c1566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:32.247290 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd111a8-153b-402e-afd3-5de4aa2c1566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:32.249422 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd111a8-153b-402e-afd3-5de4aa2c1566 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:32.264770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 653/1293] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:32:32.266249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0b3c9-078a-4bf7-a45b-55219cca45e2 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:32.266969 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0b3c9-078a-4bf7-a45b-55219cca45e2 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:32.266969 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0b3c9-078a-4bf7-a45b-55219cca45e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:32.318478 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 641/1294] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:32.319092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b368f-e858-46ad-8bb8-cfc07f4c7fc9 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:32.319544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b368f-e858-46ad-8bb8-cfc07f4c7fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:32.319821 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b368f-e858-46ad-8bb8-cfc07f4c7fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:32.321178 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-73c0b3c9-078a-4bf7-a45b-55219cca45e2 None None] MFA Rules not processed for user `58a78f75a63e4d258a4afbeb748e59f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:32.324483 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-73c0b3c9-078a-4bf7-a45b-55219cca45e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:32.344012 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:32.359008 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-751b368f-e858-46ad-8bb8-cfc07f4c7fc9 None None] MFA Rules not processed for user `58a78f75a63e4d258a4afbeb748e59f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:32.360523 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-751b368f-e858-46ad-8bb8-cfc07f4c7fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:32.414899 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 654/1295] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 19 02:32:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:32.415612 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0b3c9-078a-4bf7-a45b-55219cca45e2 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:32.436143 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0b3c9-078a-4bf7-a45b-55219cca45e2 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:32.447258 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436efdd-0a61-4337-8c06-5a8ea114d5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:32.448709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436efdd-0a61-4337-8c06-5a8ea114d5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:32.449269 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436efdd-0a61-4337-8c06-5a8ea114d5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:32.449621 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436efdd-0a61-4337-8c06-5a8ea114d5f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:32.451761 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436efdd-0a61-4337-8c06-5a8ea114d5f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:32.454764 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436efdd-0a61-4337-8c06-5a8ea114d5f0 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:32.459680 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 642/1296] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 19 02:32:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:32.460473 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b368f-e858-46ad-8bb8-cfc07f4c7fc9 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:32.480932 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b368f-e858-46ad-8bb8-cfc07f4c7fc9 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:32.487563 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece3737-de80-4577-b548-2210dd44f2e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:32.488765 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece3737-de80-4577-b548-2210dd44f2e8 service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:32.489045 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece3737-de80-4577-b548-2210dd44f2e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:32.489317 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece3737-de80-4577-b548-2210dd44f2e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:32.572601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece3737-de80-4577-b548-2210dd44f2e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:32.572601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece3737-de80-4577-b548-2210dd44f2e8 service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:32.577752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 643/1297] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:32:32.578561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece3737-de80-4577-b548-2210dd44f2e8 service nova] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:32.589752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece3737-de80-4577-b548-2210dd44f2e8 service nova] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:32.610775 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 655/1298] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:32:32 2022] POST /identity/v3/projects => generated 365 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:32.613753 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382babe0-b79f-434e-8057-5850f9d49c47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:32.613906 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436efdd-0a61-4337-8c06-5a8ea114d5f0 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:32.614381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382babe0-b79f-434e-8057-5850f9d49c47 service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:32.614661 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382babe0-b79f-434e-8057-5850f9d49c47 service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:32.615046 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382babe0-b79f-434e-8057-5850f9d49c47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:32.636266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382babe0-b79f-434e-8057-5850f9d49c47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:32.645282 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382babe0-b79f-434e-8057-5850f9d49c47 service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:32.649731 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 644/1299] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:32:32.738617 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436efdd-0a61-4337-8c06-5a8ea114d5f0 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:32.751312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799cc37b-f879-4d74-8ba7-e4ccba570772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:32.752618 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cc37b-f879-4d74-8ba7-e4ccba570772 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:32.752904 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cc37b-f879-4d74-8ba7-e4ccba570772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:32.753182 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cc37b-f879-4d74-8ba7-e4ccba570772 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:32.755679 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799cc37b-f879-4d74-8ba7-e4ccba570772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:32.761605 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799cc37b-f879-4d74-8ba7-e4ccba570772 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:32.872202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 656/1300] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:32:32 2022] POST /identity/v3/users => generated 289 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:32:32.875860 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382babe0-b79f-434e-8057-5850f9d49c47 service nova] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:32.893195 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799cc37b-f879-4d74-8ba7-e4ccba570772 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:32.903102 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382babe0-b79f-434e-8057-5850f9d49c47 service nova] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:32.911566 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641c677-4bfb-43a8-b1bd-5e2a1a25de5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:32.912259 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641c677-4bfb-43a8-b1bd-5e2a1a25de5d admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:32.912544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641c677-4bfb-43a8-b1bd-5e2a1a25de5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:32.912819 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641c677-4bfb-43a8-b1bd-5e2a1a25de5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:32.913481 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641c677-4bfb-43a8-b1bd-5e2a1a25de5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:32.918863 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641c677-4bfb-43a8-b1bd-5e2a1a25de5d admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:32.942864 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 645/1301] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:32.947883 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641c677-4bfb-43a8-b1bd-5e2a1a25de5d admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:32.968575 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641c677-4bfb-43a8-b1bd-5e2a1a25de5d admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:32.983090 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41341ad8-0c0b-4ee3-9b57-6b85094b2f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:32.983766 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41341ad8-0c0b-4ee3-9b57-6b85094b2f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:32.984046 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41341ad8-0c0b-4ee3-9b57-6b85094b2f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:32.984321 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41341ad8-0c0b-4ee3-9b57-6b85094b2f9a admin admin] PATH_INFO: `/v3/projects/0e9361251c17441890293a634dc93675/users/205cf875f57c435d90060b5b4fd85090/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:33.011798 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41341ad8-0c0b-4ee3-9b57-6b85094b2f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e9361251c17441890293a634dc93675, user_id=205cf875f57c435d90060b5b4fd85090, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:33.015641 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41341ad8-0c0b-4ee3-9b57-6b85094b2f9a admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:33.029923 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799cc37b-f879-4d74-8ba7-e4ccba570772 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:33.035757 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6c17d-9908-4bb7-b40f-8e273ec50c70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:33.036488 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6c17d-9908-4bb7-b40f-8e273ec50c70 service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:33.036771 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6c17d-9908-4bb7-b40f-8e273ec50c70 service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:33.037045 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6c17d-9908-4bb7-b40f-8e273ec50c70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:33.143739 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6c17d-9908-4bb7-b40f-8e273ec50c70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:33.144492 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6c17d-9908-4bb7-b40f-8e273ec50c70 service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:33.144712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 646/1302] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:32:32 2022] PUT /identity/v3/projects/0e9361251c17441890293a634dc93675/users/205cf875f57c435d90060b5b4fd85090/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:33.147300 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcd40f-54cf-49f2-9ce8-e4d7aaff90d6 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:33.147869 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcd40f-54cf-49f2-9ce8-e4d7aaff90d6 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:33.148514 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcd40f-54cf-49f2-9ce8-e4d7aaff90d6 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:33.155476 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 647/1303] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 19 02:32:33 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:32:33.156720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcd40f-54cf-49f2-9ce8-e4d7aaff90d6 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:33.161056 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 657/1304] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:32:33.162466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:33.164230 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd284470-0376-4643-8761-68a70147dab4 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:33.164799 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd284470-0376-4643-8761-68a70147dab4 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:33.165167 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd284470-0376-4643-8761-68a70147dab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:33.197504 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-fd284470-0376-4643-8761-68a70147dab4 None None] MFA Rules not processed for user `58a78f75a63e4d258a4afbeb748e59f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:33.201711 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-fd284470-0376-4643-8761-68a70147dab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:33.299734 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 658/1305] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 02:32:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:33.302018 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e9358-d191-465e-a2f6-15857a5e776e None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:33.302522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e9358-d191-465e-a2f6-15857a5e776e None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:33.302927 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e9358-d191-465e-a2f6-15857a5e776e None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:33.305535 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 659/1306] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 19 02:32:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:32:33.309483 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcd40f-54cf-49f2-9ce8-e4d7aaff90d6 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:33.314987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4425960-e972-44a3-aa6f-5f9e106351c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:33.315814 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4425960-e972-44a3-aa6f-5f9e106351c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:33.318322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4425960-e972-44a3-aa6f-5f9e106351c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:33.318322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4425960-e972-44a3-aa6f-5f9e106351c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:33.318555 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68231169-64c7-4dc3-b75d-161f860da347 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:33.318721 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4425960-e972-44a3-aa6f-5f9e106351c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:33.318922 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68231169-64c7-4dc3-b75d-161f860da347 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:33.319018 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4425960-e972-44a3-aa6f-5f9e106351c0 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:33.319536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68231169-64c7-4dc3-b75d-161f860da347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:33.333868 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 648/1307] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:33.334727 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4425960-e972-44a3-aa6f-5f9e106351c0 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:33.347610 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-68231169-64c7-4dc3-b75d-161f860da347 None None] MFA Rules not processed for user `58a78f75a63e4d258a4afbeb748e59f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:33.349461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-68231169-64c7-4dc3-b75d-161f860da347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:33.362148 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 660/1308] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 02:32:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:33.369066 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68231169-64c7-4dc3-b75d-161f860da347 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:33.376302 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68231169-64c7-4dc3-b75d-161f860da347 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:33.385105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da5ccf-dac7-4efe-921c-be73f4f374db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:33.386062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da5ccf-dac7-4efe-921c-be73f4f374db admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:33.386348 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da5ccf-dac7-4efe-921c-be73f4f374db admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:33.386623 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da5ccf-dac7-4efe-921c-be73f4f374db admin admin] PATH_INFO: `/v3/projects/0e9361251c17441890293a634dc93675/users/205cf875f57c435d90060b5b4fd85090/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:33.393281 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da5ccf-dac7-4efe-921c-be73f4f374db admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e9361251c17441890293a634dc93675, user_id=205cf875f57c435d90060b5b4fd85090, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:33.399367 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da5ccf-dac7-4efe-921c-be73f4f374db admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:33.418501 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4425960-e972-44a3-aa6f-5f9e106351c0 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:33.439172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 661/1309] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:32:33 2022] PUT /identity/v3/projects/0e9361251c17441890293a634dc93675/users/205cf875f57c435d90060b5b4fd85090/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:33.440267 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da5ccf-dac7-4efe-921c-be73f4f374db admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:33.516109 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:33.518406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328a5fa-148a-49b6-9b99-14ec3d33df48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:33.519161 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328a5fa-148a-49b6-9b99-14ec3d33df48 service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:33.519457 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328a5fa-148a-49b6-9b99-14ec3d33df48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:33.519717 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328a5fa-148a-49b6-9b99-14ec3d33df48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:33.530487 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da5ccf-dac7-4efe-921c-be73f4f374db admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:33.535846 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e346f9-ffc0-4bf6-a1af-db589a095567 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:33.536734 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e346f9-ffc0-4bf6-a1af-db589a095567 service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:33.537188 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e346f9-ffc0-4bf6-a1af-db589a095567 service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:33.537629 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e346f9-ffc0-4bf6-a1af-db589a095567 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:33.624575 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e346f9-ffc0-4bf6-a1af-db589a095567 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:33.626549 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e346f9-ffc0-4bf6-a1af-db589a095567 service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:33.640941 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 662/1310] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:32:33.647343 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce7590-8fce-45df-a26d-e2e6dccc1552 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:33.647654 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce7590-8fce-45df-a26d-e2e6dccc1552 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:33.648803 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce7590-8fce-45df-a26d-e2e6dccc1552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:33.675280 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328a5fa-148a-49b6-9b99-14ec3d33df48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:33.676837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328a5fa-148a-49b6-9b99-14ec3d33df48 service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:33.701790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 649/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:32:33.710422 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-35ce7590-8fce-45df-a26d-e2e6dccc1552 None None] MFA Rules not processed for user `205cf875f57c435d90060b5b4fd85090`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:33.711681 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-35ce7590-8fce-45df-a26d-e2e6dccc1552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:33.876759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 663/1312] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:33.972960 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:34.953001 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328a5fa-148a-49b6-9b99-14ec3d33df48 service cinder] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:34.970845 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328a5fa-148a-49b6-9b99-14ec3d33df48 service cinder] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:34.980587 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d7ce4-e226-4f42-b956-0872532675ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:34.981547 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d7ce4-e226-4f42-b956-0872532675ff service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:35.082640 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d7ce4-e226-4f42-b956-0872532675ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:35.082640 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d7ce4-e226-4f42-b956-0872532675ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:35.082640 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d7ce4-e226-4f42-b956-0872532675ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:35.082640 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d7ce4-e226-4f42-b956-0872532675ff service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:35.082640 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 650/1313] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:32:35.092523 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:35.662555 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce7590-8fce-45df-a26d-e2e6dccc1552 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:35.679370 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce7590-8fce-45df-a26d-e2e6dccc1552 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:35.691682 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5da077-b408-468e-8a47-83c87afbc8ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:35.692664 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5da077-b408-468e-8a47-83c87afbc8ab service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:35.693097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5da077-b408-468e-8a47-83c87afbc8ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:35.693545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5da077-b408-468e-8a47-83c87afbc8ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:35.793850 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5da077-b408-468e-8a47-83c87afbc8ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:35.795758 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5da077-b408-468e-8a47-83c87afbc8ab service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:35.824405 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 664/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:32:36.652329 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d7ce4-e226-4f42-b956-0872532675ff service cinder] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:36.759318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:36.857327 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d7ce4-e226-4f42-b956-0872532675ff service cinder] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:36.866963 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03cab5-5e63-474c-81fe-2675ef1d5d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:36.868012 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03cab5-5e63-474c-81fe-2675ef1d5d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:36.869613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03cab5-5e63-474c-81fe-2675ef1d5d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:36.870065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03cab5-5e63-474c-81fe-2675ef1d5d24 admin admin] PATH_INFO: `/v3/users/73e43b74f01f49dfb18d144f6cf98b5d` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:36.874025 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03cab5-5e63-474c-81fe-2675ef1d5d24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73e43b74f01f49dfb18d144f6cf98b5d)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:36.876408 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03cab5-5e63-474c-81fe-2675ef1d5d24 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:37.195501 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-8d03cab5-5e63-474c-81fe-2675ef1d5d24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73e43b74f01f49dfb18d144f6cf98b5d'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:37.195501 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-8d03cab5-5e63-474c-81fe-2675ef1d5d24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73e43b74f01f49dfb18d144f6cf98b5d'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:37.281321 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-8d03cab5-5e63-474c-81fe-2675ef1d5d24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73e43b74f01f49dfb18d144f6cf98b5d'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:37.292303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-8d03cab5-5e63-474c-81fe-2675ef1d5d24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73e43b74f01f49dfb18d144f6cf98b5d'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:37.293396 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-8d03cab5-5e63-474c-81fe-2675ef1d5d24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73e43b74f01f49dfb18d144f6cf98b5d'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:37.338290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 651/1315] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:32:36 2022] DELETE /identity/v3/users/73e43b74f01f49dfb18d144f6cf98b5d => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:37.340255 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f85122-530f-46c2-b119-74144771d407 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:37.344581 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f85122-530f-46c2-b119-74144771d407 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:37.344581 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f85122-530f-46c2-b119-74144771d407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:37.387689 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-93f85122-530f-46c2-b119-74144771d407 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:37.391900 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-93f85122-530f-46c2-b119-74144771d407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:37.535773 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 665/1316] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:32:37.780588 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03cab5-5e63-474c-81fe-2675ef1d5d24 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:37.783488 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-8d03cab5-5e63-474c-81fe-2675ef1d5d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:37.953417 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03cab5-5e63-474c-81fe-2675ef1d5d24 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:37.961378 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a132e8f-d716-4425-b947-e465d43b8ff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:37.962049 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a132e8f-d716-4425-b947-e465d43b8ff2 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:37.962325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a132e8f-d716-4425-b947-e465d43b8ff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:37.962598 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a132e8f-d716-4425-b947-e465d43b8ff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:37.984835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a132e8f-d716-4425-b947-e465d43b8ff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:37.986664 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a132e8f-d716-4425-b947-e465d43b8ff2 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:38.009831 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 652/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:32:38.772177 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f85122-530f-46c2-b119-74144771d407 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:38.773397 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-93f85122-530f-46c2-b119-74144771d407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:38.879387 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f85122-530f-46c2-b119-74144771d407 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:38.896894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351289d-3d57-4d6e-8bee-049d163cfaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:38.898895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351289d-3d57-4d6e-8bee-049d163cfaaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:38.900669 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351289d-3d57-4d6e-8bee-049d163cfaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:38.901682 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351289d-3d57-4d6e-8bee-049d163cfaaf admin admin] PATH_INFO: `/v3/users/957c2af4324a43c48637bb2792ca3fe9` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:38.904365 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351289d-3d57-4d6e-8bee-049d163cfaaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=957c2af4324a43c48637bb2792ca3fe9)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:38.906085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: WARNING py.warnings [None req-a351289d-3d57-4d6e-8bee-049d163cfaaf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 02:32:38.906085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: warnings.warn(msg) Oct 19 02:32:38.906085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: Oct 19 02:32:38.907700 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351289d-3d57-4d6e-8bee-049d163cfaaf admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:39.223296 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a351289d-3d57-4d6e-8bee-049d163cfaaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '957c2af4324a43c48637bb2792ca3fe9'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:39.226907 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a351289d-3d57-4d6e-8bee-049d163cfaaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '957c2af4324a43c48637bb2792ca3fe9'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:39.329014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a351289d-3d57-4d6e-8bee-049d163cfaaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '957c2af4324a43c48637bb2792ca3fe9'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:39.378653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a351289d-3d57-4d6e-8bee-049d163cfaaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '957c2af4324a43c48637bb2792ca3fe9'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:39.381584 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a351289d-3d57-4d6e-8bee-049d163cfaaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '957c2af4324a43c48637bb2792ca3fe9'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:39.383363 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:39.441705 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 666/1318] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:32:38 2022] DELETE /identity/v3/users/957c2af4324a43c48637bb2792ca3fe9 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:39.445583 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392ec41-3259-4b8c-bdf2-db6f089bf61d None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:39.446645 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392ec41-3259-4b8c-bdf2-db6f089bf61d None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:39.447232 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392ec41-3259-4b8c-bdf2-db6f089bf61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:39.492700 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-5392ec41-3259-4b8c-bdf2-db6f089bf61d None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:39.494352 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-5392ec41-3259-4b8c-bdf2-db6f089bf61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:39.583306 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:39.615459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 653/1319] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:32:39.699172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351289d-3d57-4d6e-8bee-049d163cfaaf admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:39.701089 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-a351289d-3d57-4d6e-8bee-049d163cfaaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:39.866175 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351289d-3d57-4d6e-8bee-049d163cfaaf admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:39.879361 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25a969-4f36-4164-a806-722dd84ea8dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:39.880259 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25a969-4f36-4164-a806-722dd84ea8dc service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:39.880755 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25a969-4f36-4164-a806-722dd84ea8dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:39.881275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25a969-4f36-4164-a806-722dd84ea8dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:39.912629 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25a969-4f36-4164-a806-722dd84ea8dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:39.919058 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25a969-4f36-4164-a806-722dd84ea8dc service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:39.965331 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 667/1320] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:32:40.116222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392ec41-3259-4b8c-bdf2-db6f089bf61d None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:40.119208 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-5392ec41-3259-4b8c-bdf2-db6f089bf61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:40.158132 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392ec41-3259-4b8c-bdf2-db6f089bf61d None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:40.168809 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dde839-8bf2-46d2-bdc0-efd55ccce6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:40.170214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dde839-8bf2-46d2-bdc0-efd55ccce6c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:40.170763 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dde839-8bf2-46d2-bdc0-efd55ccce6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:40.171276 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dde839-8bf2-46d2-bdc0-efd55ccce6c7 admin admin] PATH_INFO: `/v3/projects/2a39a1381f2d46b5adf2b5eaa22401c8` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:40.174469 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dde839-8bf2-46d2-bdc0-efd55ccce6c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a39a1381f2d46b5adf2b5eaa22401c8)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:40.176256 dv-cinder-861491-4-smb devstack@keystone.service[81671]: WARNING py.warnings [None req-e7dde839-8bf2-46d2-bdc0-efd55ccce6c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 02:32:40.176256 dv-cinder-861491-4-smb devstack@keystone.service[81671]: warnings.warn(msg) Oct 19 02:32:40.176256 dv-cinder-861491-4-smb devstack@keystone.service[81671]: Oct 19 02:32:40.184178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dde839-8bf2-46d2-bdc0-efd55ccce6c7 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:40.416732 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-e7dde839-8bf2-46d2-bdc0-efd55ccce6c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a39a1381f2d46b5adf2b5eaa22401c8', 'request_id': 'req-e7dde839-8bf2-46d2-bdc0-efd55ccce6c7'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:40.448002 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-e7dde839-8bf2-46d2-bdc0-efd55ccce6c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a39a1381f2d46b5adf2b5eaa22401c8', 'request_id': 'req-e7dde839-8bf2-46d2-bdc0-efd55ccce6c7'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:40.500284 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-e7dde839-8bf2-46d2-bdc0-efd55ccce6c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a39a1381f2d46b5adf2b5eaa22401c8', 'request_id': 'req-e7dde839-8bf2-46d2-bdc0-efd55ccce6c7'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:40.671006 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-e7dde839-8bf2-46d2-bdc0-efd55ccce6c7 admin admin] The token cache is being invalidate because project 2a39a1381f2d46b5adf2b5eaa22401c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:32:40.671511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-e7dde839-8bf2-46d2-bdc0-efd55ccce6c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:40.672502 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-e7dde839-8bf2-46d2-bdc0-efd55ccce6c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:40.678006 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 654/1321] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:32:40 2022] DELETE /identity/v3/projects/2a39a1381f2d46b5adf2b5eaa22401c8 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:40.679655 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299a36f-2f99-4320-b0c8-c35f57abcb2a None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:40.680024 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299a36f-2f99-4320-b0c8-c35f57abcb2a None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:40.684068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299a36f-2f99-4320-b0c8-c35f57abcb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:40.780502 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-b299a36f-2f99-4320-b0c8-c35f57abcb2a None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:40.788059 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-b299a36f-2f99-4320-b0c8-c35f57abcb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:40.943229 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 668/1322] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:32:40.945797 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceadac1-4d28-4498-832f-b8a767600d1f None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:40.946532 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceadac1-4d28-4498-832f-b8a767600d1f None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:40.947563 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceadac1-4d28-4498-832f-b8a767600d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:40.984608 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-cceadac1-4d28-4498-832f-b8a767600d1f None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:40.986214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-cceadac1-4d28-4498-832f-b8a767600d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:41.009159 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299a36f-2f99-4320-b0c8-c35f57abcb2a None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:41.018960 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 655/1323] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:41.024090 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299a36f-2f99-4320-b0c8-c35f57abcb2a None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:41.036043 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900e94c-72d1-40df-bc39-1f28f043e758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:41.038516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900e94c-72d1-40df-bc39-1f28f043e758 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:41.039084 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900e94c-72d1-40df-bc39-1f28f043e758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:41.039537 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900e94c-72d1-40df-bc39-1f28f043e758 admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:41.040994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900e94c-72d1-40df-bc39-1f28f043e758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:32:41.043364 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900e94c-72d1-40df-bc39-1f28f043e758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:41.043679 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900e94c-72d1-40df-bc39-1f28f043e758 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:41.106360 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 669/1324] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:32:41.111122 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceadac1-4d28-4498-832f-b8a767600d1f None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:41.129270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceadac1-4d28-4498-832f-b8a767600d1f None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:41.135297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93691224-3584-49f7-a430-bd52da745c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:41.136340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93691224-3584-49f7-a430-bd52da745c8d admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:41.136848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93691224-3584-49f7-a430-bd52da745c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:41.137309 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93691224-3584-49f7-a430-bd52da745c8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:41.138209 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93691224-3584-49f7-a430-bd52da745c8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:41.141625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93691224-3584-49f7-a430-bd52da745c8d admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:41.324009 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 656/1325] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:32:41 2022] POST /identity/v3/projects => generated 403 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:41.326640 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900e94c-72d1-40df-bc39-1f28f043e758 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:41.340130 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900e94c-72d1-40df-bc39-1f28f043e758 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:41.464585 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a136749-c9ca-4d48-a324-84874b608762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:41.465165 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a136749-c9ca-4d48-a324-84874b608762 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:41.465443 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a136749-c9ca-4d48-a324-84874b608762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:41.465871 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a136749-c9ca-4d48-a324-84874b608762 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:41.466521 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a136749-c9ca-4d48-a324-84874b608762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:41.468644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a136749-c9ca-4d48-a324-84874b608762 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:41.597133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 670/1326] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:32:41 2022] POST /identity/v3/users => generated 302 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:32:41.603040 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93691224-3584-49f7-a430-bd52da745c8d admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:41.621686 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93691224-3584-49f7-a430-bd52da745c8d admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:41.632491 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef387e3-be2f-4181-900e-b02b917d493b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:41.633395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef387e3-be2f-4181-900e-b02b917d493b admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:41.634438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef387e3-be2f-4181-900e-b02b917d493b admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:41.634898 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef387e3-be2f-4181-900e-b02b917d493b admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:41.635793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef387e3-be2f-4181-900e-b02b917d493b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:41.637857 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef387e3-be2f-4181-900e-b02b917d493b admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:41.657500 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 657/1327] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:41.666080 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a136749-c9ca-4d48-a324-84874b608762 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:41.677345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a136749-c9ca-4d48-a324-84874b608762 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:41.690583 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbf3fb-622f-47c6-bba1-5088d744206f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:41.691831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbf3fb-622f-47c6-bba1-5088d744206f admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:41.694768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbf3fb-622f-47c6-bba1-5088d744206f admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:41.694768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbf3fb-622f-47c6-bba1-5088d744206f admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:41.694768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbf3fb-622f-47c6-bba1-5088d744206f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:41.700845 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbf3fb-622f-47c6-bba1-5088d744206f admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:41.705573 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:41.734306 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 671/1328] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:32:41.738421 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef387e3-be2f-4181-900e-b02b917d493b admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:41.761836 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef387e3-be2f-4181-900e-b02b917d493b admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:41.775183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e06c7-a0ee-4043-a9ff-673fc27e32f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:41.775183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e06c7-a0ee-4043-a9ff-673fc27e32f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:41.775183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e06c7-a0ee-4043-a9ff-673fc27e32f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:41.775480 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e06c7-a0ee-4043-a9ff-673fc27e32f8 admin admin] PATH_INFO: `/v3/projects/76bff797b00647f8a9cb724fa73b61a7/users/c3710c28c15344ecb07d14a507d46dbb/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:41.824438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbf3fb-622f-47c6-bba1-5088d744206f admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:41.826213 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-23fbf3fb-622f-47c6-bba1-5088d744206f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:41.844307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e06c7-a0ee-4043-a9ff-673fc27e32f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76bff797b00647f8a9cb724fa73b61a7, user_id=c3710c28c15344ecb07d14a507d46dbb, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:41.849396 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e06c7-a0ee-4043-a9ff-673fc27e32f8 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:41.857556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbf3fb-622f-47c6-bba1-5088d744206f admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:41.892631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816b8ec-29e0-4f15-bab2-5331f35ffcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:41.892631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816b8ec-29e0-4f15-bab2-5331f35ffcc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:41.892631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816b8ec-29e0-4f15-bab2-5331f35ffcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:41.892631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816b8ec-29e0-4f15-bab2-5331f35ffcc5 admin admin] PATH_INFO: `/v3/projects/da4eb48b5e684c83ab0f80f750ff5ce4` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:41.905033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816b8ec-29e0-4f15-bab2-5331f35ffcc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da4eb48b5e684c83ab0f80f750ff5ce4)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:41.905033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816b8ec-29e0-4f15-bab2-5331f35ffcc5 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:42.013600 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 658/1329] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:32:41 2022] PUT /identity/v3/projects/76bff797b00647f8a9cb724fa73b61a7/users/c3710c28c15344ecb07d14a507d46dbb/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:42.022453 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cd511-a235-407a-b41d-a826c05123c4 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:42.022746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cd511-a235-407a-b41d-a826c05123c4 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:42.023048 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cd511-a235-407a-b41d-a826c05123c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:42.067271 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-479cd511-a235-407a-b41d-a826c05123c4 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:42.068499 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-479cd511-a235-407a-b41d-a826c05123c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:42.120255 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-4816b8ec-29e0-4f15-bab2-5331f35ffcc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da4eb48b5e684c83ab0f80f750ff5ce4', 'request_id': 'req-4816b8ec-29e0-4f15-bab2-5331f35ffcc5'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:42.136050 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-4816b8ec-29e0-4f15-bab2-5331f35ffcc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da4eb48b5e684c83ab0f80f750ff5ce4', 'request_id': 'req-4816b8ec-29e0-4f15-bab2-5331f35ffcc5'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:42.233928 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 659/1330] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:42.257623 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-4816b8ec-29e0-4f15-bab2-5331f35ffcc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da4eb48b5e684c83ab0f80f750ff5ce4', 'request_id': 'req-4816b8ec-29e0-4f15-bab2-5331f35ffcc5'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:42.279307 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-4816b8ec-29e0-4f15-bab2-5331f35ffcc5 admin admin] The token cache is being invalidate because project da4eb48b5e684c83ab0f80f750ff5ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:32:42.279603 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-4816b8ec-29e0-4f15-bab2-5331f35ffcc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:42.280490 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-4816b8ec-29e0-4f15-bab2-5331f35ffcc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:42.282254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 672/1331] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:32:41 2022] DELETE /identity/v3/projects/da4eb48b5e684c83ab0f80f750ff5ce4 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:42.287648 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7765b-86ee-425f-8a70-7e5c8af2a006 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:42.288145 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7765b-86ee-425f-8a70-7e5c8af2a006 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:42.288635 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7765b-86ee-425f-8a70-7e5c8af2a006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:42.320544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816b8ec-29e0-4f15-bab2-5331f35ffcc5 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:42.327867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-4816b8ec-29e0-4f15-bab2-5331f35ffcc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:42.343915 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-d6d7765b-86ee-425f-8a70-7e5c8af2a006 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:42.346729 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-d6d7765b-86ee-425f-8a70-7e5c8af2a006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:42.367140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:42.458354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816b8ec-29e0-4f15-bab2-5331f35ffcc5 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:42.465143 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6700175-9742-46c4-a38b-43d9e84414cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:42.466597 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6700175-9742-46c4-a38b-43d9e84414cf service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:42.467101 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6700175-9742-46c4-a38b-43d9e84414cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:42.469162 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6700175-9742-46c4-a38b-43d9e84414cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:42.473230 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-b6700175-9742-46c4-a38b-43d9e84414cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:42.516776 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 660/1332] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:42.516776 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec811b-b3a0-499a-b867-7c52e7b03660 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:42.516776 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec811b-b3a0-499a-b867-7c52e7b03660 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:42.516776 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec811b-b3a0-499a-b867-7c52e7b03660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:42.566353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-a3ec811b-b3a0-499a-b867-7c52e7b03660 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:42.572714 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6700175-9742-46c4-a38b-43d9e84414cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:42.573227 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-a3ec811b-b3a0-499a-b867-7c52e7b03660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:42.579049 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6700175-9742-46c4-a38b-43d9e84414cf service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:42.597279 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 661/1333] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:42.598315 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b8c4e-bdde-4dd0-a0e6-0cc6d70cf03f None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:42.602756 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b8c4e-bdde-4dd0-a0e6-0cc6d70cf03f None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:42.603128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b8c4e-bdde-4dd0-a0e6-0cc6d70cf03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:42.612312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 673/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:32:42.614697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6700175-9742-46c4-a38b-43d9e84414cf service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:42.659424 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6700175-9742-46c4-a38b-43d9e84414cf service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:42.671085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bcb7c-4648-41ae-9c9e-e8a5f28273b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:42.671760 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bcb7c-4648-41ae-9c9e-e8a5f28273b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:42.672043 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bcb7c-4648-41ae-9c9e-e8a5f28273b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:42.672320 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bcb7c-4648-41ae-9c9e-e8a5f28273b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:42.673415 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89bcb7c-4648-41ae-9c9e-e8a5f28273b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:32:42.674158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89bcb7c-4648-41ae-9c9e-e8a5f28273b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:42.677751 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-109b8c4e-bdde-4dd0-a0e6-0cc6d70cf03f None None] MFA Rules not processed for user `5eabc00f209a48f88e8e2ca28dd3e8df`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:42.681568 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-109b8c4e-bdde-4dd0-a0e6-0cc6d70cf03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:42.683368 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89bcb7c-4648-41ae-9c9e-e8a5f28273b2 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:42.706677 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 674/1335] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:32:42.710685 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bcb7c-4648-41ae-9c9e-e8a5f28273b2 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:42.730564 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bcb7c-4648-41ae-9c9e-e8a5f28273b2 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:42.749996 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461e4ec-9365-4118-a59d-0532b8257aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:42.750976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461e4ec-9365-4118-a59d-0532b8257aab admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:42.751452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461e4ec-9365-4118-a59d-0532b8257aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:42.751920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461e4ec-9365-4118-a59d-0532b8257aab admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:42.752791 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461e4ec-9365-4118-a59d-0532b8257aab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:42.754952 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461e4ec-9365-4118-a59d-0532b8257aab admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:42.820492 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 662/1336] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:42.837729 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b8c4e-bdde-4dd0-a0e6-0cc6d70cf03f None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:42.843435 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-109b8c4e-bdde-4dd0-a0e6-0cc6d70cf03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:42.910219 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 675/1337] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:32:42 2022] POST /identity/v3/projects => generated 377 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:32:42.914366 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461e4ec-9365-4118-a59d-0532b8257aab admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:42.995972 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b8c4e-bdde-4dd0-a0e6-0cc6d70cf03f None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:43.060326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461e4ec-9365-4118-a59d-0532b8257aab admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:43.083499 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d129a3-6b02-43d7-bd88-b6f0f39df68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:43.084925 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d129a3-6b02-43d7-bd88-b6f0f39df68a admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:43.088842 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d129a3-6b02-43d7-bd88-b6f0f39df68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:43.089393 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d129a3-6b02-43d7-bd88-b6f0f39df68a admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:43.090712 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d129a3-6b02-43d7-bd88-b6f0f39df68a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:43.096772 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d129a3-6b02-43d7-bd88-b6f0f39df68a admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:43.146094 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cda113-cbab-4240-9e41-713915e35db4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:43.146730 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cda113-cbab-4240-9e41-713915e35db4 service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:43.147108 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cda113-cbab-4240-9e41-713915e35db4 service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:43.147302 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cda113-cbab-4240-9e41-713915e35db4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:43.187054 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 676/1338] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:32:42 2022] POST /identity/v3/users => generated 289 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:43.191925 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d129a3-6b02-43d7-bd88-b6f0f39df68a admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:43.231004 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d129a3-6b02-43d7-bd88-b6f0f39df68a admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:43.233691 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cda113-cbab-4240-9e41-713915e35db4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:43.235389 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:43.236932 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cda113-cbab-4240-9e41-713915e35db4 service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:43.246563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced61da-a36b-4d71-9989-98cf0e19a776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:43.247486 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced61da-a36b-4d71-9989-98cf0e19a776 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:43.248091 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced61da-a36b-4d71-9989-98cf0e19a776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:43.248523 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced61da-a36b-4d71-9989-98cf0e19a776 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:43.250161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced61da-a36b-4d71-9989-98cf0e19a776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:43.256982 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced61da-a36b-4d71-9989-98cf0e19a776 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:43.259787 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 663/1339] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:32:43.291048 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 677/1340] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:43.295529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cda113-cbab-4240-9e41-713915e35db4 service nova] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:43.317184 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cda113-cbab-4240-9e41-713915e35db4 service nova] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:43.330740 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854890e3-7609-46bc-b9aa-3cfbc9d8adc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:43.331481 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854890e3-7609-46bc-b9aa-3cfbc9d8adc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:43.333093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854890e3-7609-46bc-b9aa-3cfbc9d8adc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:43.333369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854890e3-7609-46bc-b9aa-3cfbc9d8adc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:43.334710 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854890e3-7609-46bc-b9aa-3cfbc9d8adc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:43.347264 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854890e3-7609-46bc-b9aa-3cfbc9d8adc8 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:43.376514 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 664/1341] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:43.380992 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced61da-a36b-4d71-9989-98cf0e19a776 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:43.404755 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced61da-a36b-4d71-9989-98cf0e19a776 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:43.436583 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4912e-5343-44cc-b9e6-26bfb7e9c5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:43.437351 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4912e-5343-44cc-b9e6-26bfb7e9c5e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:43.437723 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4912e-5343-44cc-b9e6-26bfb7e9c5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:43.439012 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4912e-5343-44cc-b9e6-26bfb7e9c5e9 admin admin] PATH_INFO: `/v3/projects/8e7ab2b353aa4ad99bf34ec887e1e960/users/bbc10aa5b7e84677ac83c1a6367b163c/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:43.474759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4912e-5343-44cc-b9e6-26bfb7e9c5e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7ab2b353aa4ad99bf34ec887e1e960, user_id=bbc10aa5b7e84677ac83c1a6367b163c, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:43.478877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4912e-5343-44cc-b9e6-26bfb7e9c5e9 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:43.542253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854890e3-7609-46bc-b9aa-3cfbc9d8adc8 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:43.544234 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-854890e3-7609-46bc-b9aa-3cfbc9d8adc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:43.567317 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854890e3-7609-46bc-b9aa-3cfbc9d8adc8 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:43.581173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06511de3-6c60-45ba-8f4f-683cabeb507e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:43.583811 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06511de3-6c60-45ba-8f4f-683cabeb507e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:43.584112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06511de3-6c60-45ba-8f4f-683cabeb507e admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:43.584389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06511de3-6c60-45ba-8f4f-683cabeb507e admin admin] PATH_INFO: `/v3/users/77bb955e7c7742af9fae5a3e3ef9a662` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:43.587499 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06511de3-6c60-45ba-8f4f-683cabeb507e admin admin] RBAC: Authorizing `identity:delete_user(user_id=77bb955e7c7742af9fae5a3e3ef9a662)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:43.589570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06511de3-6c60-45ba-8f4f-683cabeb507e admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:43.613598 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 678/1342] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:32:43 2022] PUT /identity/v3/projects/8e7ab2b353aa4ad99bf34ec887e1e960/users/bbc10aa5b7e84677ac83c1a6367b163c/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:43.625139 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9141fc-3fbd-4c17-97e1-dbcb48d934d6 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:43.625546 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9141fc-3fbd-4c17-97e1-dbcb48d934d6 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:43.625909 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9141fc-3fbd-4c17-97e1-dbcb48d934d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:43.657980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-fe9141fc-3fbd-4c17-97e1-dbcb48d934d6 None None] MFA Rules not processed for user `bbc10aa5b7e84677ac83c1a6367b163c`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:43.659462 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-fe9141fc-3fbd-4c17-97e1-dbcb48d934d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:43.842932 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 679/1343] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:32:43.848096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9141fc-3fbd-4c17-97e1-dbcb48d934d6 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:43.947233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-06511de3-6c60-45ba-8f4f-683cabeb507e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77bb955e7c7742af9fae5a3e3ef9a662'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:43.949418 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-06511de3-6c60-45ba-8f4f-683cabeb507e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77bb955e7c7742af9fae5a3e3ef9a662'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:43.999264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9141fc-3fbd-4c17-97e1-dbcb48d934d6 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:44.005063 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a670a-37a0-4e63-aa0e-3e830ce481e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:44.009120 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a670a-37a0-4e63-aa0e-3e830ce481e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:44.009120 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a670a-37a0-4e63-aa0e-3e830ce481e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:44.009120 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a670a-37a0-4e63-aa0e-3e830ce481e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:44.009120 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a670a-37a0-4e63-aa0e-3e830ce481e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:44.010580 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a670a-37a0-4e63-aa0e-3e830ce481e1 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:44.029202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-06511de3-6c60-45ba-8f4f-683cabeb507e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77bb955e7c7742af9fae5a3e3ef9a662'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:44.042345 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-06511de3-6c60-45ba-8f4f-683cabeb507e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77bb955e7c7742af9fae5a3e3ef9a662'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:44.043480 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-06511de3-6c60-45ba-8f4f-683cabeb507e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77bb955e7c7742af9fae5a3e3ef9a662'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:44.103375 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 665/1344] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:32:43 2022] DELETE /identity/v3/users/77bb955e7c7742af9fae5a3e3ef9a662 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:44.105463 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89659c96-8a43-4efb-9304-0b9648ad632e None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:44.105920 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89659c96-8a43-4efb-9304-0b9648ad632e None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:44.110184 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89659c96-8a43-4efb-9304-0b9648ad632e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:44.132455 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 680/1345] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:32:43 2022] POST /identity/v3/projects => generated 375 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:44.140666 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a670a-37a0-4e63-aa0e-3e830ce481e1 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:44.146886 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-634a670a-37a0-4e63-aa0e-3e830ce481e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:44.155949 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-89659c96-8a43-4efb-9304-0b9648ad632e None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:44.157895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-89659c96-8a43-4efb-9304-0b9648ad632e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:44.308568 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a670a-37a0-4e63-aa0e-3e830ce481e1 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:44.315220 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019be96-703c-4f16-89db-3e45516d8795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:44.316276 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019be96-703c-4f16-89db-3e45516d8795 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:44.316837 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019be96-703c-4f16-89db-3e45516d8795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:44.317337 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019be96-703c-4f16-89db-3e45516d8795 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:44.318255 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019be96-703c-4f16-89db-3e45516d8795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:44.324470 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 666/1346] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:44.329349 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019be96-703c-4f16-89db-3e45516d8795 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:44.407598 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 681/1347] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:32:44 2022] POST /identity/v3/users => generated 294 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:44.411522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89659c96-8a43-4efb-9304-0b9648ad632e None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:44.426928 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89659c96-8a43-4efb-9304-0b9648ad632e None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:44.443586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b913883-4c86-4bd1-b5ed-2c0a50b44cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:44.444455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b913883-4c86-4bd1-b5ed-2c0a50b44cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:44.444588 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b913883-4c86-4bd1-b5ed-2c0a50b44cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:44.444809 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b913883-4c86-4bd1-b5ed-2c0a50b44cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:44.445436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b913883-4c86-4bd1-b5ed-2c0a50b44cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:44.448789 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b913883-4c86-4bd1-b5ed-2c0a50b44cf1 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:44.479269 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 667/1348] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:44.480536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019be96-703c-4f16-89db-3e45516d8795 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:44.498776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019be96-703c-4f16-89db-3e45516d8795 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:44.504883 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7d554-0feb-4cf0-873b-6530d4abdaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:44.505565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7d554-0feb-4cf0-873b-6530d4abdaca admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:44.505856 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7d554-0feb-4cf0-873b-6530d4abdaca admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:44.506484 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7d554-0feb-4cf0-873b-6530d4abdaca admin admin] PATH_INFO: `/v3/projects/aefcff72caf6476599727e33d6603d37/users/3fc2c60bd37244769333e7c4912c8359/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:44.550716 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7d554-0feb-4cf0-873b-6530d4abdaca admin admin] RBAC: Authorizing `identity:create_grant(project_id=aefcff72caf6476599727e33d6603d37, user_id=3fc2c60bd37244769333e7c4912c8359, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:44.554942 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7d554-0feb-4cf0-873b-6530d4abdaca admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:44.589470 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:44.629484 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b913883-4c86-4bd1-b5ed-2c0a50b44cf1 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:44.632141 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-1b913883-4c86-4bd1-b5ed-2c0a50b44cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:44.661408 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 682/1349] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:32:44 2022] PUT /identity/v3/projects/aefcff72caf6476599727e33d6603d37/users/3fc2c60bd37244769333e7c4912c8359/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:44.663172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7d554-0feb-4cf0-873b-6530d4abdaca admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:44.767548 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b913883-4c86-4bd1-b5ed-2c0a50b44cf1 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:44.810293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7d554-0feb-4cf0-873b-6530d4abdaca admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:44.821512 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40bcb3-bbff-40c0-8a0d-7edcb0da9b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:44.823070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40bcb3-bbff-40c0-8a0d-7edcb0da9b18 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:44.823070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40bcb3-bbff-40c0-8a0d-7edcb0da9b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:44.823070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40bcb3-bbff-40c0-8a0d-7edcb0da9b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:44.823451 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40bcb3-bbff-40c0-8a0d-7edcb0da9b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:44.825086 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40bcb3-bbff-40c0-8a0d-7edcb0da9b18 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:44.848854 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 683/1350] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:44.853113 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40bcb3-bbff-40c0-8a0d-7edcb0da9b18 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:44.868493 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd83ef-9059-4495-9fb6-016e0a55d289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:44.869661 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd83ef-9059-4495-9fb6-016e0a55d289 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:44.870996 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd83ef-9059-4495-9fb6-016e0a55d289 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:44.872232 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd83ef-9059-4495-9fb6-016e0a55d289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:44.876791 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40bcb3-bbff-40c0-8a0d-7edcb0da9b18 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:44.888204 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd83ef-9059-4495-9fb6-016e0a55d289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:44.889950 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cc09a-5511-4eaa-94e7-be76073cada9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:44.890701 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cc09a-5511-4eaa-94e7-be76073cada9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:44.891121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cc09a-5511-4eaa-94e7-be76073cada9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:44.891458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cc09a-5511-4eaa-94e7-be76073cada9 admin admin] PATH_INFO: `/v3/projects/aefcff72caf6476599727e33d6603d37/users/3fc2c60bd37244769333e7c4912c8359/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:44.893607 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd83ef-9059-4495-9fb6-016e0a55d289 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:44.896174 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839cc09a-5511-4eaa-94e7-be76073cada9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aefcff72caf6476599727e33d6603d37, user_id=3fc2c60bd37244769333e7c4912c8359, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:44.901598 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839cc09a-5511-4eaa-94e7-be76073cada9 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:44.920358 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 668/1351] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:32:44.923201 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 684/1352] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:32:44 2022] PUT /identity/v3/projects/aefcff72caf6476599727e33d6603d37/users/3fc2c60bd37244769333e7c4912c8359/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:44.934442 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f8873-55c8-4c97-ad20-9bf3abd44024 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:44.935140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f8873-55c8-4c97-ad20-9bf3abd44024 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:44.935781 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f8873-55c8-4c97-ad20-9bf3abd44024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:45.002618 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-648f8873-55c8-4c97-ad20-9bf3abd44024 None None] MFA Rules not processed for user `3fc2c60bd37244769333e7c4912c8359`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:45.003909 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-648f8873-55c8-4c97-ad20-9bf3abd44024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:45.333020 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:45.361346 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 669/1353] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:32:45.373265 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cc09a-5511-4eaa-94e7-be76073cada9 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:45.375792 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-839cc09a-5511-4eaa-94e7-be76073cada9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:45.520897 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cc09a-5511-4eaa-94e7-be76073cada9 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:45.531647 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6050103-9a46-4bd4-a616-362f21a31dc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:45.539170 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6050103-9a46-4bd4-a616-362f21a31dc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:45.539706 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6050103-9a46-4bd4-a616-362f21a31dc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:45.542439 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6050103-9a46-4bd4-a616-362f21a31dc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:45.551914 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-b6050103-9a46-4bd4-a616-362f21a31dc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:45.682782 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:45.771472 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6050103-9a46-4bd4-a616-362f21a31dc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:45.771472 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6050103-9a46-4bd4-a616-362f21a31dc1 service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:45.808535 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 685/1354] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:32:46.910770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7bd7f-8c7a-4907-babc-7ba6613d09ea None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:46.911751 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7bd7f-8c7a-4907-babc-7ba6613d09ea None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:46.912180 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7bd7f-8c7a-4907-babc-7ba6613d09ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:47.314882 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-69b7bd7f-8c7a-4907-babc-7ba6613d09ea None None] MFA Rules not processed for user `34ba60c6edb94c27bbd01819da05acd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:47.314882 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-69b7bd7f-8c7a-4907-babc-7ba6613d09ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:47.314882 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 670/1355] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:47.322700 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdb75a-1bf2-4adf-8c46-0155fb2c781b None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:47.322700 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdb75a-1bf2-4adf-8c46-0155fb2c781b None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:47.322700 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdb75a-1bf2-4adf-8c46-0155fb2c781b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:47.322700 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-d5bdb75a-1bf2-4adf-8c46-0155fb2c781b None None] MFA Rules not processed for user `34ba60c6edb94c27bbd01819da05acd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:47.322700 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-d5bdb75a-1bf2-4adf-8c46-0155fb2c781b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:47.322700 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 686/1356] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:47.328966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7bd7f-8c7a-4907-babc-7ba6613d09ea None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:47.328966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-69b7bd7f-8c7a-4907-babc-7ba6613d09ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:47.469318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7bd7f-8c7a-4907-babc-7ba6613d09ea None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:47.476953 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715890d-2765-4b09-bdfa-738baba3760c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:47.478403 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715890d-2765-4b09-bdfa-738baba3760c service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:47.478403 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715890d-2765-4b09-bdfa-738baba3760c service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:47.478403 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715890d-2765-4b09-bdfa-738baba3760c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:47.503112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715890d-2765-4b09-bdfa-738baba3760c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:47.505655 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715890d-2765-4b09-bdfa-738baba3760c service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:47.520814 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbde68-5541-4203-badd-64040f6da85c None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:47.521106 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbde68-5541-4203-badd-64040f6da85c None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:47.521398 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbde68-5541-4203-badd-64040f6da85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:47.545875 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 671/1357] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:47 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:32:47.609993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:47.615478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-d7bbde68-5541-4203-badd-64040f6da85c None None] MFA Rules not processed for user `c1bb331f86884db48dbe8d2d2f70d15f`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:47.618996 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-d7bbde68-5541-4203-badd-64040f6da85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:47.625045 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715890d-2765-4b09-bdfa-738baba3760c service nova] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:47.626444 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-8715890d-2765-4b09-bdfa-738baba3760c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:47.808139 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 687/1358] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:47.812609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715890d-2765-4b09-bdfa-738baba3760c service nova] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:47.819495 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9ec9e-4ed5-4a99-accc-653482875517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:47.820411 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9ec9e-4ed5-4a99-accc-653482875517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:47.820935 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9ec9e-4ed5-4a99-accc-653482875517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:47.828508 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9ec9e-4ed5-4a99-accc-653482875517 admin admin] PATH_INFO: `/v3/projects/ec47d6d0778d46ab9586bcaf8beb29a3` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:47.828508 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9ec9e-4ed5-4a99-accc-653482875517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec47d6d0778d46ab9586bcaf8beb29a3)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:47.828704 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ab9ca-6822-445d-b87c-c477db9ca1cb None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:47.828704 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ab9ca-6822-445d-b87c-c477db9ca1cb None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:47.828704 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ab9ca-6822-445d-b87c-c477db9ca1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:47.828887 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9ec9e-4ed5-4a99-accc-653482875517 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:47.895270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-813ab9ca-6822-445d-b87c-c477db9ca1cb None None] MFA Rules not processed for user `c1bb331f86884db48dbe8d2d2f70d15f`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:47.896874 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-813ab9ca-6822-445d-b87c-c477db9ca1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:47.927065 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 688/1359] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:32:47.944827 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ab9ca-6822-445d-b87c-c477db9ca1cb None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:47.949907 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-813ab9ca-6822-445d-b87c-c477db9ca1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:47.997944 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-ddd9ec9e-4ed5-4a99-accc-653482875517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec47d6d0778d46ab9586bcaf8beb29a3', 'request_id': 'req-ddd9ec9e-4ed5-4a99-accc-653482875517'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:48.005307 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ab9ca-6822-445d-b87c-c477db9ca1cb None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:48.014032 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-ddd9ec9e-4ed5-4a99-accc-653482875517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec47d6d0778d46ab9586bcaf8beb29a3', 'request_id': 'req-ddd9ec9e-4ed5-4a99-accc-653482875517'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:48.064816 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-ddd9ec9e-4ed5-4a99-accc-653482875517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec47d6d0778d46ab9586bcaf8beb29a3', 'request_id': 'req-ddd9ec9e-4ed5-4a99-accc-653482875517'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:48.115672 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:48.208009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b0027-edc1-4073-af9d-354be3179bea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:48.208728 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b0027-edc1-4073-af9d-354be3179bea service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:48.209082 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b0027-edc1-4073-af9d-354be3179bea service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:48.209430 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b0027-edc1-4073-af9d-354be3179bea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:48.210214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-ddd9ec9e-4ed5-4a99-accc-653482875517 admin admin] The token cache is being invalidate because project ec47d6d0778d46ab9586bcaf8beb29a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:32:48.210518 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-ddd9ec9e-4ed5-4a99-accc-653482875517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:48.211534 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-ddd9ec9e-4ed5-4a99-accc-653482875517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:48.221548 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 672/1360] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:32:47 2022] DELETE /identity/v3/projects/ec47d6d0778d46ab9586bcaf8beb29a3 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:32:48.234704 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a8dd2-e295-4767-9907-91eec56459e9 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:48.237010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a8dd2-e295-4767-9907-91eec56459e9 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:48.237479 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a8dd2-e295-4767-9907-91eec56459e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:48.279304 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-507a8dd2-e295-4767-9907-91eec56459e9 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:48.283522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-507a8dd2-e295-4767-9907-91eec56459e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:48.344547 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b0027-edc1-4073-af9d-354be3179bea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:48.346311 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b0027-edc1-4073-af9d-354be3179bea service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:48.367133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 689/1361] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:32:48.444873 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0b30f-1f11-42fa-b0d1-faf6a64105c9 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:48.445002 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 673/1362] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:48.449040 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0b30f-1f11-42fa-b0d1-faf6a64105c9 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:48.449040 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0b30f-1f11-42fa-b0d1-faf6a64105c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:48.490716 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-a5a0b30f-1f11-42fa-b0d1-faf6a64105c9 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:48.492120 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-a5a0b30f-1f11-42fa-b0d1-faf6a64105c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:48.503438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 690/1363] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:48.508403 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a8dd2-e295-4767-9907-91eec56459e9 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:48.521501 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a8dd2-e295-4767-9907-91eec56459e9 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:48.536405 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c8ce2-8e6e-4a7f-98c7-3e7890edc406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:48.537264 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c8ce2-8e6e-4a7f-98c7-3e7890edc406 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:48.537626 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c8ce2-8e6e-4a7f-98c7-3e7890edc406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:48.542285 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c8ce2-8e6e-4a7f-98c7-3e7890edc406 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:48.542285 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c8ce2-8e6e-4a7f-98c7-3e7890edc406 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:32:48.542285 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c8ce2-8e6e-4a7f-98c7-3e7890edc406 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:48.542285 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c8ce2-8e6e-4a7f-98c7-3e7890edc406 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:48.587017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 674/1364] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:32:48.590969 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0b30f-1f11-42fa-b0d1-faf6a64105c9 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:48.607705 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf8f45-71d0-4ac8-8364-952d5cba1a04 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:48.607988 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf8f45-71d0-4ac8-8364-952d5cba1a04 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:48.608266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf8f45-71d0-4ac8-8364-952d5cba1a04 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:48.609021 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0b30f-1f11-42fa-b0d1-faf6a64105c9 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:48.609626 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 675/1365] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 19 02:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:32:48.616862 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f3286-f9a3-4f86-963f-f2391178a977 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:48.617258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f3286-f9a3-4f86-963f-f2391178a977 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:48.617791 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f3286-f9a3-4f86-963f-f2391178a977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:48.619864 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746041b5-c072-4f0a-8f7d-f1baf52babfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:48.620536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746041b5-c072-4f0a-8f7d-f1baf52babfe admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:48.620816 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746041b5-c072-4f0a-8f7d-f1baf52babfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:48.621089 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746041b5-c072-4f0a-8f7d-f1baf52babfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:48.621819 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746041b5-c072-4f0a-8f7d-f1baf52babfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:48.623816 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746041b5-c072-4f0a-8f7d-f1baf52babfe admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:48.705971 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-293f3286-f9a3-4f86-963f-f2391178a977 None None] MFA Rules not processed for user `e7e4640bd879468d81ec0281827687ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:48.708037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-293f3286-f9a3-4f86-963f-f2391178a977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:48.762132 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 691/1366] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:32:48 2022] POST /identity/v3/projects => generated 405 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:48.763298 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746041b5-c072-4f0a-8f7d-f1baf52babfe admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:48.849609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 676/1367] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 02:32:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:32:48.902287 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746041b5-c072-4f0a-8f7d-f1baf52babfe admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:48.911947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6585c-9c4e-43eb-b9a7-2b05ba51feb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:48.915423 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6585c-9c4e-43eb-b9a7-2b05ba51feb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:48.915798 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6585c-9c4e-43eb-b9a7-2b05ba51feb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:48.920027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6585c-9c4e-43eb-b9a7-2b05ba51feb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:48.920834 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6585c-9c4e-43eb-b9a7-2b05ba51feb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:48.922833 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6585c-9c4e-43eb-b9a7-2b05ba51feb8 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:48.968134 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f3286-f9a3-4f86-963f-f2391178a977 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:48.969746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-293f3286-f9a3-4f86-963f-f2391178a977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:48.999844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f3286-f9a3-4f86-963f-f2391178a977 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:49.054730 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 692/1368] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:32:48 2022] POST /identity/v3/users => generated 303 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:32:49.056664 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6585c-9c4e-43eb-b9a7-2b05ba51feb8 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:49.064929 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:49.076213 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6585c-9c4e-43eb-b9a7-2b05ba51feb8 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:49.089935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98d825-604a-4ca8-b4f5-24a4fdc8282d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:49.097176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98d825-604a-4ca8-b4f5-24a4fdc8282d admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:49.097176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98d825-604a-4ca8-b4f5-24a4fdc8282d admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:49.104087 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98d825-604a-4ca8-b4f5-24a4fdc8282d admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:49.104906 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98d825-604a-4ca8-b4f5-24a4fdc8282d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:49.106182 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e479a-f1c4-423f-8dd6-d902864c1363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:49.106873 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e479a-f1c4-423f-8dd6-d902864c1363 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:49.107156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e479a-f1c4-423f-8dd6-d902864c1363 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:49.107473 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e479a-f1c4-423f-8dd6-d902864c1363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:49.117234 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98d825-604a-4ca8-b4f5-24a4fdc8282d admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:49.120270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e479a-f1c4-423f-8dd6-d902864c1363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:49.123463 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e479a-f1c4-423f-8dd6-d902864c1363 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:49.137724 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 677/1369] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:32:49.145794 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 693/1370] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:32:49.151288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e479a-f1c4-423f-8dd6-d902864c1363 service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:49.162954 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e479a-f1c4-423f-8dd6-d902864c1363 service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:49.168177 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9c162-702a-4b0c-b3d6-04d195017705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:49.169573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9c162-702a-4b0c-b3d6-04d195017705 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:49.169573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9c162-702a-4b0c-b3d6-04d195017705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:49.169573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9c162-702a-4b0c-b3d6-04d195017705 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:49.170065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9c162-702a-4b0c-b3d6-04d195017705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:49.171630 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9c162-702a-4b0c-b3d6-04d195017705 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:49.188792 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98d825-604a-4ca8-b4f5-24a4fdc8282d admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:49.189716 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 678/1371] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:49.201067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98d825-604a-4ca8-b4f5-24a4fdc8282d admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:49.210459 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba537937-d387-4324-be43-afd2c734c42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:49.212742 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba537937-d387-4324-be43-afd2c734c42a admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:49.213230 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba537937-d387-4324-be43-afd2c734c42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:49.213736 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba537937-d387-4324-be43-afd2c734c42a admin admin] PATH_INFO: `/v3/projects/1c3d4989e3e446978f6ea79e1353912e/users/c7376aa5906e41d388763fe4c0b24144/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:49.248873 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b673b-06f4-4f8c-833c-8304bc72c4a8 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:49.248873 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b673b-06f4-4f8c-833c-8304bc72c4a8 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:49.249214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b673b-06f4-4f8c-833c-8304bc72c4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:49.254098 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba537937-d387-4324-be43-afd2c734c42a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c3d4989e3e446978f6ea79e1353912e, user_id=c7376aa5906e41d388763fe4c0b24144, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:49.257320 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba537937-d387-4324-be43-afd2c734c42a admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:49.285876 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-4b6b673b-06f4-4f8c-833c-8304bc72c4a8 None None] MFA Rules not processed for user `c3710c28c15344ecb07d14a507d46dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:49.287553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-4b6b673b-06f4-4f8c-833c-8304bc72c4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:49.358092 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 694/1372] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:32:49 2022] PUT /identity/v3/projects/1c3d4989e3e446978f6ea79e1353912e/users/c7376aa5906e41d388763fe4c0b24144/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:49.371228 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a89180-5458-4e5b-8db2-3f34e54282a6 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:49.372082 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a89180-5458-4e5b-8db2-3f34e54282a6 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:49.372236 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a89180-5458-4e5b-8db2-3f34e54282a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:49.432455 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:49.440484 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-d4a89180-5458-4e5b-8db2-3f34e54282a6 None None] MFA Rules not processed for user `c7376aa5906e41d388763fe4c0b24144`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:49.443241 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-d4a89180-5458-4e5b-8db2-3f34e54282a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:49.471406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 679/1373] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:49 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:49.472667 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b673b-06f4-4f8c-833c-8304bc72c4a8 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:49.477346 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-4b6b673b-06f4-4f8c-833c-8304bc72c4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:49.518744 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b673b-06f4-4f8c-833c-8304bc72c4a8 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:49.632178 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 695/1374] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:49 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:32:49.637799 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a89180-5458-4e5b-8db2-3f34e54282a6 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:49.639414 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-d4a89180-5458-4e5b-8db2-3f34e54282a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:49.668561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6f524-f976-4f92-8394-526c667c91aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:49.669496 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6f524-f976-4f92-8394-526c667c91aa admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:49.669874 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6f524-f976-4f92-8394-526c667c91aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:49.670246 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6f524-f976-4f92-8394-526c667c91aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:49.672196 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6f524-f976-4f92-8394-526c667c91aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:49.674984 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6f524-f976-4f92-8394-526c667c91aa admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:49.772155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:49.814599 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 680/1375] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:32:49 2022] POST /identity/v3/projects => generated 401 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:49.816127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f178e4b-580f-43eb-a3ec-dc72a80b61e4 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:49.816437 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f178e4b-580f-43eb-a3ec-dc72a80b61e4 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:49.816712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f178e4b-580f-43eb-a3ec-dc72a80b61e4 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:49.819459 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a89180-5458-4e5b-8db2-3f34e54282a6 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:49.824584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 681/1376] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 19 02:32:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:32:49.825929 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81360b81-6899-4dfd-ac83-55f4fe769506 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:49.826211 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81360b81-6899-4dfd-ac83-55f4fe769506 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:49.827580 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81360b81-6899-4dfd-ac83-55f4fe769506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:49.909110 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-81360b81-6899-4dfd-ac83-55f4fe769506 None None] MFA Rules not processed for user `4e5c1ceb415a47fb81c7226508f011ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:49.910450 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-81360b81-6899-4dfd-ac83-55f4fe769506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:49.930123 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed8823-7391-4134-bedf-02101f7b1113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:49.931656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed8823-7391-4134-bedf-02101f7b1113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:49.931656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed8823-7391-4134-bedf-02101f7b1113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:49.932790 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed8823-7391-4134-bedf-02101f7b1113 admin admin] PATH_INFO: `/v3/users/0e3b3e6d1d1f4c71b8e27b9f6f62979f` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:49.934433 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed8823-7391-4134-bedf-02101f7b1113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e3b3e6d1d1f4c71b8e27b9f6f62979f)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:49.937277 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed8823-7391-4134-bedf-02101f7b1113 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:49.989472 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:50.003638 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 682/1377] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:50.004607 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81360b81-6899-4dfd-ac83-55f4fe769506 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:50.018094 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81360b81-6899-4dfd-ac83-55f4fe769506 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:50.022759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e3183-7f45-43c3-a240-a773d7e25a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:50.023921 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e3183-7f45-43c3-a240-a773d7e25a67 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:50.024966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e3183-7f45-43c3-a240-a773d7e25a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:50.025245 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e3183-7f45-43c3-a240-a773d7e25a67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:50.025946 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e3183-7f45-43c3-a240-a773d7e25a67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:50.029800 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e3183-7f45-43c3-a240-a773d7e25a67 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:50.242672 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 683/1378] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:32:50 2022] POST /identity/v3/projects => generated 403 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:50.244627 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d4c40-775b-4190-9601-a746e6826fc5 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:50.245072 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d4c40-775b-4190-9601-a746e6826fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:50.245548 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d4c40-775b-4190-9601-a746e6826fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:50.283931 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-bb0d4c40-775b-4190-9601-a746e6826fc5 None None] MFA Rules not processed for user `5eabc00f209a48f88e8e2ca28dd3e8df`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:50.285364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-bb0d4c40-775b-4190-9601-a746e6826fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:50.295847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-9bed8823-7391-4134-bedf-02101f7b1113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e3b3e6d1d1f4c71b8e27b9f6f62979f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:50.297125 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-9bed8823-7391-4134-bedf-02101f7b1113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e3b3e6d1d1f4c71b8e27b9f6f62979f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:50.363233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 684/1379] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:50.364198 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d4c40-775b-4190-9601-a746e6826fc5 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:50.367602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-bb0d4c40-775b-4190-9601-a746e6826fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:50.409467 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-9bed8823-7391-4134-bedf-02101f7b1113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e3b3e6d1d1f4c71b8e27b9f6f62979f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:50.429081 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-9bed8823-7391-4134-bedf-02101f7b1113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e3b3e6d1d1f4c71b8e27b9f6f62979f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:50.431310 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-9bed8823-7391-4134-bedf-02101f7b1113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e3b3e6d1d1f4c71b8e27b9f6f62979f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:50.460341 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 696/1380] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:32:49 2022] DELETE /identity/v3/users/0e3b3e6d1d1f4c71b8e27b9f6f62979f => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:50.463936 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef868b0-dffa-4367-b0e0-06b5ae432c5d None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:50.464445 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef868b0-dffa-4367-b0e0-06b5ae432c5d None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:50.464900 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef868b0-dffa-4367-b0e0-06b5ae432c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:50.488332 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d4c40-775b-4190-9601-a746e6826fc5 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:50.492349 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-eef868b0-dffa-4367-b0e0-06b5ae432c5d None None] MFA Rules not processed for user `e7e4640bd879468d81ec0281827687ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:50.494340 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-eef868b0-dffa-4367-b0e0-06b5ae432c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:50.572681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cbdfa-036f-43aa-9602-ffb72821ae83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:50.573307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cbdfa-036f-43aa-9602-ffb72821ae83 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:50.573647 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cbdfa-036f-43aa-9602-ffb72821ae83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:50.573943 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cbdfa-036f-43aa-9602-ffb72821ae83 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:50.575777 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cbdfa-036f-43aa-9602-ffb72821ae83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:50.577060 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cbdfa-036f-43aa-9602-ffb72821ae83 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:50.589062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 697/1381] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 02:32:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:50.591056 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef868b0-dffa-4367-b0e0-06b5ae432c5d None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:50.593015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-eef868b0-dffa-4367-b0e0-06b5ae432c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:50.683536 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 685/1382] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:32:50 2022] POST /identity/v3/users => generated 307 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:50.685644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cbdfa-036f-43aa-9602-ffb72821ae83 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:50.688325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-854cbdfa-036f-43aa-9602-ffb72821ae83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:50.703281 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cbdfa-036f-43aa-9602-ffb72821ae83 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:50.709690 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fea25-6b58-40df-b421-b7091d397b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:50.710431 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fea25-6b58-40df-b421-b7091d397b2f admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:50.710785 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fea25-6b58-40df-b421-b7091d397b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:50.711163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fea25-6b58-40df-b421-b7091d397b2f admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:50.712969 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fea25-6b58-40df-b421-b7091d397b2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:50.715340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fea25-6b58-40df-b421-b7091d397b2f admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:50.729917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef868b0-dffa-4367-b0e0-06b5ae432c5d None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:50.737745 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa64df-2332-4974-8eb9-4272f3a72e5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:50.738789 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa64df-2332-4974-8eb9-4272f3a72e5e service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:50.739488 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa64df-2332-4974-8eb9-4272f3a72e5e service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:50.740178 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa64df-2332-4974-8eb9-4272f3a72e5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:50.742745 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-abaa64df-2332-4974-8eb9-4272f3a72e5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:50.845478 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 686/1383] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:32:50 2022] POST /identity/v3/users => generated 308 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:50.846228 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fea25-6b58-40df-b421-b7091d397b2f admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:50.853383 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-a97fea25-6b58-40df-b421-b7091d397b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:50.865257 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa64df-2332-4974-8eb9-4272f3a72e5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:50.867070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa64df-2332-4974-8eb9-4272f3a72e5e service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:50.890717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 698/1384] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:32:50.912388 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd9fb7-ff7a-4170-934b-65fa26ff9e34 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:50.912694 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd9fb7-ff7a-4170-934b-65fa26ff9e34 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:50.913352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd9fb7-ff7a-4170-934b-65fa26ff9e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:50.976025 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-dbcd9fb7-ff7a-4170-934b-65fa26ff9e34 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:50.978157 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-dbcd9fb7-ff7a-4170-934b-65fa26ff9e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:51.002029 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 699/1385] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:51.004145 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd9fb7-ff7a-4170-934b-65fa26ff9e34 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:51.009074 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-dbcd9fb7-ff7a-4170-934b-65fa26ff9e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:51.032089 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd9fb7-ff7a-4170-934b-65fa26ff9e34 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:51.046256 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5715d-66b1-4110-8d6a-8792f79a59d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:51.047707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5715d-66b1-4110-8d6a-8792f79a59d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:51.048005 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5715d-66b1-4110-8d6a-8792f79a59d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:51.048285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5715d-66b1-4110-8d6a-8792f79a59d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:51.062747 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5715d-66b1-4110-8d6a-8792f79a59d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:51.064352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5715d-66b1-4110-8d6a-8792f79a59d2 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:51.082053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 700/1386] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:32:51.085306 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5715d-66b1-4110-8d6a-8792f79a59d2 service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:51.114128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fea25-6b58-40df-b421-b7091d397b2f admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:51.121554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2582c51-d835-4140-8680-6afe730bbfbd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66b9bc695b44877a06f17ea6bbeb27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:51.122603 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2582c51-d835-4140-8680-6afe730bbfbd service placement] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:51.122966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2582c51-d835-4140-8680-6afe730bbfbd service placement] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:51.123250 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2582c51-d835-4140-8680-6afe730bbfbd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:51.131818 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-f2582c51-d835-4140-8680-6afe730bbfbd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:51.132360 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5715d-66b1-4110-8d6a-8792f79a59d2 service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:51.136502 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080beb99-7bf3-4c60-9ff9-3a9cf0398ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:51.137281 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080beb99-7bf3-4c60-9ff9-3a9cf0398ecc admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:51.137563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080beb99-7bf3-4c60-9ff9-3a9cf0398ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:51.137976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080beb99-7bf3-4c60-9ff9-3a9cf0398ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:51.138715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080beb99-7bf3-4c60-9ff9-3a9cf0398ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:51.140383 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080beb99-7bf3-4c60-9ff9-3a9cf0398ecc admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:51.153829 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2582c51-d835-4140-8680-6afe730bbfbd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:51.155466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 701/1387] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:51.155786 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2582c51-d835-4140-8680-6afe730bbfbd service placement] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:51.156472 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080beb99-7bf3-4c60-9ff9-3a9cf0398ecc admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:51.160579 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-080beb99-7bf3-4c60-9ff9-3a9cf0398ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:51.204593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 687/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:32:51.205466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2582c51-d835-4140-8680-6afe730bbfbd service placement] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:51.248171 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2582c51-d835-4140-8680-6afe730bbfbd service placement] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:51.264036 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd378dc-d4cf-4619-9845-be194a180c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:51.264347 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd378dc-d4cf-4619-9845-be194a180c7e admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:51.264604 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd378dc-d4cf-4619-9845-be194a180c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:51.264876 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd378dc-d4cf-4619-9845-be194a180c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:51.273218 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd378dc-d4cf-4619-9845-be194a180c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:51.275117 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd378dc-d4cf-4619-9845-be194a180c7e admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:51.297311 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080beb99-7bf3-4c60-9ff9-3a9cf0398ecc admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:51.309542 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 688/1389] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:51.310396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a565e-3a04-412d-9045-fbc6132772c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:51.312398 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a565e-3a04-412d-9045-fbc6132772c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:51.312674 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd378dc-d4cf-4619-9845-be194a180c7e admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:51.312783 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a565e-3a04-412d-9045-fbc6132772c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:51.313155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a565e-3a04-412d-9045-fbc6132772c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:51.321059 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-032a565e-3a04-412d-9045-fbc6132772c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:51.341705 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd378dc-d4cf-4619-9845-be194a180c7e admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:51.356948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5283e93-a7fe-48f5-a53b-798513f67b8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:51.357577 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5283e93-a7fe-48f5-a53b-798513f67b8f service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:51.357855 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5283e93-a7fe-48f5-a53b-798513f67b8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:51.358125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5283e93-a7fe-48f5-a53b-798513f67b8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:51.380354 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5283e93-a7fe-48f5-a53b-798513f67b8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:51.381833 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5283e93-a7fe-48f5-a53b-798513f67b8f service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:51.408973 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 689/1390] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:32:51.408973 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5283e93-a7fe-48f5-a53b-798513f67b8f service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:51.436209 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5283e93-a7fe-48f5-a53b-798513f67b8f service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:51.449060 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd000b6-70b7-4af8-82a5-4ffca4c117c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:51.449060 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd000b6-70b7-4af8-82a5-4ffca4c117c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:51.449060 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd000b6-70b7-4af8-82a5-4ffca4c117c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:51.449489 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd000b6-70b7-4af8-82a5-4ffca4c117c5 admin admin] PATH_INFO: `/v3/projects/7634597b211d49d190902114061215c1/users/6a1377a115b940b4bb496c339b70cd20/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:51.470012 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd000b6-70b7-4af8-82a5-4ffca4c117c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7634597b211d49d190902114061215c1, user_id=6a1377a115b940b4bb496c339b70cd20, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:51.473780 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd000b6-70b7-4af8-82a5-4ffca4c117c5 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:51.507025 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a565e-3a04-412d-9045-fbc6132772c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:51.513263 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a565e-3a04-412d-9045-fbc6132772c4 service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:51.545168 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 702/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:32:51.551959 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a565e-3a04-412d-9045-fbc6132772c4 service cinder] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:51.596058 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a565e-3a04-412d-9045-fbc6132772c4 service cinder] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:51.607380 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 690/1392] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:32:51 2022] PUT /identity/v3/projects/7634597b211d49d190902114061215c1/users/6a1377a115b940b4bb496c339b70cd20/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:51.611796 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd000b6-70b7-4af8-82a5-4ffca4c117c5 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:51.614951 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a5ec7-dd17-4731-b220-aecd60a8f024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:51.619522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a5ec7-dd17-4731-b220-aecd60a8f024 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:51.632438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a5ec7-dd17-4731-b220-aecd60a8f024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:51.635992 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a5ec7-dd17-4731-b220-aecd60a8f024 admin admin] PATH_INFO: `/v3/projects/cf5d8fb6f1d948859a5bd1779823c939/users/ae2af158779e4c9690dd1084fb4f836c/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:51.677203 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a5ec7-dd17-4731-b220-aecd60a8f024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5d8fb6f1d948859a5bd1779823c939, user_id=ae2af158779e4c9690dd1084fb4f836c, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:51.683543 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a5ec7-dd17-4731-b220-aecd60a8f024 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:51.691682 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:51.732950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd000b6-70b7-4af8-82a5-4ffca4c117c5 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:51.739509 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc3ff6-e356-4269-b090-62bee7d47cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:51.740442 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc3ff6-e356-4269-b090-62bee7d47cbf admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:51.740935 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc3ff6-e356-4269-b090-62bee7d47cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:51.741389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc3ff6-e356-4269-b090-62bee7d47cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:51.743065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc3ff6-e356-4269-b090-62bee7d47cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:51.751251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc3ff6-e356-4269-b090-62bee7d47cbf admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:51.764289 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 691/1393] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:51.778698 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc3ff6-e356-4269-b090-62bee7d47cbf admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:51.831011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 703/1394] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:32:51 2022] PUT /identity/v3/projects/cf5d8fb6f1d948859a5bd1779823c939/users/ae2af158779e4c9690dd1084fb4f836c/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:51.844794 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc3ff6-e356-4269-b090-62bee7d47cbf admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:51.845956 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b56d76-d15f-48a1-80a7-9e7fb671309e None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:51.846441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b56d76-d15f-48a1-80a7-9e7fb671309e None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:51.849346 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b56d76-d15f-48a1-80a7-9e7fb671309e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:51.948331 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-10b56d76-d15f-48a1-80a7-9e7fb671309e None None] MFA Rules not processed for user `34ba60c6edb94c27bbd01819da05acd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:51.977307 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-10b56d76-d15f-48a1-80a7-9e7fb671309e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:52.055568 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894780af-5939-4d77-af37-002adc03ba20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:52.056672 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894780af-5939-4d77-af37-002adc03ba20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:52.056995 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894780af-5939-4d77-af37-002adc03ba20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:52.057270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894780af-5939-4d77-af37-002adc03ba20 admin admin] PATH_INFO: `/v3/projects/7634597b211d49d190902114061215c1/users/6a1377a115b940b4bb496c339b70cd20/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:52.060314 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894780af-5939-4d77-af37-002adc03ba20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7634597b211d49d190902114061215c1, user_id=6a1377a115b940b4bb496c339b70cd20, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:52.063428 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894780af-5939-4d77-af37-002adc03ba20 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:52.083403 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 692/1395] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:32:51 2022] PUT /identity/v3/projects/7634597b211d49d190902114061215c1/users/6a1377a115b940b4bb496c339b70cd20/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:52.084489 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894780af-5939-4d77-af37-002adc03ba20 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:52.135273 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 704/1396] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:52.184074 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894780af-5939-4d77-af37-002adc03ba20 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:52.211664 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81102a30-11d9-473d-8740-a3f1cd9068ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:52.212488 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81102a30-11d9-473d-8740-a3f1cd9068ab admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:52.214307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81102a30-11d9-473d-8740-a3f1cd9068ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:52.215274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81102a30-11d9-473d-8740-a3f1cd9068ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:52.217085 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81102a30-11d9-473d-8740-a3f1cd9068ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:52.233866 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81102a30-11d9-473d-8740-a3f1cd9068ab admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:52.266293 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 693/1397] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:52.267513 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b56d76-d15f-48a1-80a7-9e7fb671309e None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:52.289931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b56d76-d15f-48a1-80a7-9e7fb671309e None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:52.299103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd3a94-e030-4dc5-b362-26e823527dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:52.299791 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd3a94-e030-4dc5-b362-26e823527dca admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:52.300072 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd3a94-e030-4dc5-b362-26e823527dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:52.300351 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd3a94-e030-4dc5-b362-26e823527dca admin admin] PATH_INFO: `/v3/projects/cf5d8fb6f1d948859a5bd1779823c939/users/ae2af158779e4c9690dd1084fb4f836c/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:52.306422 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd3a94-e030-4dc5-b362-26e823527dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5d8fb6f1d948859a5bd1779823c939, user_id=ae2af158779e4c9690dd1084fb4f836c, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:52.313864 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd3a94-e030-4dc5-b362-26e823527dca admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:52.349105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 705/1398] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:32:52 2022] PUT /identity/v3/projects/cf5d8fb6f1d948859a5bd1779823c939/users/ae2af158779e4c9690dd1084fb4f836c/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:52.351221 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ca526-6c05-4410-b804-ae3424134a08 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:52.351514 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ca526-6c05-4410-b804-ae3424134a08 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:52.351828 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ca526-6c05-4410-b804-ae3424134a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:52.442842 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-106ca526-6c05-4410-b804-ae3424134a08 None None] MFA Rules not processed for user `ae2af158779e4c9690dd1084fb4f836c`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:52.447393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-106ca526-6c05-4410-b804-ae3424134a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:52.504544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:52.673950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 694/1399] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:52 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:52.703847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd3a94-e030-4dc5-b362-26e823527dca admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:52.709185 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-f3cd3a94-e030-4dc5-b362-26e823527dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:52.812057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd3a94-e030-4dc5-b362-26e823527dca admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:52.849950 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd01a1e-52c6-4894-b89a-358d0d45fe99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:52.850565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd01a1e-52c6-4894-b89a-358d0d45fe99 service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:52.850867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd01a1e-52c6-4894-b89a-358d0d45fe99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:52.851138 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd01a1e-52c6-4894-b89a-358d0d45fe99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:52.868399 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd01a1e-52c6-4894-b89a-358d0d45fe99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:52.872730 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd01a1e-52c6-4894-b89a-358d0d45fe99 service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:52.895432 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 706/1400] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:52 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:32:53.223867 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ca526-6c05-4410-b804-ae3424134a08 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:53.314236 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd01a1e-52c6-4894-b89a-358d0d45fe99 service cinder] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:53.316286 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-3bd01a1e-52c6-4894-b89a-358d0d45fe99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:53.424156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ca526-6c05-4410-b804-ae3424134a08 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:53.430993 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1f8ee-dcc2-4182-a2fa-5d2dd87e62fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:53.432543 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1f8ee-dcc2-4182-a2fa-5d2dd87e62fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:53.433014 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1f8ee-dcc2-4182-a2fa-5d2dd87e62fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:53.433568 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1f8ee-dcc2-4182-a2fa-5d2dd87e62fc admin admin] PATH_INFO: `/v3/users/c7376aa5906e41d388763fe4c0b24144` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:53.435413 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1f8ee-dcc2-4182-a2fa-5d2dd87e62fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7376aa5906e41d388763fe4c0b24144)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:53.440843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1f8ee-dcc2-4182-a2fa-5d2dd87e62fc admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:53.534404 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd01a1e-52c6-4894-b89a-358d0d45fe99 service cinder] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:53.540600 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9fbb9-b685-45f8-b0d6-7af949c5bd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:53.542172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9fbb9-b685-45f8-b0d6-7af949c5bd9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:53.545445 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9fbb9-b685-45f8-b0d6-7af949c5bd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:53.545445 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9fbb9-b685-45f8-b0d6-7af949c5bd9b admin admin] PATH_INFO: `/v3/projects/25a4a058ff574c259474c9105774ce39` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:53.545445 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9fbb9-b685-45f8-b0d6-7af949c5bd9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=25a4a058ff574c259474c9105774ce39)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:53.548154 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9fbb9-b685-45f8-b0d6-7af949c5bd9b admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:53.871012 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-38b1f8ee-dcc2-4182-a2fa-5d2dd87e62fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7376aa5906e41d388763fe4c0b24144'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:53.872269 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-38b1f8ee-dcc2-4182-a2fa-5d2dd87e62fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7376aa5906e41d388763fe4c0b24144'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:53.927155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-48a9fbb9-b685-45f8-b0d6-7af949c5bd9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25a4a058ff574c259474c9105774ce39', 'request_id': 'req-48a9fbb9-b685-45f8-b0d6-7af949c5bd9b'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:53.954347 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-48a9fbb9-b685-45f8-b0d6-7af949c5bd9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25a4a058ff574c259474c9105774ce39', 'request_id': 'req-48a9fbb9-b685-45f8-b0d6-7af949c5bd9b'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:53.990032 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-38b1f8ee-dcc2-4182-a2fa-5d2dd87e62fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7376aa5906e41d388763fe4c0b24144'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:54.003989 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-38b1f8ee-dcc2-4182-a2fa-5d2dd87e62fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7376aa5906e41d388763fe4c0b24144'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:54.004945 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-38b1f8ee-dcc2-4182-a2fa-5d2dd87e62fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7376aa5906e41d388763fe4c0b24144'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:54.063751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-48a9fbb9-b685-45f8-b0d6-7af949c5bd9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25a4a058ff574c259474c9105774ce39', 'request_id': 'req-48a9fbb9-b685-45f8-b0d6-7af949c5bd9b'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:54.065436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 695/1401] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:32:53 2022] DELETE /identity/v3/users/c7376aa5906e41d388763fe4c0b24144 => generated 0 bytes in 843 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:54.070284 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319e833-4412-44e0-bcb6-dd07a9798748 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:54.070983 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319e833-4412-44e0-bcb6-dd07a9798748 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:54.073562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319e833-4412-44e0-bcb6-dd07a9798748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:54.080329 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-48a9fbb9-b685-45f8-b0d6-7af949c5bd9b admin admin] The token cache is being invalidate because project 25a4a058ff574c259474c9105774ce39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:32:54.080934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-48a9fbb9-b685-45f8-b0d6-7af949c5bd9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:54.081954 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-48a9fbb9-b685-45f8-b0d6-7af949c5bd9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:54.084353 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 707/1402] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:32:53 2022] DELETE /identity/v3/projects/25a4a058ff574c259474c9105774ce39 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:32:54.098781 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9fbb9-b685-45f8-b0d6-7af949c5bd9b admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:54.104246 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-48a9fbb9-b685-45f8-b0d6-7af949c5bd9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:54.104428 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-9319e833-4412-44e0-bcb6-dd07a9798748 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:54.105684 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-9319e833-4412-44e0-bcb6-dd07a9798748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:54.266690 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 696/1403] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:32:54.274895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9fbb9-b685-45f8-b0d6-7af949c5bd9b admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:54.280641 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ea22d-a5fc-4ebc-8f9d-d19ce19f73b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:54.282697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ea22d-a5fc-4ebc-8f9d-d19ce19f73b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:54.283275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ea22d-a5fc-4ebc-8f9d-d19ce19f73b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:54.284042 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ea22d-a5fc-4ebc-8f9d-d19ce19f73b6 admin admin] PATH_INFO: `/v3/users/205cf875f57c435d90060b5b4fd85090` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:54.285790 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ea22d-a5fc-4ebc-8f9d-d19ce19f73b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=205cf875f57c435d90060b5b4fd85090)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:54.288073 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ea22d-a5fc-4ebc-8f9d-d19ce19f73b6 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:54.315170 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319e833-4412-44e0-bcb6-dd07a9798748 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:54.317066 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-9319e833-4412-44e0-bcb6-dd07a9798748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:54.530418 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319e833-4412-44e0-bcb6-dd07a9798748 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:54.547609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a271fa4-6ce0-46ef-9311-3c418f70cb88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:54.548482 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a271fa4-6ce0-46ef-9311-3c418f70cb88 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:54.550330 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a271fa4-6ce0-46ef-9311-3c418f70cb88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:54.551201 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a271fa4-6ce0-46ef-9311-3c418f70cb88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:54.629017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a271fa4-6ce0-46ef-9311-3c418f70cb88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:54.637394 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a271fa4-6ce0-46ef-9311-3c418f70cb88 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:54.730902 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 697/1404] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:32:55.039998 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-fc5ea22d-a5fc-4ebc-8f9d-d19ce19f73b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '205cf875f57c435d90060b5b4fd85090'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:55.044324 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-fc5ea22d-a5fc-4ebc-8f9d-d19ce19f73b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '205cf875f57c435d90060b5b4fd85090'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:55.221595 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-fc5ea22d-a5fc-4ebc-8f9d-d19ce19f73b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '205cf875f57c435d90060b5b4fd85090'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:55.289434 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-fc5ea22d-a5fc-4ebc-8f9d-d19ce19f73b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '205cf875f57c435d90060b5b4fd85090'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:55.290620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-fc5ea22d-a5fc-4ebc-8f9d-d19ce19f73b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '205cf875f57c435d90060b5b4fd85090'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:55.310673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 708/1405] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:32:54 2022] DELETE /identity/v3/users/205cf875f57c435d90060b5b4fd85090 => generated 0 bytes in 1221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:55.451622 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:55.738444 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c2ff7-03d9-493a-a73b-eaae020508c5 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:55.739122 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c2ff7-03d9-493a-a73b-eaae020508c5 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:55.739653 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c2ff7-03d9-493a-a73b-eaae020508c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:55.785364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-fd1c2ff7-03d9-493a-a73b-eaae020508c5 None None] MFA Rules not processed for user `6a1377a115b940b4bb496c339b70cd20`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:55.787099 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-fd1c2ff7-03d9-493a-a73b-eaae020508c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:55.951490 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:56.036713 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 698/1406] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:55 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:56.354431 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ea22d-a5fc-4ebc-8f9d-d19ce19f73b6 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:56.356615 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-fc5ea22d-a5fc-4ebc-8f9d-d19ce19f73b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:56.487082 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ea22d-a5fc-4ebc-8f9d-d19ce19f73b6 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:56.499955 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee32be-9fc7-4465-8bc1-8e8940b3d3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:56.500766 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee32be-9fc7-4465-8bc1-8e8940b3d3a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:56.501095 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee32be-9fc7-4465-8bc1-8e8940b3d3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:56.501373 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee32be-9fc7-4465-8bc1-8e8940b3d3a6 admin admin] PATH_INFO: `/v3/projects/1c3d4989e3e446978f6ea79e1353912e` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:56.502687 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee32be-9fc7-4465-8bc1-8e8940b3d3a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c3d4989e3e446978f6ea79e1353912e)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:56.509185 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee32be-9fc7-4465-8bc1-8e8940b3d3a6 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:56.602938 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c2ff7-03d9-493a-a73b-eaae020508c5 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:56.604852 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-fd1c2ff7-03d9-493a-a73b-eaae020508c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:56.627259 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c2ff7-03d9-493a-a73b-eaae020508c5 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:56.647669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82b177-fdce-4e02-ad55-6f281753fd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:56.648353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82b177-fdce-4e02-ad55-6f281753fd69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:56.649202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82b177-fdce-4e02-ad55-6f281753fd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:56.649202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82b177-fdce-4e02-ad55-6f281753fd69 admin admin] PATH_INFO: `/v3/projects/0e9361251c17441890293a634dc93675` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:56.650753 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82b177-fdce-4e02-ad55-6f281753fd69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e9361251c17441890293a634dc93675)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:56.652694 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82b177-fdce-4e02-ad55-6f281753fd69 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:56.734354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-8fee32be-9fc7-4465-8bc1-8e8940b3d3a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c3d4989e3e446978f6ea79e1353912e', 'request_id': 'req-8fee32be-9fc7-4465-8bc1-8e8940b3d3a6'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:56.755645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-8fee32be-9fc7-4465-8bc1-8e8940b3d3a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c3d4989e3e446978f6ea79e1353912e', 'request_id': 'req-8fee32be-9fc7-4465-8bc1-8e8940b3d3a6'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:56.926391 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-cb82b177-fdce-4e02-ad55-6f281753fd69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e9361251c17441890293a634dc93675', 'request_id': 'req-cb82b177-fdce-4e02-ad55-6f281753fd69'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:56.935047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-cb82b177-fdce-4e02-ad55-6f281753fd69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e9361251c17441890293a634dc93675', 'request_id': 'req-cb82b177-fdce-4e02-ad55-6f281753fd69'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:56.938220 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-8fee32be-9fc7-4465-8bc1-8e8940b3d3a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c3d4989e3e446978f6ea79e1353912e', 'request_id': 'req-8fee32be-9fc7-4465-8bc1-8e8940b3d3a6'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:56.955701 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-8fee32be-9fc7-4465-8bc1-8e8940b3d3a6 admin admin] The token cache is being invalidate because project 1c3d4989e3e446978f6ea79e1353912e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:32:56.955848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-cb82b177-fdce-4e02-ad55-6f281753fd69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e9361251c17441890293a634dc93675', 'request_id': 'req-cb82b177-fdce-4e02-ad55-6f281753fd69'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:56.956266 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-8fee32be-9fc7-4465-8bc1-8e8940b3d3a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:56.957072 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-8fee32be-9fc7-4465-8bc1-8e8940b3d3a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:56.958786 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 709/1407] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:32:56 2022] DELETE /identity/v3/projects/1c3d4989e3e446978f6ea79e1353912e => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:56.963488 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee32be-9fc7-4465-8bc1-8e8940b3d3a6 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:56.966291 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-8fee32be-9fc7-4465-8bc1-8e8940b3d3a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:57.092540 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-cb82b177-fdce-4e02-ad55-6f281753fd69 admin admin] The token cache is being invalidate because project 0e9361251c17441890293a634dc93675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:32:57.095705 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-cb82b177-fdce-4e02-ad55-6f281753fd69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:57.096050 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee32be-9fc7-4465-8bc1-8e8940b3d3a6 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:57.096154 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-cb82b177-fdce-4e02-ad55-6f281753fd69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:57.099165 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 699/1408] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:32:56 2022] DELETE /identity/v3/projects/0e9361251c17441890293a634dc93675 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:57.104482 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde57b84-dfd8-49aa-847f-328dc3305d4a None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:57.106795 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde57b84-dfd8-49aa-847f-328dc3305d4a None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:57.107277 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde57b84-dfd8-49aa-847f-328dc3305d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:57.153169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-cde57b84-dfd8-49aa-847f-328dc3305d4a None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:57.156066 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-cde57b84-dfd8-49aa-847f-328dc3305d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:57.184635 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:57.298575 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 700/1409] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:57.307046 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf038fc-776e-4172-bbae-a22d6f8bda1a None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:57.307529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf038fc-776e-4172-bbae-a22d6f8bda1a None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:57.307984 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf038fc-776e-4172-bbae-a22d6f8bda1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:57.360228 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-7bf038fc-776e-4172-bbae-a22d6f8bda1a None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:57.361935 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-7bf038fc-776e-4172-bbae-a22d6f8bda1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:57.390633 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 701/1410] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:32:57.392190 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf038fc-776e-4172-bbae-a22d6f8bda1a None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:57.397347 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62ee47-076b-422b-a488-fc9828982a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:57.397347 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62ee47-076b-422b-a488-fc9828982a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:57.404006 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf038fc-776e-4172-bbae-a22d6f8bda1a None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:57.406133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62ee47-076b-422b-a488-fc9828982a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:57.408700 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62ee47-076b-422b-a488-fc9828982a6b admin admin] PATH_INFO: `/v3/users/ae2af158779e4c9690dd1084fb4f836c` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:57.415207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bcb56-36d7-46de-a17f-a96dd41bdfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:57.417057 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bcb56-36d7-46de-a17f-a96dd41bdfa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:57.417454 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bcb56-36d7-46de-a17f-a96dd41bdfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:57.418312 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bcb56-36d7-46de-a17f-a96dd41bdfa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:57.418729 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62ee47-076b-422b-a488-fc9828982a6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae2af158779e4c9690dd1084fb4f836c)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:57.420114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3bcb56-36d7-46de-a17f-a96dd41bdfa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:32:57.426145 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3bcb56-36d7-46de-a17f-a96dd41bdfa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:57.426274 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62ee47-076b-422b-a488-fc9828982a6b admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:57.426361 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3bcb56-36d7-46de-a17f-a96dd41bdfa1 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:57.502470 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 702/1411] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:32:57.504087 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb3d40-8817-432c-a706-d66e490068c3 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:57.509464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb3d40-8817-432c-a706-d66e490068c3 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:57.510044 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb3d40-8817-432c-a706-d66e490068c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:57.591451 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-fdfb3d40-8817-432c-a706-d66e490068c3 None None] MFA Rules not processed for user `4e5c1ceb415a47fb81c7226508f011ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:57.597757 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-fdfb3d40-8817-432c-a706-d66e490068c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:57.723038 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 703/1412] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:57.723980 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb3d40-8817-432c-a706-d66e490068c3 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:57.745001 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb3d40-8817-432c-a706-d66e490068c3 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:57.752680 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2faf30b-9777-49c1-ad2c-8870e706d6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:57.753513 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faf30b-9777-49c1-ad2c-8870e706d6a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:57.754490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faf30b-9777-49c1-ad2c-8870e706d6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:57.754901 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faf30b-9777-49c1-ad2c-8870e706d6a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:57.756339 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2faf30b-9777-49c1-ad2c-8870e706d6a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:57.759459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2faf30b-9777-49c1-ad2c-8870e706d6a5 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:58.044650 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 704/1413] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:32:57 2022] POST /identity/v3/projects => generated 367 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:58.050082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf74027-3f07-4be2-be41-5d1b1c07a927 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:58.052499 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf74027-3f07-4be2-be41-5d1b1c07a927 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:58.053188 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf74027-3f07-4be2-be41-5d1b1c07a927 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:58.060333 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 705/1414] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 19 02:32:58 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:32:58.063748 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf74027-3f07-4be2-be41-5d1b1c07a927 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:58.069384 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-8b62ee47-076b-422b-a488-fc9828982a6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae2af158779e4c9690dd1084fb4f836c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:58.074405 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-8b62ee47-076b-422b-a488-fc9828982a6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae2af158779e4c9690dd1084fb4f836c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:58.188818 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf74027-3f07-4be2-be41-5d1b1c07a927 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:58.195744 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc0102-d2f2-4811-b6cf-f717391279a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:58.196908 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc0102-d2f2-4811-b6cf-f717391279a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:58.197415 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc0102-d2f2-4811-b6cf-f717391279a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:58.198090 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc0102-d2f2-4811-b6cf-f717391279a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:58.199255 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc0102-d2f2-4811-b6cf-f717391279a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:58.201965 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc0102-d2f2-4811-b6cf-f717391279a2 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:58.234128 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-8b62ee47-076b-422b-a488-fc9828982a6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae2af158779e4c9690dd1084fb4f836c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:58.255823 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-8b62ee47-076b-422b-a488-fc9828982a6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae2af158779e4c9690dd1084fb4f836c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:58.256933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-8b62ee47-076b-422b-a488-fc9828982a6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae2af158779e4c9690dd1084fb4f836c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:58.277783 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 710/1415] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:32:56 2022] DELETE /identity/v3/users/ae2af158779e4c9690dd1084fb4f836c => generated 0 bytes in 1315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:32:58.281253 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dff47-6c1d-4432-afc8-4e35e96fa477 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:58.281771 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dff47-6c1d-4432-afc8-4e35e96fa477 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:58.282070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dff47-6c1d-4432-afc8-4e35e96fa477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:58.347039 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-245dff47-6c1d-4432-afc8-4e35e96fa477 None None] MFA Rules not processed for user `a66b9bc695b44877a06f17ea6bbeb27a`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:58.348543 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-245dff47-6c1d-4432-afc8-4e35e96fa477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:58.375397 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 706/1416] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:32:58 2022] POST /identity/v3/users => generated 284 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:32:58.375397 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b0e72-d111-4333-9e0e-cac78f25e434 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:58.375397 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b0e72-d111-4333-9e0e-cac78f25e434 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:58.375397 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b0e72-d111-4333-9e0e-cac78f25e434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:58.563195 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-724b0e72-d111-4333-9e0e-cac78f25e434 None None] MFA Rules not processed for user `e58cdf090af44b508767e821be2f379f`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:58.567362 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-724b0e72-d111-4333-9e0e-cac78f25e434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:58.596240 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 711/1417] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 19 02:32:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:58.597791 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dff47-6c1d-4432-afc8-4e35e96fa477 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:58.603998 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-245dff47-6c1d-4432-afc8-4e35e96fa477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:58.608809 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:32:58.764939 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 707/1418] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 02:32:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:58.766605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b0e72-d111-4333-9e0e-cac78f25e434 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:58.783041 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-724b0e72-d111-4333-9e0e-cac78f25e434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:58.806556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b0e72-d111-4333-9e0e-cac78f25e434 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:58.815913 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2e1c7-af9d-4b35-a537-08be43e4677c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66b9bc695b44877a06f17ea6bbeb27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:58.819098 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dff47-6c1d-4432-afc8-4e35e96fa477 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:58.819639 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2e1c7-af9d-4b35-a537-08be43e4677c service placement] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:58.819970 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2e1c7-af9d-4b35-a537-08be43e4677c service placement] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:58.820902 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2e1c7-af9d-4b35-a537-08be43e4677c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:58.826668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cec241-7475-4bb2-bb7c-37f174cdb6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:58.827515 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cec241-7475-4bb2-bb7c-37f174cdb6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:58.828039 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cec241-7475-4bb2-bb7c-37f174cdb6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:58.828486 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cec241-7475-4bb2-bb7c-37f174cdb6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:58.829315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cec241-7475-4bb2-bb7c-37f174cdb6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:58.831344 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cec241-7475-4bb2-bb7c-37f174cdb6f9 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:58.840644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2e1c7-af9d-4b35-a537-08be43e4677c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:58.843514 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2e1c7-af9d-4b35-a537-08be43e4677c service placement] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:58.844677 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 712/1419] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:58.848633 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cec241-7475-4bb2-bb7c-37f174cdb6f9 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:58.861211 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cec241-7475-4bb2-bb7c-37f174cdb6f9 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:58.866651 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fe3e3-1470-44cd-8d5d-69c74489717e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:58.867665 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fe3e3-1470-44cd-8d5d-69c74489717e admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:58.868117 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fe3e3-1470-44cd-8d5d-69c74489717e admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:58.870945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fe3e3-1470-44cd-8d5d-69c74489717e admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:58.870945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045fe3e3-1470-44cd-8d5d-69c74489717e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:58.871749 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045fe3e3-1470-44cd-8d5d-69c74489717e admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:58.879431 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 708/1420] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:32:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:32:58.897044 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 713/1421] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:32:58.898183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2e1c7-af9d-4b35-a537-08be43e4677c service placement] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:58.929196 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2e1c7-af9d-4b35-a537-08be43e4677c service placement] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:58.936619 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bf315-b1ce-41ff-90bf-3ef55c3ca20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:58.937476 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bf315-b1ce-41ff-90bf-3ef55c3ca20c admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:58.937854 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bf315-b1ce-41ff-90bf-3ef55c3ca20c admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:58.938499 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bf315-b1ce-41ff-90bf-3ef55c3ca20c admin admin] PATH_INFO: `/v3/projects/0d43518b5cb04cf5a2965168c8ffb358/users/3c0076ffa06b4ee58380a83389f48d1b/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:58.957577 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137bf315-b1ce-41ff-90bf-3ef55c3ca20c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d43518b5cb04cf5a2965168c8ffb358, user_id=3c0076ffa06b4ee58380a83389f48d1b, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:58.961254 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137bf315-b1ce-41ff-90bf-3ef55c3ca20c admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:59.087182 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 709/1422] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:32:58 2022] PUT /identity/v3/projects/0d43518b5cb04cf5a2965168c8ffb358/users/3c0076ffa06b4ee58380a83389f48d1b/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:32:59.092906 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0ce7f-0804-4ae1-b753-3811beec969c None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:59.093242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0ce7f-0804-4ae1-b753-3811beec969c None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:59.093532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0ce7f-0804-4ae1-b753-3811beec969c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:59.130922 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-33f0ce7f-0804-4ae1-b753-3811beec969c None None] MFA Rules not processed for user `3c0076ffa06b4ee58380a83389f48d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:32:59.133396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-33f0ce7f-0804-4ae1-b753-3811beec969c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:59.208621 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bf315-b1ce-41ff-90bf-3ef55c3ca20c admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:59.211506 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-137bf315-b1ce-41ff-90bf-3ef55c3ca20c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:59.372094 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 714/1423] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:32:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:32:59.373106 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0ce7f-0804-4ae1-b753-3811beec969c None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:59.377438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-33f0ce7f-0804-4ae1-b753-3811beec969c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:32:59.402230 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bf315-b1ce-41ff-90bf-3ef55c3ca20c admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:59.411582 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0049caf-522a-4fa4-bbd7-4f705b569028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:59.412330 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0049caf-522a-4fa4-bbd7-4f705b569028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:59.412610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0049caf-522a-4fa4-bbd7-4f705b569028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:59.412878 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0049caf-522a-4fa4-bbd7-4f705b569028 admin admin] PATH_INFO: `/v3/users/c3710c28c15344ecb07d14a507d46dbb` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:59.414679 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0049caf-522a-4fa4-bbd7-4f705b569028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3710c28c15344ecb07d14a507d46dbb)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:59.419892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0049caf-522a-4fa4-bbd7-4f705b569028 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:59.581997 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0ce7f-0804-4ae1-b753-3811beec969c None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:59.588708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4897e5-c0ba-449b-918f-ac68a9ca5c7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906e9835f5c4e709915c6553b41aeff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:59.589413 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4897e5-c0ba-449b-918f-ac68a9ca5c7d service swift] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:59.589697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4897e5-c0ba-449b-918f-ac68a9ca5c7d service swift] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:59.589989 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4897e5-c0ba-449b-918f-ac68a9ca5c7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:59.657815 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-f0049caf-522a-4fa4-bbd7-4f705b569028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3710c28c15344ecb07d14a507d46dbb'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:59.657815 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-f0049caf-522a-4fa4-bbd7-4f705b569028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3710c28c15344ecb07d14a507d46dbb'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:59.767585 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4897e5-c0ba-449b-918f-ac68a9ca5c7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:59.771541 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4897e5-c0ba-449b-918f-ac68a9ca5c7d service swift] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:59.813953 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 715/1424] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 02:32:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:32:59.815218 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4897e5-c0ba-449b-918f-ac68a9ca5c7d service swift] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:32:59.843679 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4897e5-c0ba-449b-918f-ac68a9ca5c7d service swift] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:32:59.852418 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-f0049caf-522a-4fa4-bbd7-4f705b569028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3710c28c15344ecb07d14a507d46dbb'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:59.861630 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873e159-69e7-45d6-b3ef-c617e41fa2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:32:59.876936 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873e159-69e7-45d6-b3ef-c617e41fa2eb admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:59.877256 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873e159-69e7-45d6-b3ef-c617e41fa2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:59.877479 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873e159-69e7-45d6-b3ef-c617e41fa2eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:32:59.878183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873e159-69e7-45d6-b3ef-c617e41fa2eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:32:59.880009 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-f0049caf-522a-4fa4-bbd7-4f705b569028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3710c28c15344ecb07d14a507d46dbb'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:59.886288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-f0049caf-522a-4fa4-bbd7-4f705b569028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3710c28c15344ecb07d14a507d46dbb'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:32:59.889698 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873e159-69e7-45d6-b3ef-c617e41fa2eb admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:32:59.963490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 710/1425] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:32:59 2022] DELETE /identity/v3/users/c3710c28c15344ecb07d14a507d46dbb => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:32:59.965543 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc34f0d-6b73-4697-b71b-b4dc212a7e2d None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:32:59.966018 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc34f0d-6b73-4697-b71b-b4dc212a7e2d None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:32:59.969681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc34f0d-6b73-4697-b71b-b4dc212a7e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:00.058139 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:00.067063 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-1dc34f0d-6b73-4697-b71b-b4dc212a7e2d None None] MFA Rules not processed for user `e7e4640bd879468d81ec0281827687ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:00.069325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-1dc34f0d-6b73-4697-b71b-b4dc212a7e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:00.099868 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 716/1426] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:32:59 2022] POST /identity/v3/projects => generated 369 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:00.104516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873e159-69e7-45d6-b3ef-c617e41fa2eb admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:00.109168 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-3873e159-69e7-45d6-b3ef-c617e41fa2eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:00.392737 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 711/1427] 10.222.0.39 () {58 vars in 1015 bytes} [Wed Oct 19 02:32:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:00.425079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873e159-69e7-45d6-b3ef-c617e41fa2eb admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:00.433247 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba96592-21b0-4ae0-88a7-67ff9bf4c896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:00.436488 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba96592-21b0-4ae0-88a7-67ff9bf4c896 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:00.436963 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba96592-21b0-4ae0-88a7-67ff9bf4c896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:00.437386 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba96592-21b0-4ae0-88a7-67ff9bf4c896 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:00.442794 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba96592-21b0-4ae0-88a7-67ff9bf4c896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:00.446166 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba96592-21b0-4ae0-88a7-67ff9bf4c896 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:00.594644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 717/1428] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:33:00 2022] POST /identity/v3/users => generated 291 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:00.599472 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc34f0d-6b73-4697-b71b-b4dc212a7e2d None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:00.689471 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba96592-21b0-4ae0-88a7-67ff9bf4c896 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:00.692395 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-0ba96592-21b0-4ae0-88a7-67ff9bf4c896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:00.749323 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba96592-21b0-4ae0-88a7-67ff9bf4c896 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:00.765613 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e9faf-f887-4c61-b361-a893ddb0283b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:00.767072 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e9faf-f887-4c61-b361-a893ddb0283b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:00.767380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e9faf-f887-4c61-b361-a893ddb0283b admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:00.767661 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e9faf-f887-4c61-b361-a893ddb0283b admin admin] PATH_INFO: `/v3/projects/cf5d8fb6f1d948859a5bd1779823c939` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:00.775886 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e9faf-f887-4c61-b361-a893ddb0283b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf5d8fb6f1d948859a5bd1779823c939)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:00.781473 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e9faf-f887-4c61-b361-a893ddb0283b admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:00.847746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc34f0d-6b73-4697-b71b-b4dc212a7e2d None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:00.862592 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8db958-bf3b-4d3e-9d6b-df952f0a0352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:00.863308 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8db958-bf3b-4d3e-9d6b-df952f0a0352 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:00.863858 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8db958-bf3b-4d3e-9d6b-df952f0a0352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:00.864365 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8db958-bf3b-4d3e-9d6b-df952f0a0352 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:00.865241 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8db958-bf3b-4d3e-9d6b-df952f0a0352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:00.880302 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8db958-bf3b-4d3e-9d6b-df952f0a0352 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:00.948408 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 712/1429] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:00.956033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8db958-bf3b-4d3e-9d6b-df952f0a0352 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:00.972568 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-5d8db958-bf3b-4d3e-9d6b-df952f0a0352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:01.156950 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c46e9faf-f887-4c61-b361-a893ddb0283b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf5d8fb6f1d948859a5bd1779823c939', 'request_id': 'req-c46e9faf-f887-4c61-b361-a893ddb0283b'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:01.177133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c46e9faf-f887-4c61-b361-a893ddb0283b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf5d8fb6f1d948859a5bd1779823c939', 'request_id': 'req-c46e9faf-f887-4c61-b361-a893ddb0283b'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:01.263698 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c46e9faf-f887-4c61-b361-a893ddb0283b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf5d8fb6f1d948859a5bd1779823c939', 'request_id': 'req-c46e9faf-f887-4c61-b361-a893ddb0283b'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:01.267444 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:01.286595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8db958-bf3b-4d3e-9d6b-df952f0a0352 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:01.309214 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c46e9faf-f887-4c61-b361-a893ddb0283b admin admin] The token cache is being invalidate because project cf5d8fb6f1d948859a5bd1779823c939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:33:01.309602 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c46e9faf-f887-4c61-b361-a893ddb0283b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:01.312824 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c46e9faf-f887-4c61-b361-a893ddb0283b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:01.315124 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 718/1430] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:33:00 2022] DELETE /identity/v3/projects/cf5d8fb6f1d948859a5bd1779823c939 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:01.317929 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e9faf-f887-4c61-b361-a893ddb0283b admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:01.324811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-c46e9faf-f887-4c61-b361-a893ddb0283b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:01.479161 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd623b0-80ab-42e7-b187-abee7993fdff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:01.485088 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd623b0-80ab-42e7-b187-abee7993fdff service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:01.488165 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd623b0-80ab-42e7-b187-abee7993fdff service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:01.488837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd623b0-80ab-42e7-b187-abee7993fdff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:01.495086 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-3bd623b0-80ab-42e7-b187-abee7993fdff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:01.567615 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd623b0-80ab-42e7-b187-abee7993fdff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:01.569501 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd623b0-80ab-42e7-b187-abee7993fdff service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:01.599741 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e9faf-f887-4c61-b361-a893ddb0283b admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:01.604654 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 713/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:33:01.611757 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd623b0-80ab-42e7-b187-abee7993fdff service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:01.618319 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1b06a-f923-497e-8f5c-3ef01b024dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:01.619401 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-3bd623b0-80ab-42e7-b187-abee7993fdff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:01.621315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1b06a-f923-497e-8f5c-3ef01b024dda admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:01.622569 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1b06a-f923-497e-8f5c-3ef01b024dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:01.624681 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1b06a-f923-497e-8f5c-3ef01b024dda admin admin] PATH_INFO: `/v3/projects/de629d634ed44d629e6f32c06487f74a/users/13c4a1a270b945c68d855204234d0ef5/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:01.661566 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd623b0-80ab-42e7-b187-abee7993fdff service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:01.680769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b1b06a-f923-497e-8f5c-3ef01b024dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=de629d634ed44d629e6f32c06487f74a, user_id=13c4a1a270b945c68d855204234d0ef5, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:01.688055 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b1b06a-f923-497e-8f5c-3ef01b024dda admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:01.693395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85434b3a-a0da-47bf-9a3a-15da9bc1f6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:01.694553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85434b3a-a0da-47bf-9a3a-15da9bc1f6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:01.694553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85434b3a-a0da-47bf-9a3a-15da9bc1f6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:01.694780 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85434b3a-a0da-47bf-9a3a-15da9bc1f6ac admin admin] PATH_INFO: `/v3/projects/76bff797b00647f8a9cb724fa73b61a7` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:01.697673 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85434b3a-a0da-47bf-9a3a-15da9bc1f6ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=76bff797b00647f8a9cb724fa73b61a7)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:01.700184 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85434b3a-a0da-47bf-9a3a-15da9bc1f6ac admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:02.217382 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 719/1432] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:01 2022] PUT /identity/v3/projects/de629d634ed44d629e6f32c06487f74a/users/13c4a1a270b945c68d855204234d0ef5/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 899 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:02.219376 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee3f38-6fa1-49b5-9630-5d652ce6fb63 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:02.219707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee3f38-6fa1-49b5-9630-5d652ce6fb63 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:02.220003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee3f38-6fa1-49b5-9630-5d652ce6fb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:02.264205 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-85434b3a-a0da-47bf-9a3a-15da9bc1f6ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76bff797b00647f8a9cb724fa73b61a7', 'request_id': 'req-85434b3a-a0da-47bf-9a3a-15da9bc1f6ac'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:02.280295 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-85434b3a-a0da-47bf-9a3a-15da9bc1f6ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76bff797b00647f8a9cb724fa73b61a7', 'request_id': 'req-85434b3a-a0da-47bf-9a3a-15da9bc1f6ac'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:02.300015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-6fee3f38-6fa1-49b5-9630-5d652ce6fb63 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:02.301310 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-6fee3f38-6fa1-49b5-9630-5d652ce6fb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:02.303617 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-85434b3a-a0da-47bf-9a3a-15da9bc1f6ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76bff797b00647f8a9cb724fa73b61a7', 'request_id': 'req-85434b3a-a0da-47bf-9a3a-15da9bc1f6ac'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:02.446236 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-85434b3a-a0da-47bf-9a3a-15da9bc1f6ac admin admin] The token cache is being invalidate because project 76bff797b00647f8a9cb724fa73b61a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:33:02.449947 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-85434b3a-a0da-47bf-9a3a-15da9bc1f6ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:02.450187 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-85434b3a-a0da-47bf-9a3a-15da9bc1f6ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:02.452191 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 714/1433] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:33:01 2022] DELETE /identity/v3/projects/76bff797b00647f8a9cb724fa73b61a7 => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:02.453117 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85434b3a-a0da-47bf-9a3a-15da9bc1f6ac admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:02.465233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-85434b3a-a0da-47bf-9a3a-15da9bc1f6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:02.554195 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 720/1434] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:02.564722 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee3f38-6fa1-49b5-9630-5d652ce6fb63 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:02.564722 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-6fee3f38-6fa1-49b5-9630-5d652ce6fb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:02.615063 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee3f38-6fa1-49b5-9630-5d652ce6fb63 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:02.638788 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a7a0d-96cf-47c7-9048-0d15b323c0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:02.639590 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a7a0d-96cf-47c7-9048-0d15b323c0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:02.639785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a7a0d-96cf-47c7-9048-0d15b323c0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:02.640104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a7a0d-96cf-47c7-9048-0d15b323c0a2 admin admin] PATH_INFO: `/v3/users/6a1377a115b940b4bb496c339b70cd20` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:02.642061 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a7a0d-96cf-47c7-9048-0d15b323c0a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a1377a115b940b4bb496c339b70cd20)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:02.644337 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a7a0d-96cf-47c7-9048-0d15b323c0a2 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:02.675194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85434b3a-a0da-47bf-9a3a-15da9bc1f6ac admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:02.686052 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0daf0-7a89-4acc-8cbb-77447acaa29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:02.688757 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0daf0-7a89-4acc-8cbb-77447acaa29e admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:02.689141 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0daf0-7a89-4acc-8cbb-77447acaa29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:02.701579 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0daf0-7a89-4acc-8cbb-77447acaa29e admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:02.701579 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0daf0-7a89-4acc-8cbb-77447acaa29e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:02.701579 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0daf0-7a89-4acc-8cbb-77447acaa29e admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:02.723285 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 715/1435] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:02.725028 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5b1c9-6352-4d1a-bbe2-b04bdb43eca6 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:02.725594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5b1c9-6352-4d1a-bbe2-b04bdb43eca6 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:02.726076 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5b1c9-6352-4d1a-bbe2-b04bdb43eca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:02.753431 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-12b5b1c9-6352-4d1a-bbe2-b04bdb43eca6 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:02.755453 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-12b5b1c9-6352-4d1a-bbe2-b04bdb43eca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:02.776053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 716/1436] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:02.777641 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5b1c9-6352-4d1a-bbe2-b04bdb43eca6 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:02.793910 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5b1c9-6352-4d1a-bbe2-b04bdb43eca6 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:02.805243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ed7d0-068c-4ebb-b3f3-859754a8c338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:02.805243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ed7d0-068c-4ebb-b3f3-859754a8c338 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:02.805243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ed7d0-068c-4ebb-b3f3-859754a8c338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:02.805243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ed7d0-068c-4ebb-b3f3-859754a8c338 admin admin] PATH_INFO: `/v3/projects/de629d634ed44d629e6f32c06487f74a/users/13c4a1a270b945c68d855204234d0ef5/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:02.806350 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ed7d0-068c-4ebb-b3f3-859754a8c338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de629d634ed44d629e6f32c06487f74a, user_id=13c4a1a270b945c68d855204234d0ef5, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:02.810047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ed7d0-068c-4ebb-b3f3-859754a8c338 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:02.852565 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 717/1437] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:02 2022] PUT /identity/v3/projects/de629d634ed44d629e6f32c06487f74a/users/13c4a1a270b945c68d855204234d0ef5/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:02.853877 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ed7d0-068c-4ebb-b3f3-859754a8c338 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:02.998987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ed7d0-068c-4ebb-b3f3-859754a8c338 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:03.009105 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07de802-d6b7-4f9c-8b10-fedd06dd8ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:03.011787 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07de802-d6b7-4f9c-8b10-fedd06dd8ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:03.012410 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07de802-d6b7-4f9c-8b10-fedd06dd8ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:03.013059 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07de802-d6b7-4f9c-8b10-fedd06dd8ea6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:03.015159 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07de802-d6b7-4f9c-8b10-fedd06dd8ea6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:33:03.015669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07de802-d6b7-4f9c-8b10-fedd06dd8ea6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:03.019427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07de802-d6b7-4f9c-8b10-fedd06dd8ea6 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:03.043235 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 718/1438] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:33:03.043235 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe726e2-819f-4ff3-9319-8455565e189f None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:03.043235 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe726e2-819f-4ff3-9319-8455565e189f None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:03.043235 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe726e2-819f-4ff3-9319-8455565e189f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:03.092765 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-4e3a7a0d-96cf-47c7-9048-0d15b323c0a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a1377a115b940b4bb496c339b70cd20'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:03.093513 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-4e3a7a0d-96cf-47c7-9048-0d15b323c0a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a1377a115b940b4bb496c339b70cd20'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:03.128695 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-abe726e2-819f-4ff3-9319-8455565e189f None None] MFA Rules not processed for user `13c4a1a270b945c68d855204234d0ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:03.130981 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-abe726e2-819f-4ff3-9319-8455565e189f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:03.189908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-4e3a7a0d-96cf-47c7-9048-0d15b323c0a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a1377a115b940b4bb496c339b70cd20'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:03.224370 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-4e3a7a0d-96cf-47c7-9048-0d15b323c0a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a1377a115b940b4bb496c339b70cd20'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:03.227081 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-4e3a7a0d-96cf-47c7-9048-0d15b323c0a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a1377a115b940b4bb496c339b70cd20'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:03.257989 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 721/1439] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:33:02 2022] DELETE /identity/v3/users/6a1377a115b940b4bb496c339b70cd20 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:03.257989 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a7a0d-96cf-47c7-9048-0d15b323c0a2 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:03.273669 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-4e3a7a0d-96cf-47c7-9048-0d15b323c0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:03.457607 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 719/1440] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:03.470656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a7a0d-96cf-47c7-9048-0d15b323c0a2 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:03.471907 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe726e2-819f-4ff3-9319-8455565e189f None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:03.474223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-abe726e2-819f-4ff3-9319-8455565e189f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:03.503612 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d99f6-9a74-45b4-a50f-5d20be22eb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:03.505130 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d99f6-9a74-45b4-a50f-5d20be22eb5c admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:03.505658 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d99f6-9a74-45b4-a50f-5d20be22eb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:03.506090 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d99f6-9a74-45b4-a50f-5d20be22eb5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:03.519225 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d99f6-9a74-45b4-a50f-5d20be22eb5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:03.531150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d99f6-9a74-45b4-a50f-5d20be22eb5c admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:03.607840 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe726e2-819f-4ff3-9319-8455565e189f None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:03.750953 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 722/1441] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:33:03 2022] POST /identity/v3/projects => generated 381 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:03.752670 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe8a58-d5db-4b4a-a907-00bb642dfeef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:03.753352 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe8a58-d5db-4b4a-a907-00bb642dfeef service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:03.753770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe8a58-d5db-4b4a-a907-00bb642dfeef service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:03.754057 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe8a58-d5db-4b4a-a907-00bb642dfeef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:03.756371 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d99f6-9a74-45b4-a50f-5d20be22eb5c admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:03.899089 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe8a58-d5db-4b4a-a907-00bb642dfeef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:03.901735 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe8a58-d5db-4b4a-a907-00bb642dfeef service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:03.936343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 720/1442] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:33:03.955211 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d99f6-9a74-45b4-a50f-5d20be22eb5c admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:03.966627 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6edb93-b966-4a32-bb42-d25f834a0e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:03.967432 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6edb93-b966-4a32-bb42-d25f834a0e9d admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:03.968062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6edb93-b966-4a32-bb42-d25f834a0e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:03.968454 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6edb93-b966-4a32-bb42-d25f834a0e9d admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:03.969272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6edb93-b966-4a32-bb42-d25f834a0e9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:03.971703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6edb93-b966-4a32-bb42-d25f834a0e9d admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:04.143062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 723/1443] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:33:03 2022] POST /identity/v3/users => generated 291 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:04.151617 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe8a58-d5db-4b4a-a907-00bb642dfeef service cinder] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:04.186597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe8a58-d5db-4b4a-a907-00bb642dfeef service cinder] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:04.199709 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872d72d-b111-4074-9b37-64624f30061f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:04.200397 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872d72d-b111-4074-9b37-64624f30061f admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:04.200736 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872d72d-b111-4074-9b37-64624f30061f admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:04.201066 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872d72d-b111-4074-9b37-64624f30061f admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:04.201840 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872d72d-b111-4074-9b37-64624f30061f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:04.204797 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872d72d-b111-4074-9b37-64624f30061f admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:04.224411 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 721/1444] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:04.228847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6edb93-b966-4a32-bb42-d25f834a0e9d admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:04.244243 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6edb93-b966-4a32-bb42-d25f834a0e9d admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:04.250156 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ebb0d-2139-4578-a3ec-85a8bb729138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:04.250156 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ebb0d-2139-4578-a3ec-85a8bb729138 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:04.255073 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ebb0d-2139-4578-a3ec-85a8bb729138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:04.255389 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ebb0d-2139-4578-a3ec-85a8bb729138 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:04.275564 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ebb0d-2139-4578-a3ec-85a8bb729138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:04.278971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ebb0d-2139-4578-a3ec-85a8bb729138 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:04.296746 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 724/1445] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:04.300854 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872d72d-b111-4074-9b37-64624f30061f admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:04.321610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872d72d-b111-4074-9b37-64624f30061f admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:04.340345 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f5aa2-634c-4862-b9f7-1381aaf2429f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:04.341467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f5aa2-634c-4862-b9f7-1381aaf2429f admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:04.341905 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f5aa2-634c-4862-b9f7-1381aaf2429f admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:04.342339 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f5aa2-634c-4862-b9f7-1381aaf2429f admin admin] PATH_INFO: `/v3/projects/cbc31b5a323b4161b942cc5ca4e5e82e/users/2411959619644c68a5133eb442125ee2/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:04.378645 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f5aa2-634c-4862-b9f7-1381aaf2429f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc31b5a323b4161b942cc5ca4e5e82e, user_id=2411959619644c68a5133eb442125ee2, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:04.381830 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f5aa2-634c-4862-b9f7-1381aaf2429f admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:04.536654 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 722/1446] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:04 2022] PUT /identity/v3/projects/cbc31b5a323b4161b942cc5ca4e5e82e/users/2411959619644c68a5133eb442125ee2/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:04.539045 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4bf45-f04c-4914-bd86-6d7a96c02c71 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:04.539530 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4bf45-f04c-4914-bd86-6d7a96c02c71 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:04.540009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4bf45-f04c-4914-bd86-6d7a96c02c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:04.655922 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-2de4bf45-f04c-4914-bd86-6d7a96c02c71 None None] MFA Rules not processed for user `2411959619644c68a5133eb442125ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:04.657530 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-2de4bf45-f04c-4914-bd86-6d7a96c02c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:04.688096 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:04.705592 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f5aa2-634c-4862-b9f7-1381aaf2429f admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:04.709826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-152f5aa2-634c-4862-b9f7-1381aaf2429f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:04.801059 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:04.934458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 725/1447] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:04.940971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4bf45-f04c-4914-bd86-6d7a96c02c71 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:05.160444 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f5aa2-634c-4862-b9f7-1381aaf2429f admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:05.176017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3ed36-9502-4746-8088-341f3db16a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:05.188107 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3ed36-9502-4746-8088-341f3db16a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:05.188107 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3ed36-9502-4746-8088-341f3db16a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:05.188107 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3ed36-9502-4746-8088-341f3db16a11 admin admin] PATH_INFO: `/v3/projects/7634597b211d49d190902114061215c1` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:05.188107 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3ed36-9502-4746-8088-341f3db16a11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7634597b211d49d190902114061215c1)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:05.192426 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3ed36-9502-4746-8088-341f3db16a11 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:05.206219 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4bf45-f04c-4914-bd86-6d7a96c02c71 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:05.228484 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21893193-accb-4165-b13f-f751649a6e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:05.228484 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21893193-accb-4165-b13f-f751649a6e34 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:05.229170 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21893193-accb-4165-b13f-f751649a6e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:05.229786 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21893193-accb-4165-b13f-f751649a6e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:05.232773 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21893193-accb-4165-b13f-f751649a6e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:05.255268 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21893193-accb-4165-b13f-f751649a6e34 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:05.491577 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 726/1448] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:33:04 2022] POST /identity/v3/projects => generated 379 bytes in 553 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:05.496396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e85dc2-3de1-4d8f-afe3-2f22f290c660 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:05.496681 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e85dc2-3de1-4d8f-afe3-2f22f290c660 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:05.496958 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e85dc2-3de1-4d8f-afe3-2f22f290c660 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:05.501463 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 727/1449] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 19 02:33:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:33:05.502344 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e85dc2-3de1-4d8f-afe3-2f22f290c660 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:05.509226 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-3ed3ed36-9502-4746-8088-341f3db16a11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7634597b211d49d190902114061215c1', 'request_id': 'req-3ed3ed36-9502-4746-8088-341f3db16a11'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:05.525869 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-3ed3ed36-9502-4746-8088-341f3db16a11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7634597b211d49d190902114061215c1', 'request_id': 'req-3ed3ed36-9502-4746-8088-341f3db16a11'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:05.550500 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-3ed3ed36-9502-4746-8088-341f3db16a11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7634597b211d49d190902114061215c1', 'request_id': 'req-3ed3ed36-9502-4746-8088-341f3db16a11'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:05.663239 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-3ed3ed36-9502-4746-8088-341f3db16a11 admin admin] The token cache is being invalidate because project 7634597b211d49d190902114061215c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:33:05.664139 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-3ed3ed36-9502-4746-8088-341f3db16a11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:05.665459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-3ed3ed36-9502-4746-8088-341f3db16a11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:05.668747 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 723/1450] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:33:04 2022] DELETE /identity/v3/projects/7634597b211d49d190902114061215c1 => generated 0 bytes in 964 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:05.674059 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac178439-7fb1-4f77-b99d-18b8013d75e9 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:05.674264 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac178439-7fb1-4f77-b99d-18b8013d75e9 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:05.680798 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac178439-7fb1-4f77-b99d-18b8013d75e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:05.722966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e85dc2-3de1-4d8f-afe3-2f22f290c660 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:05.727883 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-ac178439-7fb1-4f77-b99d-18b8013d75e9 None None] MFA Rules not processed for user `58a78f75a63e4d258a4afbeb748e59f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:05.729623 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ac178439-7fb1-4f77-b99d-18b8013d75e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:05.730761 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cd30c-a6be-44e1-b733-e6c7a41c18ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:05.731511 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cd30c-a6be-44e1-b733-e6c7a41c18ad admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:05.731883 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cd30c-a6be-44e1-b733-e6c7a41c18ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:05.732251 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cd30c-a6be-44e1-b733-e6c7a41c18ad admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:05.733131 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cd30c-a6be-44e1-b733-e6c7a41c18ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:05.735649 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cd30c-a6be-44e1-b733-e6c7a41c18ad admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:05.877323 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 724/1451] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 19 02:33:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:05.883668 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7d54c-5a50-466f-89ba-8bda296a0659 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:05.883668 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7d54c-5a50-466f-89ba-8bda296a0659 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:05.883668 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7d54c-5a50-466f-89ba-8bda296a0659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:05.888232 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 728/1452] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:33:05 2022] POST /identity/v3/users => generated 296 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:05.892261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cd30c-a6be-44e1-b733-e6c7a41c18ad admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:05.907936 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-978cd30c-a6be-44e1-b733-e6c7a41c18ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:05.925529 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cd30c-a6be-44e1-b733-e6c7a41c18ad admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:05.948404 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb3c0e-30a0-47cb-b6fc-913d001e3047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:05.949129 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb3c0e-30a0-47cb-b6fc-913d001e3047 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:05.949503 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb3c0e-30a0-47cb-b6fc-913d001e3047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:05.950411 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb3c0e-30a0-47cb-b6fc-913d001e3047 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:05.950918 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-f1b7d54c-5a50-466f-89ba-8bda296a0659 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:05.951312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb3c0e-30a0-47cb-b6fc-913d001e3047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:05.952375 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-f1b7d54c-5a50-466f-89ba-8bda296a0659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:05.953228 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb3c0e-30a0-47cb-b6fc-913d001e3047 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:05.979312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 729/1453] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:05.982039 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb3c0e-30a0-47cb-b6fc-913d001e3047 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:05.996775 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 725/1454] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:06.007021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e8314-02e9-4596-bd64-7c2af137cf4d None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:06.008007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e8314-02e9-4596-bd64-7c2af137cf4d None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:06.008371 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e8314-02e9-4596-bd64-7c2af137cf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:06.016245 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb3c0e-30a0-47cb-b6fc-913d001e3047 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:06.041022 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236cb9e-04bf-4da4-9dc0-cec0f4a0ef91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:06.041022 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236cb9e-04bf-4da4-9dc0-cec0f4a0ef91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:06.041022 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236cb9e-04bf-4da4-9dc0-cec0f4a0ef91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:06.041022 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236cb9e-04bf-4da4-9dc0-cec0f4a0ef91 admin admin] PATH_INFO: `/v3/projects/69b75cd212164d468be27ff633d7a38a/users/15eebb6b11f042db977d71c9bdc70889/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:06.068849 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236cb9e-04bf-4da4-9dc0-cec0f4a0ef91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b75cd212164d468be27ff633d7a38a, user_id=15eebb6b11f042db977d71c9bdc70889, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:06.068849 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236cb9e-04bf-4da4-9dc0-cec0f4a0ef91 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:06.077216 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-ff8e8314-02e9-4596-bd64-7c2af137cf4d None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:06.079108 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ff8e8314-02e9-4596-bd64-7c2af137cf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:06.105392 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 726/1455] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:06.121465 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e8314-02e9-4596-bd64-7c2af137cf4d None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:06.154769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 730/1456] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:05 2022] PUT /identity/v3/projects/69b75cd212164d468be27ff633d7a38a/users/15eebb6b11f042db977d71c9bdc70889/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:06.161904 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236cb9e-04bf-4da4-9dc0-cec0f4a0ef91 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:06.199106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e8314-02e9-4596-bd64-7c2af137cf4d None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:06.345333 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236cb9e-04bf-4da4-9dc0-cec0f4a0ef91 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:06.368745 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1f697-4912-488d-90db-301830aa717d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:06.370736 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1f697-4912-488d-90db-301830aa717d admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:06.378086 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1f697-4912-488d-90db-301830aa717d admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:06.378086 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1f697-4912-488d-90db-301830aa717d admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:06.378086 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1f697-4912-488d-90db-301830aa717d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:06.378086 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1f697-4912-488d-90db-301830aa717d admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:06.403305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 731/1457] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:33:06.411772 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1f697-4912-488d-90db-301830aa717d admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:06.412624 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa90019-b72e-4b37-9856-49d83b3a6f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:06.414859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa90019-b72e-4b37-9856-49d83b3a6f61 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:06.415301 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa90019-b72e-4b37-9856-49d83b3a6f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:06.415729 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa90019-b72e-4b37-9856-49d83b3a6f61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:06.416706 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa90019-b72e-4b37-9856-49d83b3a6f61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:33:06.417165 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa90019-b72e-4b37-9856-49d83b3a6f61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:06.419570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa90019-b72e-4b37-9856-49d83b3a6f61 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:06.437961 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 727/1458] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:33:06.448247 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1f697-4912-488d-90db-301830aa717d admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:06.454444 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa90019-b72e-4b37-9856-49d83b3a6f61 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:06.466646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa90019-b72e-4b37-9856-49d83b3a6f61 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:06.472743 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f92e1c-63af-441c-8f90-37d41928e42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:06.473369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f92e1c-63af-441c-8f90-37d41928e42a admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:06.473739 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f92e1c-63af-441c-8f90-37d41928e42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:06.474002 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f92e1c-63af-441c-8f90-37d41928e42a admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:06.483281 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f92e1c-63af-441c-8f90-37d41928e42a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:06.488197 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00020def-34a1-418d-9435-83cb2e8289ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:06.489154 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00020def-34a1-418d-9435-83cb2e8289ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:06.489559 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00020def-34a1-418d-9435-83cb2e8289ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:06.489961 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00020def-34a1-418d-9435-83cb2e8289ae admin admin] PATH_INFO: `/v3/projects/69b75cd212164d468be27ff633d7a38a/users/15eebb6b11f042db977d71c9bdc70889/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:06.490362 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f92e1c-63af-441c-8f90-37d41928e42a admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:06.502016 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00020def-34a1-418d-9435-83cb2e8289ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b75cd212164d468be27ff633d7a38a, user_id=15eebb6b11f042db977d71c9bdc70889, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:06.507252 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00020def-34a1-418d-9435-83cb2e8289ae admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:06.541028 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 732/1459] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:06 2022] PUT /identity/v3/projects/69b75cd212164d468be27ff633d7a38a/users/15eebb6b11f042db977d71c9bdc70889/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:06.549404 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00020def-34a1-418d-9435-83cb2e8289ae admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:06.556702 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-00020def-34a1-418d-9435-83cb2e8289ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:06.683954 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00020def-34a1-418d-9435-83cb2e8289ae admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:06.690711 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0a3e8-93cc-4a40-8127-52099f725897 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:06.691738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0a3e8-93cc-4a40-8127-52099f725897 service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:06.692470 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0a3e8-93cc-4a40-8127-52099f725897 service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:06.694017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0a3e8-93cc-4a40-8127-52099f725897 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:06.707711 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0a3e8-93cc-4a40-8127-52099f725897 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:06.709768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0a3e8-93cc-4a40-8127-52099f725897 service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:06.727245 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 733/1460] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:33:06.729908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1f3f8-93e0-4278-95dd-79ca62a40650 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:06.730445 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1f3f8-93e0-4278-95dd-79ca62a40650 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:06.731114 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1f3f8-93e0-4278-95dd-79ca62a40650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:06.807015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-ead1f3f8-93e0-4278-95dd-79ca62a40650 None None] MFA Rules not processed for user `15eebb6b11f042db977d71c9bdc70889`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:06.809614 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-ead1f3f8-93e0-4278-95dd-79ca62a40650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:06.930433 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 728/1461] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:33:06 2022] POST /identity/v3/projects => generated 371 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:33:06.936411 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f92e1c-63af-441c-8f90-37d41928e42a admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:07.066931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 734/1462] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:07.068300 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdaa74-ca85-4b49-8566-d8e76c5ea06c None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:07.068588 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdaa74-ca85-4b49-8566-d8e76c5ea06c None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:07.068860 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdaa74-ca85-4b49-8566-d8e76c5ea06c None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:07.071203 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 735/1463] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 19 02:33:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:33:07.079897 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdaa74-ca85-4b49-8566-d8e76c5ea06c None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:07.081812 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-aecdaa74-ca85-4b49-8566-d8e76c5ea06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:07.137671 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f92e1c-63af-441c-8f90-37d41928e42a admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:07.153867 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d59cb-c43a-4c70-9bfd-df1fc7158e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:07.155122 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d59cb-c43a-4c70-9bfd-df1fc7158e07 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:07.155482 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d59cb-c43a-4c70-9bfd-df1fc7158e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:07.155824 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d59cb-c43a-4c70-9bfd-df1fc7158e07 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:07.156532 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d59cb-c43a-4c70-9bfd-df1fc7158e07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:07.162855 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d59cb-c43a-4c70-9bfd-df1fc7158e07 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:07.248470 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdaa74-ca85-4b49-8566-d8e76c5ea06c None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:07.263155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250c171-72d8-4d97-8ab2-2783102e62c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:07.263155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250c171-72d8-4d97-8ab2-2783102e62c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:07.263155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250c171-72d8-4d97-8ab2-2783102e62c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:07.263155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250c171-72d8-4d97-8ab2-2783102e62c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:07.294419 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 729/1464] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:33:06 2022] POST /identity/v3/users => generated 286 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:33:07.296279 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a9eb9-b082-4631-bd76-4c90c84bbf78 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:07.296595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a9eb9-b082-4631-bd76-4c90c84bbf78 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:07.296969 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a9eb9-b082-4631-bd76-4c90c84bbf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:07.355257 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-842a9eb9-b082-4631-bd76-4c90c84bbf78 None None] MFA Rules not processed for user `58a78f75a63e4d258a4afbeb748e59f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:07.358369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-842a9eb9-b082-4631-bd76-4c90c84bbf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:07.389473 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250c171-72d8-4d97-8ab2-2783102e62c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:07.396847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250c171-72d8-4d97-8ab2-2783102e62c1 service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:07.412364 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 736/1465] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:07 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:33:07.413252 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250c171-72d8-4d97-8ab2-2783102e62c1 service cinder] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:07.430432 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250c171-72d8-4d97-8ab2-2783102e62c1 service cinder] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:07.438083 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cbb94-4193-4b84-aad2-54b3d6d2b56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:07.438768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cbb94-4193-4b84-aad2-54b3d6d2b56a admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:07.439082 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cbb94-4193-4b84-aad2-54b3d6d2b56a admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:07.439362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cbb94-4193-4b84-aad2-54b3d6d2b56a admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:07.440660 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9cbb94-4193-4b84-aad2-54b3d6d2b56a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:07.442630 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9cbb94-4193-4b84-aad2-54b3d6d2b56a admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:07.462066 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 737/1466] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:07.467266 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cbb94-4193-4b84-aad2-54b3d6d2b56a admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:07.499414 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cbb94-4193-4b84-aad2-54b3d6d2b56a admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:07.506026 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efa13c-2ecf-4271-9cb8-f58ece0a5625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:07.507270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efa13c-2ecf-4271-9cb8-f58ece0a5625 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:07.508196 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efa13c-2ecf-4271-9cb8-f58ece0a5625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:07.508410 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efa13c-2ecf-4271-9cb8-f58ece0a5625 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:07.509300 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efa13c-2ecf-4271-9cb8-f58ece0a5625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:07.513076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efa13c-2ecf-4271-9cb8-f58ece0a5625 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:07.513613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 730/1467] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 19 02:33:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:07.538868 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 738/1468] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:07.548184 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a9eb9-b082-4631-bd76-4c90c84bbf78 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:07.561398 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a9eb9-b082-4631-bd76-4c90c84bbf78 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:07.571335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf623f2-4f66-49d2-840f-c083e9a3f455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:07.572806 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf623f2-4f66-49d2-840f-c083e9a3f455 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:07.572806 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf623f2-4f66-49d2-840f-c083e9a3f455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:07.572806 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf623f2-4f66-49d2-840f-c083e9a3f455 admin admin] PATH_INFO: `/v3/projects/31c7823acb3b4cc283fb7ddc9bf0e2a2/users/5b490147c7124412803a7155325b416c/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:07.626130 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf623f2-4f66-49d2-840f-c083e9a3f455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c7823acb3b4cc283fb7ddc9bf0e2a2, user_id=5b490147c7124412803a7155325b416c, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:07.629346 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf623f2-4f66-49d2-840f-c083e9a3f455 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:07.799024 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efa13c-2ecf-4271-9cb8-f58ece0a5625 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:07.822099 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efa13c-2ecf-4271-9cb8-f58ece0a5625 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:07.832857 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 731/1469] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:07 2022] PUT /identity/v3/projects/31c7823acb3b4cc283fb7ddc9bf0e2a2/users/5b490147c7124412803a7155325b416c/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:07.833801 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf623f2-4f66-49d2-840f-c083e9a3f455 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:07.916714 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39c935-c513-452b-ba83-b9736a72fc7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:07.917259 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39c935-c513-452b-ba83-b9736a72fc7c service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:07.917592 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39c935-c513-452b-ba83-b9736a72fc7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:07.917864 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39c935-c513-452b-ba83-b9736a72fc7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:07.920161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-ff39c935-c513-452b-ba83-b9736a72fc7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:07.976552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf623f2-4f66-49d2-840f-c083e9a3f455 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:07.984006 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91706523-c9e3-40e7-b950-cc2d0e222122 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:07.984930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91706523-c9e3-40e7-b950-cc2d0e222122 service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:07.985441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91706523-c9e3-40e7-b950-cc2d0e222122 service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:07.985990 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91706523-c9e3-40e7-b950-cc2d0e222122 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:07.998011 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91706523-c9e3-40e7-b950-cc2d0e222122 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:08.004342 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91706523-c9e3-40e7-b950-cc2d0e222122 service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:08.009452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39c935-c513-452b-ba83-b9736a72fc7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:08.011538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39c935-c513-452b-ba83-b9736a72fc7c service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:08.015451 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 732/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:33:08.016789 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e4626-5c78-41d0-9eb0-5c9f07c29ae8 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:08.017168 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e4626-5c78-41d0-9eb0-5c9f07c29ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:08.017620 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e4626-5c78-41d0-9eb0-5c9f07c29ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:08.046268 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 739/1471] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:33:08.073319 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-e34e4626-5c78-41d0-9eb0-5c9f07c29ae8 None None] MFA Rules not processed for user `5b490147c7124412803a7155325b416c`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:08.074840 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-e34e4626-5c78-41d0-9eb0-5c9f07c29ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:08.237859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 733/1472] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:08.239427 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39c935-c513-452b-ba83-b9736a72fc7c service cinder] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:08.433586 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39c935-c513-452b-ba83-b9736a72fc7c service cinder] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:08.441373 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3a788-54d0-4379-8962-7ff8cd75e0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:08.442308 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3a788-54d0-4379-8962-7ff8cd75e0f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:08.442947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3a788-54d0-4379-8962-7ff8cd75e0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:08.443672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3a788-54d0-4379-8962-7ff8cd75e0f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:08.444597 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3a788-54d0-4379-8962-7ff8cd75e0f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:08.473219 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3a788-54d0-4379-8962-7ff8cd75e0f6 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:08.599749 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 740/1473] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:33:08 2022] POST /identity/v3/projects => generated 373 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:08.603810 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e4626-5c78-41d0-9eb0-5c9f07c29ae8 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:08.619514 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e4626-5c78-41d0-9eb0-5c9f07c29ae8 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:08.716630 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab574b6-360e-43db-b1a3-1ff4803c0722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:08.717278 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab574b6-360e-43db-b1a3-1ff4803c0722 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:08.717571 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab574b6-360e-43db-b1a3-1ff4803c0722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:08.717898 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab574b6-360e-43db-b1a3-1ff4803c0722 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:08.718487 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab574b6-360e-43db-b1a3-1ff4803c0722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:08.723746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab574b6-360e-43db-b1a3-1ff4803c0722 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:08.919387 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 734/1474] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:33:08 2022] POST /identity/v3/users => generated 293 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:08.923665 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3a788-54d0-4379-8962-7ff8cd75e0f6 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:08.945693 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3a788-54d0-4379-8962-7ff8cd75e0f6 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:08.973742 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cb335-680d-41b3-9cad-ccdf69383ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:08.974674 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cb335-680d-41b3-9cad-ccdf69383ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:08.975167 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cb335-680d-41b3-9cad-ccdf69383ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:08.975560 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cb335-680d-41b3-9cad-ccdf69383ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:08.976501 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41cb335-680d-41b3-9cad-ccdf69383ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:08.978391 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41cb335-680d-41b3-9cad-ccdf69383ff0 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:08.998029 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 741/1475] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:09.001058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab574b6-360e-43db-b1a3-1ff4803c0722 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:09.021836 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab574b6-360e-43db-b1a3-1ff4803c0722 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:09.036752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23c4a7-108c-479a-863b-993f1acaa932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:09.037831 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23c4a7-108c-479a-863b-993f1acaa932 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:09.038365 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23c4a7-108c-479a-863b-993f1acaa932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:09.040084 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23c4a7-108c-479a-863b-993f1acaa932 admin admin] PATH_INFO: `/v3/projects/33ed0f6271bf4fd5955121b76ba14c66/users/399178d1002e4dfead7bdb2cd6156953/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:09.072975 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:09.090779 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23c4a7-108c-479a-863b-993f1acaa932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33ed0f6271bf4fd5955121b76ba14c66, user_id=399178d1002e4dfead7bdb2cd6156953, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:09.096127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23c4a7-108c-479a-863b-993f1acaa932 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:09.114145 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:09.226006 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 735/1476] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:08 2022] PUT /identity/v3/projects/33ed0f6271bf4fd5955121b76ba14c66/users/399178d1002e4dfead7bdb2cd6156953/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:09.230025 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cb335-680d-41b3-9cad-ccdf69383ff0 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:09.246249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cb335-680d-41b3-9cad-ccdf69383ff0 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:09.391684 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c4cf0-0b26-4512-8f6f-907a0089af46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:09.393459 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c4cf0-0b26-4512-8f6f-907a0089af46 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:09.393894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c4cf0-0b26-4512-8f6f-907a0089af46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:09.394277 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c4cf0-0b26-4512-8f6f-907a0089af46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:09.395107 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c4cf0-0b26-4512-8f6f-907a0089af46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:09.396970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c4cf0-0b26-4512-8f6f-907a0089af46 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:09.415348 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 742/1477] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:09.419190 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23c4a7-108c-479a-863b-993f1acaa932 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:09.438009 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23c4a7-108c-479a-863b-993f1acaa932 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:09.456730 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e48bc8-2c13-4ab7-8bc6-b87430174c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:09.457474 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e48bc8-2c13-4ab7-8bc6-b87430174c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:09.459055 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e48bc8-2c13-4ab7-8bc6-b87430174c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:09.459055 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e48bc8-2c13-4ab7-8bc6-b87430174c75 admin admin] PATH_INFO: `/v3/projects/33ed0f6271bf4fd5955121b76ba14c66/users/399178d1002e4dfead7bdb2cd6156953/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:09.470225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e48bc8-2c13-4ab7-8bc6-b87430174c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33ed0f6271bf4fd5955121b76ba14c66, user_id=399178d1002e4dfead7bdb2cd6156953, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:09.474770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e48bc8-2c13-4ab7-8bc6-b87430174c75 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:09.505076 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 736/1478] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:09 2022] PUT /identity/v3/projects/33ed0f6271bf4fd5955121b76ba14c66/users/399178d1002e4dfead7bdb2cd6156953/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:09.516202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245b7b9-c2c9-4b1e-a4f2-da37b38d57ef None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:09.516756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245b7b9-c2c9-4b1e-a4f2-da37b38d57ef None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:09.516756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245b7b9-c2c9-4b1e-a4f2-da37b38d57ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:09.568346 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-1245b7b9-c2c9-4b1e-a4f2-da37b38d57ef None None] MFA Rules not processed for user `399178d1002e4dfead7bdb2cd6156953`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:09.569608 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-1245b7b9-c2c9-4b1e-a4f2-da37b38d57ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:09.705049 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 743/1479] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:09.717407 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e48bc8-2c13-4ab7-8bc6-b87430174c75 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:09.855484 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e48bc8-2c13-4ab7-8bc6-b87430174c75 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:09.864671 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15146465-6db3-4e6c-80e7-860e770d2146 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:09.865396 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15146465-6db3-4e6c-80e7-860e770d2146 service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:09.865764 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15146465-6db3-4e6c-80e7-860e770d2146 service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:09.867011 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15146465-6db3-4e6c-80e7-860e770d2146 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:09.890516 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15146465-6db3-4e6c-80e7-860e770d2146 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:09.892116 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15146465-6db3-4e6c-80e7-860e770d2146 service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:09.914262 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 737/1480] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:33:10.337191 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245b7b9-c2c9-4b1e-a4f2-da37b38d57ef None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:10.341297 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-1245b7b9-c2c9-4b1e-a4f2-da37b38d57ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:10.398431 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245b7b9-c2c9-4b1e-a4f2-da37b38d57ef None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:10.419083 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62251bc-7957-4973-b9e9-d237e671e567 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:10.422367 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62251bc-7957-4973-b9e9-d237e671e567 service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:10.424579 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62251bc-7957-4973-b9e9-d237e671e567 service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:10.460875 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62251bc-7957-4973-b9e9-d237e671e567 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:10.587433 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62251bc-7957-4973-b9e9-d237e671e567 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:10.589443 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62251bc-7957-4973-b9e9-d237e671e567 service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:10.604926 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 744/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:33:11.424684 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15146465-6db3-4e6c-80e7-860e770d2146 service cinder] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:11.428637 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-15146465-6db3-4e6c-80e7-860e770d2146 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:11.662971 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15146465-6db3-4e6c-80e7-860e770d2146 service cinder] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:11.686243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d80775-cd07-4cc2-9433-67c6c05669a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:11.687151 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d80775-cd07-4cc2-9433-67c6c05669a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:11.688236 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d80775-cd07-4cc2-9433-67c6c05669a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:11.688691 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d80775-cd07-4cc2-9433-67c6c05669a5 admin admin] PATH_INFO: `/v3/users/3c0076ffa06b4ee58380a83389f48d1b` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:11.690344 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d80775-cd07-4cc2-9433-67c6c05669a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c0076ffa06b4ee58380a83389f48d1b)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:11.692518 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d80775-cd07-4cc2-9433-67c6c05669a5 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:12.005708 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-c1d80775-cd07-4cc2-9433-67c6c05669a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c0076ffa06b4ee58380a83389f48d1b'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:12.007423 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-c1d80775-cd07-4cc2-9433-67c6c05669a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c0076ffa06b4ee58380a83389f48d1b'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:12.103350 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-c1d80775-cd07-4cc2-9433-67c6c05669a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c0076ffa06b4ee58380a83389f48d1b'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:12.114148 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-c1d80775-cd07-4cc2-9433-67c6c05669a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c0076ffa06b4ee58380a83389f48d1b'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:12.115196 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-c1d80775-cd07-4cc2-9433-67c6c05669a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c0076ffa06b4ee58380a83389f48d1b'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:12.179479 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 738/1482] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:33:11 2022] DELETE /identity/v3/users/3c0076ffa06b4ee58380a83389f48d1b => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:12.181194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa990dd-954b-4e21-8943-f6261f70bb3f None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:12.181683 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa990dd-954b-4e21-8943-f6261f70bb3f None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:12.181771 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa990dd-954b-4e21-8943-f6261f70bb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:12.230791 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-6aa990dd-954b-4e21-8943-f6261f70bb3f None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:12.234417 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-6aa990dd-954b-4e21-8943-f6261f70bb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:12.269554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:12.356535 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:12.372488 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 745/1483] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:12.384478 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d80775-cd07-4cc2-9433-67c6c05669a5 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:12.385901 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c1d80775-cd07-4cc2-9433-67c6c05669a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:12.484855 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d80775-cd07-4cc2-9433-67c6c05669a5 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:12.493920 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e3429-8d46-49e9-8a65-981ea00598b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:12.494721 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e3429-8d46-49e9-8a65-981ea00598b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:12.498277 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e3429-8d46-49e9-8a65-981ea00598b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:12.498633 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e3429-8d46-49e9-8a65-981ea00598b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:12.514631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e3429-8d46-49e9-8a65-981ea00598b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:12.516326 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e3429-8d46-49e9-8a65-981ea00598b6 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:12.531369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 739/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:33:13.353744 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:13.464510 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa990dd-954b-4e21-8943-f6261f70bb3f None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:13.466119 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-6aa990dd-954b-4e21-8943-f6261f70bb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:13.481266 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa990dd-954b-4e21-8943-f6261f70bb3f None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:13.492076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c450e-bfab-4821-b090-122d4b615fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:13.493727 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c450e-bfab-4821-b090-122d4b615fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:13.494331 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c450e-bfab-4821-b090-122d4b615fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:13.495054 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c450e-bfab-4821-b090-122d4b615fc0 admin admin] PATH_INFO: `/v3/projects/0d43518b5cb04cf5a2965168c8ffb358` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:13.497806 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c450e-bfab-4821-b090-122d4b615fc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d43518b5cb04cf5a2965168c8ffb358)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:13.501063 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c450e-bfab-4821-b090-122d4b615fc0 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:13.845047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-002c450e-bfab-4821-b090-122d4b615fc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d43518b5cb04cf5a2965168c8ffb358', 'request_id': 'req-002c450e-bfab-4821-b090-122d4b615fc0'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:13.851998 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-002c450e-bfab-4821-b090-122d4b615fc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d43518b5cb04cf5a2965168c8ffb358', 'request_id': 'req-002c450e-bfab-4821-b090-122d4b615fc0'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:14.016581 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-002c450e-bfab-4821-b090-122d4b615fc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d43518b5cb04cf5a2965168c8ffb358', 'request_id': 'req-002c450e-bfab-4821-b090-122d4b615fc0'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:14.038663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-002c450e-bfab-4821-b090-122d4b615fc0 admin admin] The token cache is being invalidate because project 0d43518b5cb04cf5a2965168c8ffb358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:33:14.039137 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-002c450e-bfab-4821-b090-122d4b615fc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:14.039816 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-002c450e-bfab-4821-b090-122d4b615fc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:14.041636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 746/1485] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:33:13 2022] DELETE /identity/v3/projects/0d43518b5cb04cf5a2965168c8ffb358 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:14.046517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e3429-8d46-49e9-8a65-981ea00598b6 service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:14.064133 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e3429-8d46-49e9-8a65-981ea00598b6 service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:14.151584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d8ea3-a87e-44fd-8f43-dc8006a8e410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:14.152776 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d8ea3-a87e-44fd-8f43-dc8006a8e410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:14.153060 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d8ea3-a87e-44fd-8f43-dc8006a8e410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:14.153338 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d8ea3-a87e-44fd-8f43-dc8006a8e410 admin admin] PATH_INFO: `/v3/users/13c4a1a270b945c68d855204234d0ef5` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:14.154677 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d8ea3-a87e-44fd-8f43-dc8006a8e410 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13c4a1a270b945c68d855204234d0ef5)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:14.156666 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d8ea3-a87e-44fd-8f43-dc8006a8e410 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:14.339182 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b17d8ea3-a87e-44fd-8f43-dc8006a8e410 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13c4a1a270b945c68d855204234d0ef5'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:14.339975 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b17d8ea3-a87e-44fd-8f43-dc8006a8e410 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13c4a1a270b945c68d855204234d0ef5'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:14.410309 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b17d8ea3-a87e-44fd-8f43-dc8006a8e410 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13c4a1a270b945c68d855204234d0ef5'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:14.418102 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b17d8ea3-a87e-44fd-8f43-dc8006a8e410 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13c4a1a270b945c68d855204234d0ef5'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:14.418791 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b17d8ea3-a87e-44fd-8f43-dc8006a8e410 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13c4a1a270b945c68d855204234d0ef5'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:14.437422 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 740/1486] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:33:14 2022] DELETE /identity/v3/users/13c4a1a270b945c68d855204234d0ef5 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:14.770752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:14.984212 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c450e-bfab-4821-b090-122d4b615fc0 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:14.985718 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-002c450e-bfab-4821-b090-122d4b615fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:15.003590 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c450e-bfab-4821-b090-122d4b615fc0 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:15.064176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45532fc-813a-46b9-a955-88fd0bc2296c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:15.064815 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45532fc-813a-46b9-a955-88fd0bc2296c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:15.065092 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45532fc-813a-46b9-a955-88fd0bc2296c admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:15.065367 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45532fc-813a-46b9-a955-88fd0bc2296c admin admin] PATH_INFO: `/v3/projects/de629d634ed44d629e6f32c06487f74a` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:15.066503 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45532fc-813a-46b9-a955-88fd0bc2296c admin admin] RBAC: Authorizing `identity:delete_project(project_id=de629d634ed44d629e6f32c06487f74a)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:15.068468 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45532fc-813a-46b9-a955-88fd0bc2296c admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:15.235011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c45532fc-813a-46b9-a955-88fd0bc2296c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de629d634ed44d629e6f32c06487f74a', 'request_id': 'req-c45532fc-813a-46b9-a955-88fd0bc2296c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:15.236820 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c45532fc-813a-46b9-a955-88fd0bc2296c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de629d634ed44d629e6f32c06487f74a', 'request_id': 'req-c45532fc-813a-46b9-a955-88fd0bc2296c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:15.311580 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c45532fc-813a-46b9-a955-88fd0bc2296c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de629d634ed44d629e6f32c06487f74a', 'request_id': 'req-c45532fc-813a-46b9-a955-88fd0bc2296c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:15.325229 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c45532fc-813a-46b9-a955-88fd0bc2296c admin admin] The token cache is being invalidate because project de629d634ed44d629e6f32c06487f74a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:33:15.325540 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c45532fc-813a-46b9-a955-88fd0bc2296c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:15.326198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c45532fc-813a-46b9-a955-88fd0bc2296c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:15.327738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 747/1487] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:33:14 2022] DELETE /identity/v3/projects/de629d634ed44d629e6f32c06487f74a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:15.332633 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0250f-8c09-4964-91a1-0c0f68e4174a None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:15.333101 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0250f-8c09-4964-91a1-0c0f68e4174a None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:15.333197 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0250f-8c09-4964-91a1-0c0f68e4174a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:15.353997 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-cde0250f-8c09-4964-91a1-0c0f68e4174a None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:15.355235 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-cde0250f-8c09-4964-91a1-0c0f68e4174a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:15.412679 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45532fc-813a-46b9-a955-88fd0bc2296c admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:15.414216 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-c45532fc-813a-46b9-a955-88fd0bc2296c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:15.421037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 741/1488] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:15.427009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45532fc-813a-46b9-a955-88fd0bc2296c admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:15.431791 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6535a4-f2ff-49bb-98a8-dfc6edffb726 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:15.431791 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6535a4-f2ff-49bb-98a8-dfc6edffb726 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:15.431791 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6535a4-f2ff-49bb-98a8-dfc6edffb726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:15.432197 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e258d73-68b2-42ef-9f79-af28e0798669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:15.432413 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e258d73-68b2-42ef-9f79-af28e0798669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:15.432695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e258d73-68b2-42ef-9f79-af28e0798669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:15.432971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e258d73-68b2-42ef-9f79-af28e0798669 admin admin] PATH_INFO: `/v3/users/bbc10aa5b7e84677ac83c1a6367b163c` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:15.434425 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e258d73-68b2-42ef-9f79-af28e0798669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbc10aa5b7e84677ac83c1a6367b163c)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:15.436432 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e258d73-68b2-42ef-9f79-af28e0798669 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:15.451107 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-bd6535a4-f2ff-49bb-98a8-dfc6edffb726 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:15.452310 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-bd6535a4-f2ff-49bb-98a8-dfc6edffb726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:15.462755 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 742/1489] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:15.467079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6535a4-f2ff-49bb-98a8-dfc6edffb726 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:15.476353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6535a4-f2ff-49bb-98a8-dfc6edffb726 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:15.481021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1374e-901f-4260-b5c0-115c5ff60321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:15.481597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1374e-901f-4260-b5c0-115c5ff60321 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:15.481872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1374e-901f-4260-b5c0-115c5ff60321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:15.482140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1374e-901f-4260-b5c0-115c5ff60321 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:15.482771 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1374e-901f-4260-b5c0-115c5ff60321 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:33:15.483106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1374e-901f-4260-b5c0-115c5ff60321 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:15.484795 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1374e-901f-4260-b5c0-115c5ff60321 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:15.496413 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 743/1490] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:33:15.500376 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1374e-901f-4260-b5c0-115c5ff60321 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:15.510441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1374e-901f-4260-b5c0-115c5ff60321 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:15.515292 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da23e21-f452-4459-81b3-5b679a4c2900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:15.517909 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da23e21-f452-4459-81b3-5b679a4c2900 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:15.517909 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da23e21-f452-4459-81b3-5b679a4c2900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:15.517909 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da23e21-f452-4459-81b3-5b679a4c2900 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:15.517909 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da23e21-f452-4459-81b3-5b679a4c2900 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:15.518883 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da23e21-f452-4459-81b3-5b679a4c2900 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:15.613213 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 744/1491] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:33:15 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:33:15.617758 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da23e21-f452-4459-81b3-5b679a4c2900 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:15.684312 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da23e21-f452-4459-81b3-5b679a4c2900 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:15.689713 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74512b8-9ec5-4e3c-8421-2748972ace39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:15.695340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74512b8-9ec5-4e3c-8421-2748972ace39 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:15.695340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74512b8-9ec5-4e3c-8421-2748972ace39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:15.695340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74512b8-9ec5-4e3c-8421-2748972ace39 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:15.695340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74512b8-9ec5-4e3c-8421-2748972ace39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:15.695340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74512b8-9ec5-4e3c-8421-2748972ace39 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:15.702875 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0e258d73-68b2-42ef-9f79-af28e0798669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc10aa5b7e84677ac83c1a6367b163c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:15.703545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0e258d73-68b2-42ef-9f79-af28e0798669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc10aa5b7e84677ac83c1a6367b163c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:15.793409 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0e258d73-68b2-42ef-9f79-af28e0798669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc10aa5b7e84677ac83c1a6367b163c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:15.799947 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 745/1492] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:33:15 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:33:15.804794 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74512b8-9ec5-4e3c-8421-2748972ace39 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:15.806708 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-a74512b8-9ec5-4e3c-8421-2748972ace39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:15.811839 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0e258d73-68b2-42ef-9f79-af28e0798669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc10aa5b7e84677ac83c1a6367b163c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:15.812532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0e258d73-68b2-42ef-9f79-af28e0798669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc10aa5b7e84677ac83c1a6367b163c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:15.821152 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74512b8-9ec5-4e3c-8421-2748972ace39 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:15.826107 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb9dc9-c076-4d53-8682-560ee4bc5ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:15.826719 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb9dc9-c076-4d53-8682-560ee4bc5ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:15.827027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb9dc9-c076-4d53-8682-560ee4bc5ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:15.827301 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb9dc9-c076-4d53-8682-560ee4bc5ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:15.828035 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb9dc9-c076-4d53-8682-560ee4bc5ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:15.829747 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb9dc9-c076-4d53-8682-560ee4bc5ee2 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:15.830028 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 748/1493] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:33:15 2022] DELETE /identity/v3/users/bbc10aa5b7e84677ac83c1a6367b163c => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:33:15.831774 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79fd0b-7069-4f4e-be47-909fa8c155ea None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:15.837722 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79fd0b-7069-4f4e-be47-909fa8c155ea None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:15.837722 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79fd0b-7069-4f4e-be47-909fa8c155ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:15.841325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 746/1494] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:33:15.844876 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb9dc9-c076-4d53-8682-560ee4bc5ee2 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:15.854232 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-4a79fd0b-7069-4f4e-be47-909fa8c155ea None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:15.855604 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-4a79fd0b-7069-4f4e-be47-909fa8c155ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:15.876085 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb9dc9-c076-4d53-8682-560ee4bc5ee2 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:15.931328 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 749/1495] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:15.943051 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79fd0b-7069-4f4e-be47-909fa8c155ea None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:15.944682 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-4a79fd0b-7069-4f4e-be47-909fa8c155ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:15.948940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565e52b-ad9b-4218-be6e-94e1f66e03fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:15.949556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565e52b-ad9b-4218-be6e-94e1f66e03fa admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:15.949840 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565e52b-ad9b-4218-be6e-94e1f66e03fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:15.950110 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565e52b-ad9b-4218-be6e-94e1f66e03fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:15.950750 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565e52b-ad9b-4218-be6e-94e1f66e03fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:15.952406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565e52b-ad9b-4218-be6e-94e1f66e03fa admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:15.964352 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 747/1496] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:33:15.968409 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565e52b-ad9b-4218-be6e-94e1f66e03fa admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:15.979631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565e52b-ad9b-4218-be6e-94e1f66e03fa admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:15.984323 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b17612-df4a-4a3e-9994-6e3f50908a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:15.984969 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b17612-df4a-4a3e-9994-6e3f50908a05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:15.985258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b17612-df4a-4a3e-9994-6e3f50908a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:15.985528 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b17612-df4a-4a3e-9994-6e3f50908a05 admin admin] PATH_INFO: `/v3/projects/5c087bf603ff41b1b4ea472ca8a5d8ae/users/eda636e8f2cb45708bddd02b501cedfb/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:16.001449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b17612-df4a-4a3e-9994-6e3f50908a05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c087bf603ff41b1b4ea472ca8a5d8ae, user_id=eda636e8f2cb45708bddd02b501cedfb, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:16.003397 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79fd0b-7069-4f4e-be47-909fa8c155ea None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:16.006373 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b17612-df4a-4a3e-9994-6e3f50908a05 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:16.007423 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebbc50-1ef6-4076-a712-190754c01c62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:16.008033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebbc50-1ef6-4076-a712-190754c01c62 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:16.008319 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebbc50-1ef6-4076-a712-190754c01c62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:16.008619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebbc50-1ef6-4076-a712-190754c01c62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:16.017722 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebbc50-1ef6-4076-a712-190754c01c62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:16.019207 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebbc50-1ef6-4076-a712-190754c01c62 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:16.032318 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 750/1497] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:33:16.113920 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 748/1498] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:15 2022] PUT /identity/v3/projects/5c087bf603ff41b1b4ea472ca8a5d8ae/users/eda636e8f2cb45708bddd02b501cedfb/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:33:16.125560 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ae8cc-da51-4165-9a5e-fb0fd65b5fd8 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:16.125850 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ae8cc-da51-4165-9a5e-fb0fd65b5fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:16.126580 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ae8cc-da51-4165-9a5e-fb0fd65b5fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:16.157147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-1e4ae8cc-da51-4165-9a5e-fb0fd65b5fd8 None None] MFA Rules not processed for user `eda636e8f2cb45708bddd02b501cedfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:16.158351 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-1e4ae8cc-da51-4165-9a5e-fb0fd65b5fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:16.259757 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b17612-df4a-4a3e-9994-6e3f50908a05 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:16.259887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 751/1499] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:16.337421 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b17612-df4a-4a3e-9994-6e3f50908a05 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:16.347954 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c89a4-eab7-4d42-b1cc-cf0cae871aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:16.367359 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c89a4-eab7-4d42-b1cc-cf0cae871aaf admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:16.367359 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c89a4-eab7-4d42-b1cc-cf0cae871aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:16.367359 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c89a4-eab7-4d42-b1cc-cf0cae871aaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:16.367359 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c89a4-eab7-4d42-b1cc-cf0cae871aaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:16.370143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c89a4-eab7-4d42-b1cc-cf0cae871aaf admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:16.491025 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 749/1500] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:33:16 2022] POST /identity/v3/projects => generated 385 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:16.496223 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ae8cc-da51-4165-9a5e-fb0fd65b5fd8 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:16.511195 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ae8cc-da51-4165-9a5e-fb0fd65b5fd8 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:16.739622 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470c66a-ac44-4c6b-b355-2cda528eed9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:16.740451 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470c66a-ac44-4c6b-b355-2cda528eed9a admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:16.740749 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470c66a-ac44-4c6b-b355-2cda528eed9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:16.741025 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470c66a-ac44-4c6b-b355-2cda528eed9a admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:16.742432 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470c66a-ac44-4c6b-b355-2cda528eed9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:16.748378 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470c66a-ac44-4c6b-b355-2cda528eed9a admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:16.949668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 752/1501] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:33:16 2022] POST /identity/v3/users => generated 299 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:16.953398 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c89a4-eab7-4d42-b1cc-cf0cae871aaf admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:16.968388 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c89a4-eab7-4d42-b1cc-cf0cae871aaf admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:16.973419 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e3418-9c24-4c68-9588-67133f8f5778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:16.974092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e3418-9c24-4c68-9588-67133f8f5778 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:16.974449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e3418-9c24-4c68-9588-67133f8f5778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:16.974780 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e3418-9c24-4c68-9588-67133f8f5778 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:16.975518 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e3418-9c24-4c68-9588-67133f8f5778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:16.979733 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470c66a-ac44-4c6b-b355-2cda528eed9a admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:16.981786 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-9470c66a-ac44-4c6b-b355-2cda528eed9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:16.994225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e3418-9c24-4c68-9588-67133f8f5778 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:17.000911 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470c66a-ac44-4c6b-b355-2cda528eed9a admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:17.012207 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d1b4c-283d-4c63-b829-163736d5d7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:17.020402 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d1b4c-283d-4c63-b829-163736d5d7ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:17.020402 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d1b4c-283d-4c63-b829-163736d5d7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:17.020402 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d1b4c-283d-4c63-b829-163736d5d7ac admin admin] PATH_INFO: `/v3/projects/8e7ab2b353aa4ad99bf34ec887e1e960` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:17.021023 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 750/1502] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:17.021023 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e3418-9c24-4c68-9588-67133f8f5778 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:17.021343 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d1b4c-283d-4c63-b829-163736d5d7ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e7ab2b353aa4ad99bf34ec887e1e960)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:17.021343 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d1b4c-283d-4c63-b829-163736d5d7ac admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:17.032249 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e3418-9c24-4c68-9588-67133f8f5778 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:17.037085 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289b013-2063-4ce1-8cb2-89f8ea27d723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:17.037751 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289b013-2063-4ce1-8cb2-89f8ea27d723 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:17.038065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289b013-2063-4ce1-8cb2-89f8ea27d723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:17.038404 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289b013-2063-4ce1-8cb2-89f8ea27d723 admin admin] PATH_INFO: `/v3/projects/5eede7b519da40cbb077a310a2cc5f5e/users/971afb7817f144098908b5fe959086e6/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:17.054230 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289b013-2063-4ce1-8cb2-89f8ea27d723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eede7b519da40cbb077a310a2cc5f5e, user_id=971afb7817f144098908b5fe959086e6, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:17.056979 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289b013-2063-4ce1-8cb2-89f8ea27d723 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:17.210729 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 751/1503] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:17 2022] PUT /identity/v3/projects/5eede7b519da40cbb077a310a2cc5f5e/users/971afb7817f144098908b5fe959086e6/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:17.214859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289b013-2063-4ce1-8cb2-89f8ea27d723 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:17.227328 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2c9d1b4c-283d-4c63-b829-163736d5d7ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e7ab2b353aa4ad99bf34ec887e1e960', 'request_id': 'req-2c9d1b4c-283d-4c63-b829-163736d5d7ac'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:17.232900 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2c9d1b4c-283d-4c63-b829-163736d5d7ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e7ab2b353aa4ad99bf34ec887e1e960', 'request_id': 'req-2c9d1b4c-283d-4c63-b829-163736d5d7ac'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:17.273346 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:17.278580 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289b013-2063-4ce1-8cb2-89f8ea27d723 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:17.336135 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c251e-a2a3-4ffa-96fe-ec7d03d19caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:17.336290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c251e-a2a3-4ffa-96fe-ec7d03d19caf admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:17.336488 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c251e-a2a3-4ffa-96fe-ec7d03d19caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:17.336760 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c251e-a2a3-4ffa-96fe-ec7d03d19caf admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:17.337408 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c251e-a2a3-4ffa-96fe-ec7d03d19caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:17.339038 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c251e-a2a3-4ffa-96fe-ec7d03d19caf admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:17.349619 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 752/1504] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:33:17.353623 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c251e-a2a3-4ffa-96fe-ec7d03d19caf admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:17.359248 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2c9d1b4c-283d-4c63-b829-163736d5d7ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e7ab2b353aa4ad99bf34ec887e1e960', 'request_id': 'req-2c9d1b4c-283d-4c63-b829-163736d5d7ac'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:17.363655 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c251e-a2a3-4ffa-96fe-ec7d03d19caf admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:17.371662 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31faa22-5016-4565-9727-96d371f32a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:17.372436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31faa22-5016-4565-9727-96d371f32a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:17.372723 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31faa22-5016-4565-9727-96d371f32a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:17.373000 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31faa22-5016-4565-9727-96d371f32a1f admin admin] PATH_INFO: `/v3/projects/5eede7b519da40cbb077a310a2cc5f5e/users/971afb7817f144098908b5fe959086e6/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:17.374952 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31faa22-5016-4565-9727-96d371f32a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eede7b519da40cbb077a310a2cc5f5e, user_id=971afb7817f144098908b5fe959086e6, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:17.376185 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2c9d1b4c-283d-4c63-b829-163736d5d7ac admin admin] The token cache is being invalidate because project 8e7ab2b353aa4ad99bf34ec887e1e960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:33:17.376644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2c9d1b4c-283d-4c63-b829-163736d5d7ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:17.377273 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2c9d1b4c-283d-4c63-b829-163736d5d7ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:17.377903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31faa22-5016-4565-9727-96d371f32a1f admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:17.378781 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 753/1505] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:33:16 2022] DELETE /identity/v3/projects/8e7ab2b353aa4ad99bf34ec887e1e960 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:33:17.384097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d1b4c-283d-4c63-b829-163736d5d7ac admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:17.385584 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-2c9d1b4c-283d-4c63-b829-163736d5d7ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:17.391801 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 753/1506] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:17 2022] PUT /identity/v3/projects/5eede7b519da40cbb077a310a2cc5f5e/users/971afb7817f144098908b5fe959086e6/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:33:17.400508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d1b4c-283d-4c63-b829-163736d5d7ac admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:17.404438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93380d-8693-458a-90c7-855722eab827 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:17.405068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93380d-8693-458a-90c7-855722eab827 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:17.405536 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93380d-8693-458a-90c7-855722eab827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:17.436451 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-9f93380d-8693-458a-90c7-855722eab827 None None] MFA Rules not processed for user `971afb7817f144098908b5fe959086e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:17.437789 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-9f93380d-8693-458a-90c7-855722eab827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:17.469613 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f2d33-3365-4ddc-90d3-8d79ae30d2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:17.470433 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f2d33-3365-4ddc-90d3-8d79ae30d2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:17.470778 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f2d33-3365-4ddc-90d3-8d79ae30d2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:17.471394 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f2d33-3365-4ddc-90d3-8d79ae30d2b0 admin admin] PATH_INFO: `/v3/users/3fc2c60bd37244769333e7c4912c8359` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:17.472814 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f2d33-3365-4ddc-90d3-8d79ae30d2b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fc2c60bd37244769333e7c4912c8359)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:17.474803 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f2d33-3365-4ddc-90d3-8d79ae30d2b0 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:17.510122 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 754/1507] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:33:17.520691 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93380d-8693-458a-90c7-855722eab827 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:17.522013 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-9f93380d-8693-458a-90c7-855722eab827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:17.579617 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93380d-8693-458a-90c7-855722eab827 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:17.583216 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1bbd3-8dc5-4577-9c4f-0b9909d33f2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:17.583820 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1bbd3-8dc5-4577-9c4f-0b9909d33f2e service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:17.584101 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1bbd3-8dc5-4577-9c4f-0b9909d33f2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:17.584373 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1bbd3-8dc5-4577-9c4f-0b9909d33f2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:17.586783 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-dbe1bbd3-8dc5-4577-9c4f-0b9909d33f2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:17.644066 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1bbd3-8dc5-4577-9c4f-0b9909d33f2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:17.645509 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1bbd3-8dc5-4577-9c4f-0b9909d33f2e service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:17.655231 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 755/1508] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:33:17.768946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e65f2d33-3365-4ddc-90d3-8d79ae30d2b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc2c60bd37244769333e7c4912c8359'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:17.778315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e65f2d33-3365-4ddc-90d3-8d79ae30d2b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc2c60bd37244769333e7c4912c8359'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:17.890598 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e65f2d33-3365-4ddc-90d3-8d79ae30d2b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc2c60bd37244769333e7c4912c8359'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:17.904200 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e65f2d33-3365-4ddc-90d3-8d79ae30d2b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc2c60bd37244769333e7c4912c8359'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:17.904682 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e65f2d33-3365-4ddc-90d3-8d79ae30d2b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc2c60bd37244769333e7c4912c8359'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:17.918057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 754/1509] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:33:17 2022] DELETE /identity/v3/users/3fc2c60bd37244769333e7c4912c8359 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:18.450525 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:18.492559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1bbd3-8dc5-4577-9c4f-0b9909d33f2e service cinder] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:18.506248 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1bbd3-8dc5-4577-9c4f-0b9909d33f2e service cinder] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:18.568540 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e444c-4727-48b1-9b20-7129f17e66be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:18.569679 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e444c-4727-48b1-9b20-7129f17e66be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:18.570142 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e444c-4727-48b1-9b20-7129f17e66be admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:18.570462 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e444c-4727-48b1-9b20-7129f17e66be admin admin] PATH_INFO: `/v3/projects/aefcff72caf6476599727e33d6603d37` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:18.571639 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e444c-4727-48b1-9b20-7129f17e66be admin admin] RBAC: Authorizing `identity:delete_project(project_id=aefcff72caf6476599727e33d6603d37)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:18.573577 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e444c-4727-48b1-9b20-7129f17e66be admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:18.691855 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-747e444c-4727-48b1-9b20-7129f17e66be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aefcff72caf6476599727e33d6603d37', 'request_id': 'req-747e444c-4727-48b1-9b20-7129f17e66be'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:18.698091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-747e444c-4727-48b1-9b20-7129f17e66be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aefcff72caf6476599727e33d6603d37', 'request_id': 'req-747e444c-4727-48b1-9b20-7129f17e66be'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:18.704512 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-747e444c-4727-48b1-9b20-7129f17e66be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aefcff72caf6476599727e33d6603d37', 'request_id': 'req-747e444c-4727-48b1-9b20-7129f17e66be'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:19.787020 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-747e444c-4727-48b1-9b20-7129f17e66be admin admin] The token cache is being invalidate because project aefcff72caf6476599727e33d6603d37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:33:19.787532 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-747e444c-4727-48b1-9b20-7129f17e66be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:19.789218 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-747e444c-4727-48b1-9b20-7129f17e66be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:19.790789 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 756/1510] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:33:18 2022] DELETE /identity/v3/projects/aefcff72caf6476599727e33d6603d37 => generated 0 bytes in 1300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:19.795953 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65916001-cd88-4051-bce8-4a15bffdb624 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:19.796443 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65916001-cd88-4051-bce8-4a15bffdb624 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:19.796443 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65916001-cd88-4051-bce8-4a15bffdb624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:19.817247 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-65916001-cd88-4051-bce8-4a15bffdb624 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:19.818442 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-65916001-cd88-4051-bce8-4a15bffdb624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:19.876862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 755/1511] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:33:19.887891 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198699a-1a9a-491f-b895-a100e9f4e683 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:19.887891 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198699a-1a9a-491f-b895-a100e9f4e683 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:19.887891 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198699a-1a9a-491f-b895-a100e9f4e683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:19.906221 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-f198699a-1a9a-491f-b895-a100e9f4e683 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:19.907437 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-f198699a-1a9a-491f-b895-a100e9f4e683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:19.916227 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 757/1512] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:19.920758 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65916001-cd88-4051-bce8-4a15bffdb624 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:19.931494 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65916001-cd88-4051-bce8-4a15bffdb624 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:19.936545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cd3d2-411e-44a7-b726-ca2593e9f288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:19.937144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cd3d2-411e-44a7-b726-ca2593e9f288 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:19.937423 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cd3d2-411e-44a7-b726-ca2593e9f288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:19.937696 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cd3d2-411e-44a7-b726-ca2593e9f288 admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:19.938340 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cd3d2-411e-44a7-b726-ca2593e9f288 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:33:19.938644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cd3d2-411e-44a7-b726-ca2593e9f288 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:19.940285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cd3d2-411e-44a7-b726-ca2593e9f288 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:19.951734 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 756/1513] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:33:19.959730 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198699a-1a9a-491f-b895-a100e9f4e683 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:19.969338 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198699a-1a9a-491f-b895-a100e9f4e683 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:19.973891 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d709152-28ad-4fa8-a68d-9bbd3d492340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:19.974477 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d709152-28ad-4fa8-a68d-9bbd3d492340 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:19.974751 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d709152-28ad-4fa8-a68d-9bbd3d492340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:19.975045 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d709152-28ad-4fa8-a68d-9bbd3d492340 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:19.976469 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d709152-28ad-4fa8-a68d-9bbd3d492340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:19.978492 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d709152-28ad-4fa8-a68d-9bbd3d492340 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:20.124354 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 758/1514] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:33:19 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:20.125530 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cd3d2-411e-44a7-b726-ca2593e9f288 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:20.136120 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cd3d2-411e-44a7-b726-ca2593e9f288 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:20.236705 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ee9eb-9259-4117-8268-eb2b4b4b2440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:20.238715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ee9eb-9259-4117-8268-eb2b4b4b2440 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:20.240261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ee9eb-9259-4117-8268-eb2b4b4b2440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:20.240261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ee9eb-9259-4117-8268-eb2b4b4b2440 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:20.240448 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ee9eb-9259-4117-8268-eb2b4b4b2440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:20.243532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ee9eb-9259-4117-8268-eb2b4b4b2440 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:20.406863 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 757/1515] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:33:20 2022] POST /identity/v3/users => generated 291 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:20.410575 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d709152-28ad-4fa8-a68d-9bbd3d492340 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:20.426004 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d709152-28ad-4fa8-a68d-9bbd3d492340 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:20.433467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ade449-b07b-4921-a67e-e6e68ced8952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:20.434281 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ade449-b07b-4921-a67e-e6e68ced8952 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:20.434711 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ade449-b07b-4921-a67e-e6e68ced8952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:20.435773 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ade449-b07b-4921-a67e-e6e68ced8952 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:20.436601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ade449-b07b-4921-a67e-e6e68ced8952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:20.438375 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ade449-b07b-4921-a67e-e6e68ced8952 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:20.451225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 759/1516] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:20.455476 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ee9eb-9259-4117-8268-eb2b4b4b2440 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:20.466643 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ee9eb-9259-4117-8268-eb2b4b4b2440 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:20.472467 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba189753-4b39-4527-89b2-b85a83b9ddd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:20.473157 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba189753-4b39-4527-89b2-b85a83b9ddd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:20.473367 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:20.474191 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba189753-4b39-4527-89b2-b85a83b9ddd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:20.474313 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba189753-4b39-4527-89b2-b85a83b9ddd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:20.475054 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba189753-4b39-4527-89b2-b85a83b9ddd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:20.476772 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba189753-4b39-4527-89b2-b85a83b9ddd3 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:20.489837 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 758/1517] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:20.495727 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ade449-b07b-4921-a67e-e6e68ced8952 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:20.510289 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ade449-b07b-4921-a67e-e6e68ced8952 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:20.518097 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da6666-d0fe-4585-ae89-ce4412f506b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:20.519379 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da6666-d0fe-4585-ae89-ce4412f506b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:20.519766 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da6666-d0fe-4585-ae89-ce4412f506b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:20.520141 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da6666-d0fe-4585-ae89-ce4412f506b7 admin admin] PATH_INFO: `/v3/projects/d8584d25ad7c440194b8fdb575a13898/users/686c15651ee943c6b00517ae115fc0d1/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:20.556501 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da6666-d0fe-4585-ae89-ce4412f506b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8584d25ad7c440194b8fdb575a13898, user_id=686c15651ee943c6b00517ae115fc0d1, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:20.560355 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da6666-d0fe-4585-ae89-ce4412f506b7 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:20.708329 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 760/1518] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:20 2022] PUT /identity/v3/projects/d8584d25ad7c440194b8fdb575a13898/users/686c15651ee943c6b00517ae115fc0d1/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:20.718624 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b46b9-477f-4aaf-9265-3b4262227ff7 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:20.719029 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b46b9-477f-4aaf-9265-3b4262227ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:20.719374 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b46b9-477f-4aaf-9265-3b4262227ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:20.750184 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-b27b46b9-477f-4aaf-9265-3b4262227ff7 None None] MFA Rules not processed for user `686c15651ee943c6b00517ae115fc0d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:20.751569 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-b27b46b9-477f-4aaf-9265-3b4262227ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:20.831455 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 759/1519] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:20.836129 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da6666-d0fe-4585-ae89-ce4412f506b7 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:20.900749 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da6666-d0fe-4585-ae89-ce4412f506b7 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:20.905533 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2afff-7b91-4317-9c54-1d2ce8578885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:20.906140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2afff-7b91-4317-9c54-1d2ce8578885 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:20.906423 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2afff-7b91-4317-9c54-1d2ce8578885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:20.906702 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2afff-7b91-4317-9c54-1d2ce8578885 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:20.907369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2afff-7b91-4317-9c54-1d2ce8578885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:20.909347 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2afff-7b91-4317-9c54-1d2ce8578885 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:20.983687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 761/1520] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:33:20 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:20.987627 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b46b9-477f-4aaf-9265-3b4262227ff7 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:20.998461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b46b9-477f-4aaf-9265-3b4262227ff7 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:21.057486 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f632f7-2f17-4168-a9e7-c3d1b61b049f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:21.058092 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f632f7-2f17-4168-a9e7-c3d1b61b049f admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:21.058634 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f632f7-2f17-4168-a9e7-c3d1b61b049f admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:21.058933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f632f7-2f17-4168-a9e7-c3d1b61b049f admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:21.059569 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f632f7-2f17-4168-a9e7-c3d1b61b049f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:21.061475 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f632f7-2f17-4168-a9e7-c3d1b61b049f admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:21.154555 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 760/1521] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:33:20 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:33:21.158569 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2afff-7b91-4317-9c54-1d2ce8578885 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:21.169633 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2afff-7b91-4317-9c54-1d2ce8578885 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:21.174377 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbaec3-0900-4a68-8a5d-81cecf10b52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:21.175017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbaec3-0900-4a68-8a5d-81cecf10b52d admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:21.175372 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbaec3-0900-4a68-8a5d-81cecf10b52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:21.175665 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbaec3-0900-4a68-8a5d-81cecf10b52d admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:21.176373 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcbaec3-0900-4a68-8a5d-81cecf10b52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:21.177979 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcbaec3-0900-4a68-8a5d-81cecf10b52d admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:21.189276 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 762/1522] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:21.193578 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f632f7-2f17-4168-a9e7-c3d1b61b049f admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:21.203970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f632f7-2f17-4168-a9e7-c3d1b61b049f admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:21.208769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89120ac-71ff-40f4-8f4c-4d368f6eaa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:21.209427 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89120ac-71ff-40f4-8f4c-4d368f6eaa5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:21.210217 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89120ac-71ff-40f4-8f4c-4d368f6eaa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:21.210496 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89120ac-71ff-40f4-8f4c-4d368f6eaa5e admin admin] PATH_INFO: `/v3/projects/8a19d823375c4ef5a2237179393d3c73/users/91b069b5bb3e478dae424a92ec8dda73/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:21.227493 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89120ac-71ff-40f4-8f4c-4d368f6eaa5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a19d823375c4ef5a2237179393d3c73, user_id=91b069b5bb3e478dae424a92ec8dda73, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:21.230165 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89120ac-71ff-40f4-8f4c-4d368f6eaa5e admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:21.371107 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 761/1523] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:21 2022] PUT /identity/v3/projects/8a19d823375c4ef5a2237179393d3c73/users/91b069b5bb3e478dae424a92ec8dda73/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:21.375466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbaec3-0900-4a68-8a5d-81cecf10b52d admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:21.386108 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbaec3-0900-4a68-8a5d-81cecf10b52d admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:21.455991 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0d000-e3cf-460b-ad82-72770d119621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:21.456616 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0d000-e3cf-460b-ad82-72770d119621 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:21.456893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0d000-e3cf-460b-ad82-72770d119621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:21.457191 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0d000-e3cf-460b-ad82-72770d119621 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:21.457837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0d000-e3cf-460b-ad82-72770d119621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:21.459459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0d000-e3cf-460b-ad82-72770d119621 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:21.470260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 763/1524] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:21.474433 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89120ac-71ff-40f4-8f4c-4d368f6eaa5e admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:21.486104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89120ac-71ff-40f4-8f4c-4d368f6eaa5e admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:21.491519 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e6d7b-e413-486e-9ecb-3f3efeebebb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:21.492177 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e6d7b-e413-486e-9ecb-3f3efeebebb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:21.492473 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e6d7b-e413-486e-9ecb-3f3efeebebb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:21.492742 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e6d7b-e413-486e-9ecb-3f3efeebebb8 admin admin] PATH_INFO: `/v3/projects/8a19d823375c4ef5a2237179393d3c73/users/91b069b5bb3e478dae424a92ec8dda73/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:21.494832 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e6d7b-e413-486e-9ecb-3f3efeebebb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a19d823375c4ef5a2237179393d3c73, user_id=91b069b5bb3e478dae424a92ec8dda73, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:21.497596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e6d7b-e413-486e-9ecb-3f3efeebebb8 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:21.508711 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 762/1525] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:21 2022] PUT /identity/v3/projects/8a19d823375c4ef5a2237179393d3c73/users/91b069b5bb3e478dae424a92ec8dda73/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:21.519387 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24d4fa-34b6-4daa-bf4a-89cc118f1b8a None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:21.519670 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24d4fa-34b6-4daa-bf4a-89cc118f1b8a None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:21.525056 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24d4fa-34b6-4daa-bf4a-89cc118f1b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:21.547867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:21.548499 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-aa24d4fa-34b6-4daa-bf4a-89cc118f1b8a None None] MFA Rules not processed for user `91b069b5bb3e478dae424a92ec8dda73`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:21.549690 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-aa24d4fa-34b6-4daa-bf4a-89cc118f1b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:21.654439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 764/1526] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:21.674471 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e6d7b-e413-486e-9ecb-3f3efeebebb8 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:21.676531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-b33e6d7b-e413-486e-9ecb-3f3efeebebb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:21.752543 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e6d7b-e413-486e-9ecb-3f3efeebebb8 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:21.756848 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ab0a1-cc53-4b3d-827f-a4020d667235 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:21.757524 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ab0a1-cc53-4b3d-827f-a4020d667235 service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:21.757805 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ab0a1-cc53-4b3d-827f-a4020d667235 service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:21.758079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ab0a1-cc53-4b3d-827f-a4020d667235 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:21.768184 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ab0a1-cc53-4b3d-827f-a4020d667235 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:21.769726 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ab0a1-cc53-4b3d-827f-a4020d667235 service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:21.780673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 763/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:21 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:33:22.081953 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24d4fa-34b6-4daa-bf4a-89cc118f1b8a None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:22.092385 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24d4fa-34b6-4daa-bf4a-89cc118f1b8a None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:22.096272 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b670109-c001-461e-9c77-109850b20988 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:22.096902 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b670109-c001-461e-9c77-109850b20988 service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:22.097180 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b670109-c001-461e-9c77-109850b20988 service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:22.097453 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b670109-c001-461e-9c77-109850b20988 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:22.154271 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b670109-c001-461e-9c77-109850b20988 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:22.155762 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b670109-c001-461e-9c77-109850b20988 service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:22.165152 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 765/1528] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:33:22.813909 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5503c63-7ed7-4d49-b99b-24e88fb299c0 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:22.814476 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5503c63-7ed7-4d49-b99b-24e88fb299c0 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:22.814476 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5503c63-7ed7-4d49-b99b-24e88fb299c0 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:22.816054 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 764/1529] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 19 02:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:33:22.823075 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d1f73-a1df-4a70-969f-57b2ac46eaac None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:22.823691 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d1f73-a1df-4a70-969f-57b2ac46eaac None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:22.823969 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d1f73-a1df-4a70-969f-57b2ac46eaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:22.848099 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-683d1f73-a1df-4a70-969f-57b2ac46eaac None None] MFA Rules not processed for user `58a78f75a63e4d258a4afbeb748e59f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:22.849805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-683d1f73-a1df-4a70-969f-57b2ac46eaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:22.933552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 766/1530] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 19 02:33:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:22.939659 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5503c63-7ed7-4d49-b99b-24e88fb299c0 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:23.068786 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5503c63-7ed7-4d49-b99b-24e88fb299c0 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:23.070843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d1f73-a1df-4a70-969f-57b2ac46eaac None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:23.072424 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-683d1f73-a1df-4a70-969f-57b2ac46eaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:23.073907 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f65713-3c30-4ef7-b2b9-19664687eff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:23.074551 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f65713-3c30-4ef7-b2b9-19664687eff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:23.074852 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f65713-3c30-4ef7-b2b9-19664687eff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:23.075130 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f65713-3c30-4ef7-b2b9-19664687eff0 admin admin] PATH_INFO: `/v3/users/686c15651ee943c6b00517ae115fc0d1` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:23.076330 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f65713-3c30-4ef7-b2b9-19664687eff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=686c15651ee943c6b00517ae115fc0d1)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:23.078319 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f65713-3c30-4ef7-b2b9-19664687eff0 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:23.104446 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d1f73-a1df-4a70-969f-57b2ac46eaac None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:23.121426 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e16f9-5ee5-4f11-895f-906a51b322ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:23.122129 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e16f9-5ee5-4f11-895f-906a51b322ad service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:23.127155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e16f9-5ee5-4f11-895f-906a51b322ad service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:23.127155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e16f9-5ee5-4f11-895f-906a51b322ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:23.133749 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e16f9-5ee5-4f11-895f-906a51b322ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:23.136424 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e16f9-5ee5-4f11-895f-906a51b322ad service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:23.150439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 767/1531] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:33:23.327643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e16f9-5ee5-4f11-895f-906a51b322ad service nova] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:23.329427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-807e16f9-5ee5-4f11-895f-906a51b322ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:23.352787 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e16f9-5ee5-4f11-895f-906a51b322ad service nova] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:23.358448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5339a4-75fa-4540-b8eb-4016119b0a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:23.359112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5339a4-75fa-4540-b8eb-4016119b0a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:23.359430 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5339a4-75fa-4540-b8eb-4016119b0a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:23.359691 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5339a4-75fa-4540-b8eb-4016119b0a2f admin admin] PATH_INFO: `/v3/users/2411959619644c68a5133eb442125ee2` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:23.361075 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5339a4-75fa-4540-b8eb-4016119b0a2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2411959619644c68a5133eb442125ee2)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:23.363113 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5339a4-75fa-4540-b8eb-4016119b0a2f admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:23.399221 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a2f65713-3c30-4ef7-b2b9-19664687eff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '686c15651ee943c6b00517ae115fc0d1'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:23.400541 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a2f65713-3c30-4ef7-b2b9-19664687eff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '686c15651ee943c6b00517ae115fc0d1'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:23.496691 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a2f65713-3c30-4ef7-b2b9-19664687eff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '686c15651ee943c6b00517ae115fc0d1'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:23.514111 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a2f65713-3c30-4ef7-b2b9-19664687eff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '686c15651ee943c6b00517ae115fc0d1'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:23.514111 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a2f65713-3c30-4ef7-b2b9-19664687eff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '686c15651ee943c6b00517ae115fc0d1'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:23.524357 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 765/1532] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:33:22 2022] DELETE /identity/v3/users/686c15651ee943c6b00517ae115fc0d1 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:23.528740 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab64149-e26b-4ae8-a680-1a10375e1880 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:23.529017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab64149-e26b-4ae8-a680-1a10375e1880 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:23.529317 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab64149-e26b-4ae8-a680-1a10375e1880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:23.548390 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-bab64149-e26b-4ae8-a680-1a10375e1880 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:23.552205 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-bab64149-e26b-4ae8-a680-1a10375e1880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:23.602208 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-af5339a4-75fa-4540-b8eb-4016119b0a2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2411959619644c68a5133eb442125ee2'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:23.603138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-af5339a4-75fa-4540-b8eb-4016119b0a2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2411959619644c68a5133eb442125ee2'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:23.623165 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 766/1533] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:33:23.623165 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab64149-e26b-4ae8-a680-1a10375e1880 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:23.623165 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-bab64149-e26b-4ae8-a680-1a10375e1880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:23.677291 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab64149-e26b-4ae8-a680-1a10375e1880 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:23.682035 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb1156-e7aa-4f76-b078-10a8f0118b1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:23.682632 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb1156-e7aa-4f76-b078-10a8f0118b1c service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:23.682939 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb1156-e7aa-4f76-b078-10a8f0118b1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:23.683461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb1156-e7aa-4f76-b078-10a8f0118b1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:23.692445 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb1156-e7aa-4f76-b078-10a8f0118b1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:23.693860 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb1156-e7aa-4f76-b078-10a8f0118b1c service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:23.703563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 767/1534] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:33:23.874710 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-af5339a4-75fa-4540-b8eb-4016119b0a2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2411959619644c68a5133eb442125ee2'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:23.885124 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-af5339a4-75fa-4540-b8eb-4016119b0a2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2411959619644c68a5133eb442125ee2'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:23.886502 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-af5339a4-75fa-4540-b8eb-4016119b0a2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2411959619644c68a5133eb442125ee2'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:23.907780 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 768/1535] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:33:23 2022] DELETE /identity/v3/users/2411959619644c68a5133eb442125ee2 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:33:23.913390 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4c2e8-6d17-481c-8b7f-d81f583851b3 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:23.914351 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4c2e8-6d17-481c-8b7f-d81f583851b3 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:23.914982 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4c2e8-6d17-481c-8b7f-d81f583851b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:23.940122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-7fa4c2e8-6d17-481c-8b7f-d81f583851b3 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:23.941523 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-7fa4c2e8-6d17-481c-8b7f-d81f583851b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:24.012481 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 768/1536] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:24.019118 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5339a4-75fa-4540-b8eb-4016119b0a2f admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:24.020554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-af5339a4-75fa-4540-b8eb-4016119b0a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:24.079822 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5339a4-75fa-4540-b8eb-4016119b0a2f admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:24.083869 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b6f31-0dcf-4f49-8316-064c452e5340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:24.084480 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b6f31-0dcf-4f49-8316-064c452e5340 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:24.084800 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b6f31-0dcf-4f49-8316-064c452e5340 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:24.085157 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b6f31-0dcf-4f49-8316-064c452e5340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:24.094647 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b6f31-0dcf-4f49-8316-064c452e5340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:24.096369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b6f31-0dcf-4f49-8316-064c452e5340 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:24.104243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:24.110350 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 769/1537] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:33:24.182681 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4c2e8-6d17-481c-8b7f-d81f583851b3 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:24.184530 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-7fa4c2e8-6d17-481c-8b7f-d81f583851b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:24.199548 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4c2e8-6d17-481c-8b7f-d81f583851b3 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:24.205233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9116e-23d6-4ed2-af39-5719caabcee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:24.205907 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9116e-23d6-4ed2-af39-5719caabcee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:24.206197 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9116e-23d6-4ed2-af39-5719caabcee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:24.206496 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9116e-23d6-4ed2-af39-5719caabcee6 admin admin] PATH_INFO: `/v3/projects/d8584d25ad7c440194b8fdb575a13898` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:24.207643 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9116e-23d6-4ed2-af39-5719caabcee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8584d25ad7c440194b8fdb575a13898)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:24.210253 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9116e-23d6-4ed2-af39-5719caabcee6 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:24.331581 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d3f9116e-23d6-4ed2-af39-5719caabcee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8584d25ad7c440194b8fdb575a13898', 'request_id': 'req-d3f9116e-23d6-4ed2-af39-5719caabcee6'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:24.340098 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d3f9116e-23d6-4ed2-af39-5719caabcee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8584d25ad7c440194b8fdb575a13898', 'request_id': 'req-d3f9116e-23d6-4ed2-af39-5719caabcee6'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:24.422007 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d3f9116e-23d6-4ed2-af39-5719caabcee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8584d25ad7c440194b8fdb575a13898', 'request_id': 'req-d3f9116e-23d6-4ed2-af39-5719caabcee6'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:24.442239 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d3f9116e-23d6-4ed2-af39-5719caabcee6 admin admin] The token cache is being invalidate because project d8584d25ad7c440194b8fdb575a13898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:33:24.442583 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d3f9116e-23d6-4ed2-af39-5719caabcee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:24.443599 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d3f9116e-23d6-4ed2-af39-5719caabcee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:24.449771 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 769/1538] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:33:24 2022] DELETE /identity/v3/projects/d8584d25ad7c440194b8fdb575a13898 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:33:24.450610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b6f31-0dcf-4f49-8316-064c452e5340 service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:24.461775 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b6f31-0dcf-4f49-8316-064c452e5340 service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:24.536807 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054894de-db7c-4747-990c-84f6663bc844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:24.537553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054894de-db7c-4747-990c-84f6663bc844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:24.538341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054894de-db7c-4747-990c-84f6663bc844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:24.538874 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054894de-db7c-4747-990c-84f6663bc844 admin admin] PATH_INFO: `/v3/users/91b069b5bb3e478dae424a92ec8dda73` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:24.540241 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054894de-db7c-4747-990c-84f6663bc844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91b069b5bb3e478dae424a92ec8dda73)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:24.542606 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054894de-db7c-4747-990c-84f6663bc844 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:24.726341 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9116e-23d6-4ed2-af39-5719caabcee6 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:24.727915 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-d3f9116e-23d6-4ed2-af39-5719caabcee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:24.742009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9116e-23d6-4ed2-af39-5719caabcee6 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:24.747086 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28baf5cc-886e-4195-95d3-d30c65e92ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:24.747798 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28baf5cc-886e-4195-95d3-d30c65e92ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:24.748145 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28baf5cc-886e-4195-95d3-d30c65e92ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:24.748489 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28baf5cc-886e-4195-95d3-d30c65e92ed0 admin admin] PATH_INFO: `/v3/projects/cbc31b5a323b4161b942cc5ca4e5e82e` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:24.749722 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28baf5cc-886e-4195-95d3-d30c65e92ed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc31b5a323b4161b942cc5ca4e5e82e)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:24.751815 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28baf5cc-886e-4195-95d3-d30c65e92ed0 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:24.798089 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-054894de-db7c-4747-990c-84f6663bc844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91b069b5bb3e478dae424a92ec8dda73'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:24.798776 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-054894de-db7c-4747-990c-84f6663bc844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91b069b5bb3e478dae424a92ec8dda73'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:24.889884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-054894de-db7c-4747-990c-84f6663bc844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91b069b5bb3e478dae424a92ec8dda73'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:24.898280 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-054894de-db7c-4747-990c-84f6663bc844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91b069b5bb3e478dae424a92ec8dda73'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:24.898975 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-054894de-db7c-4747-990c-84f6663bc844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91b069b5bb3e478dae424a92ec8dda73'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:24.908826 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-28baf5cc-886e-4195-95d3-d30c65e92ed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc31b5a323b4161b942cc5ca4e5e82e', 'request_id': 'req-28baf5cc-886e-4195-95d3-d30c65e92ed0'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:24.915085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-28baf5cc-886e-4195-95d3-d30c65e92ed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc31b5a323b4161b942cc5ca4e5e82e', 'request_id': 'req-28baf5cc-886e-4195-95d3-d30c65e92ed0'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:24.917829 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 770/1539] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:33:24 2022] DELETE /identity/v3/users/91b069b5bb3e478dae424a92ec8dda73 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:33:25.009834 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-28baf5cc-886e-4195-95d3-d30c65e92ed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc31b5a323b4161b942cc5ca4e5e82e', 'request_id': 'req-28baf5cc-886e-4195-95d3-d30c65e92ed0'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:25.022897 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-28baf5cc-886e-4195-95d3-d30c65e92ed0 admin admin] The token cache is being invalidate because project cbc31b5a323b4161b942cc5ca4e5e82e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:33:25.023164 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-28baf5cc-886e-4195-95d3-d30c65e92ed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:25.023810 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-28baf5cc-886e-4195-95d3-d30c65e92ed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:25.025617 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 770/1540] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:33:24 2022] DELETE /identity/v3/projects/cbc31b5a323b4161b942cc5ca4e5e82e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:33:25.029715 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054894de-db7c-4747-990c-84f6663bc844 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:25.031272 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-054894de-db7c-4747-990c-84f6663bc844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:25.060638 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:25.090984 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:25.098601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054894de-db7c-4747-990c-84f6663bc844 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:25.104116 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839545d9-427c-4f1d-bc00-8656a8569411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:25.104764 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839545d9-427c-4f1d-bc00-8656a8569411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:25.105046 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839545d9-427c-4f1d-bc00-8656a8569411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:25.105318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839545d9-427c-4f1d-bc00-8656a8569411 admin admin] PATH_INFO: `/v3/users/15eebb6b11f042db977d71c9bdc70889` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:25.106570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839545d9-427c-4f1d-bc00-8656a8569411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15eebb6b11f042db977d71c9bdc70889)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:25.108633 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839545d9-427c-4f1d-bc00-8656a8569411 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:25.350553 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28baf5cc-886e-4195-95d3-d30c65e92ed0 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:25.352334 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-28baf5cc-886e-4195-95d3-d30c65e92ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:25.366985 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-839545d9-427c-4f1d-bc00-8656a8569411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15eebb6b11f042db977d71c9bdc70889'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:25.368962 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-839545d9-427c-4f1d-bc00-8656a8569411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15eebb6b11f042db977d71c9bdc70889'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:25.472259 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28baf5cc-886e-4195-95d3-d30c65e92ed0 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:25.473171 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-839545d9-427c-4f1d-bc00-8656a8569411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15eebb6b11f042db977d71c9bdc70889'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:25.478166 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9fbc0-222b-4527-9e33-361d694ecd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:25.480021 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9fbc0-222b-4527-9e33-361d694ecd98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:25.480021 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9fbc0-222b-4527-9e33-361d694ecd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:25.480021 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9fbc0-222b-4527-9e33-361d694ecd98 admin admin] PATH_INFO: `/v3/projects/8a19d823375c4ef5a2237179393d3c73` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:25.481015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9fbc0-222b-4527-9e33-361d694ecd98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a19d823375c4ef5a2237179393d3c73)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:25.482960 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9fbc0-222b-4527-9e33-361d694ecd98 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:25.484761 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-839545d9-427c-4f1d-bc00-8656a8569411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15eebb6b11f042db977d71c9bdc70889'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:25.485674 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-839545d9-427c-4f1d-bc00-8656a8569411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15eebb6b11f042db977d71c9bdc70889'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:25.506970 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 771/1541] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:33:25 2022] DELETE /identity/v3/users/15eebb6b11f042db977d71c9bdc70889 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:25.624833 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-63e9fbc0-222b-4527-9e33-361d694ecd98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a19d823375c4ef5a2237179393d3c73', 'request_id': 'req-63e9fbc0-222b-4527-9e33-361d694ecd98'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:25.630301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-63e9fbc0-222b-4527-9e33-361d694ecd98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a19d823375c4ef5a2237179393d3c73', 'request_id': 'req-63e9fbc0-222b-4527-9e33-361d694ecd98'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:25.742767 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-63e9fbc0-222b-4527-9e33-361d694ecd98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a19d823375c4ef5a2237179393d3c73', 'request_id': 'req-63e9fbc0-222b-4527-9e33-361d694ecd98'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:25.756453 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-63e9fbc0-222b-4527-9e33-361d694ecd98 admin admin] The token cache is being invalidate because project 8a19d823375c4ef5a2237179393d3c73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:33:25.757472 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-63e9fbc0-222b-4527-9e33-361d694ecd98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:25.758448 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-63e9fbc0-222b-4527-9e33-361d694ecd98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:25.764781 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 771/1542] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:33:25 2022] DELETE /identity/v3/projects/8a19d823375c4ef5a2237179393d3c73 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:33:25.766446 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4568adf-c00a-4f39-9ddd-a3e328a197cb None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:25.766734 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4568adf-c00a-4f39-9ddd-a3e328a197cb None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:25.767111 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4568adf-c00a-4f39-9ddd-a3e328a197cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:25.794382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-c4568adf-c00a-4f39-9ddd-a3e328a197cb None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:25.796007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c4568adf-c00a-4f39-9ddd-a3e328a197cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:25.913138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 772/1543] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:25.915581 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2f24e-5479-48a2-aef1-ef1363694a5d None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:25.926063 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2f24e-5479-48a2-aef1-ef1363694a5d None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:25.926063 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2f24e-5479-48a2-aef1-ef1363694a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:25.945033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-1be2f24e-5479-48a2-aef1-ef1363694a5d None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:25.951102 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-1be2f24e-5479-48a2-aef1-ef1363694a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:25.975832 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 772/1544] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:33:25.980275 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4568adf-c00a-4f39-9ddd-a3e328a197cb None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:25.994654 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4568adf-c00a-4f39-9ddd-a3e328a197cb None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:26.000516 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36aa72-7a14-44e0-baa0-df6bac3e8de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:26.001286 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36aa72-7a14-44e0-baa0-df6bac3e8de0 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:26.001561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36aa72-7a14-44e0-baa0-df6bac3e8de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:26.002041 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36aa72-7a14-44e0-baa0-df6bac3e8de0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:26.002858 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36aa72-7a14-44e0-baa0-df6bac3e8de0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:33:26.003303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36aa72-7a14-44e0-baa0-df6bac3e8de0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:26.015829 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36aa72-7a14-44e0-baa0-df6bac3e8de0 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:26.042501 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 773/1545] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:33:26.048973 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2f24e-5479-48a2-aef1-ef1363694a5d None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:26.059684 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2f24e-5479-48a2-aef1-ef1363694a5d None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:26.064510 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff063a-c279-4743-a772-08b9adfff606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:26.065111 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff063a-c279-4743-a772-08b9adfff606 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:26.065389 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff063a-c279-4743-a772-08b9adfff606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:26.065663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff063a-c279-4743-a772-08b9adfff606 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:26.066328 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff063a-c279-4743-a772-08b9adfff606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:26.068250 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff063a-c279-4743-a772-08b9adfff606 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:26.089156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36aa72-7a14-44e0-baa0-df6bac3e8de0 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:26.091007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-2b36aa72-7a14-44e0-baa0-df6bac3e8de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:26.109090 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36aa72-7a14-44e0-baa0-df6bac3e8de0 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:26.121017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8242e-61fb-41c4-980e-1671c7404db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:26.121017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8242e-61fb-41c4-980e-1671c7404db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:26.121017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8242e-61fb-41c4-980e-1671c7404db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:26.121017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8242e-61fb-41c4-980e-1671c7404db0 admin admin] PATH_INFO: `/v3/projects/69b75cd212164d468be27ff633d7a38a` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:26.121633 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8242e-61fb-41c4-980e-1671c7404db0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69b75cd212164d468be27ff633d7a38a)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:26.121633 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8242e-61fb-41c4-980e-1671c7404db0 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:26.194897 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 773/1546] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:33:26 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:26.199017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff063a-c279-4743-a772-08b9adfff606 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:26.261693 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff063a-c279-4743-a772-08b9adfff606 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:26.267221 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f14f6d-ce8d-4e92-84b3-88b5b3919245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:26.267837 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f14f6d-ce8d-4e92-84b3-88b5b3919245 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:26.268118 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f14f6d-ce8d-4e92-84b3-88b5b3919245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:26.268396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f14f6d-ce8d-4e92-84b3-88b5b3919245 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:26.269036 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f14f6d-ce8d-4e92-84b3-88b5b3919245 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:26.271108 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f14f6d-ce8d-4e92-84b3-88b5b3919245 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:26.280490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-52c8242e-61fb-41c4-980e-1671c7404db0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b75cd212164d468be27ff633d7a38a', 'request_id': 'req-52c8242e-61fb-41c4-980e-1671c7404db0'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:26.285900 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-52c8242e-61fb-41c4-980e-1671c7404db0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b75cd212164d468be27ff633d7a38a', 'request_id': 'req-52c8242e-61fb-41c4-980e-1671c7404db0'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:26.293946 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-52c8242e-61fb-41c4-980e-1671c7404db0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b75cd212164d468be27ff633d7a38a', 'request_id': 'req-52c8242e-61fb-41c4-980e-1671c7404db0'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:26.415239 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-52c8242e-61fb-41c4-980e-1671c7404db0 admin admin] The token cache is being invalidate because project 69b75cd212164d468be27ff633d7a38a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:33:26.415239 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-52c8242e-61fb-41c4-980e-1671c7404db0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:26.415239 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-52c8242e-61fb-41c4-980e-1671c7404db0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:26.416695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 774/1547] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:33:26 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:33:26.416769 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 774/1548] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:33:26 2022] DELETE /identity/v3/projects/69b75cd212164d468be27ff633d7a38a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:26.421882 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f14f6d-ce8d-4e92-84b3-88b5b3919245 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:26.422351 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded1b2f-7dd0-4800-a50f-226977748107 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:26.422844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded1b2f-7dd0-4800-a50f-226977748107 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:26.423306 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded1b2f-7dd0-4800-a50f-226977748107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:26.423702 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-a8f14f6d-ce8d-4e92-84b3-88b5b3919245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:26.437145 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f14f6d-ce8d-4e92-84b3-88b5b3919245 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:26.448720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-8ded1b2f-7dd0-4800-a50f-226977748107 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:26.450174 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-8ded1b2f-7dd0-4800-a50f-226977748107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:26.511749 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a7328-ac55-4ec5-82aa-e654e6da3fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:26.512355 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a7328-ac55-4ec5-82aa-e654e6da3fdb admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:26.512636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a7328-ac55-4ec5-82aa-e654e6da3fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:26.512930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a7328-ac55-4ec5-82aa-e654e6da3fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:26.513597 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a7328-ac55-4ec5-82aa-e654e6da3fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:26.515245 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a7328-ac55-4ec5-82aa-e654e6da3fdb admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:26.527255 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 775/1549] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:26.531494 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a7328-ac55-4ec5-82aa-e654e6da3fdb admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:26.545201 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a7328-ac55-4ec5-82aa-e654e6da3fdb admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:26.545314 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 775/1550] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:26.550674 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2871ee-e154-4a84-9151-33c488fc028a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:26.551608 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2871ee-e154-4a84-9151-33c488fc028a admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:26.551737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2871ee-e154-4a84-9151-33c488fc028a admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:26.551981 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2871ee-e154-4a84-9151-33c488fc028a admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:26.552993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2871ee-e154-4a84-9151-33c488fc028a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:26.554609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac8470-b105-45b2-920c-9b3d5fb7edf3 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:26.554721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2871ee-e154-4a84-9151-33c488fc028a admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:26.554955 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac8470-b105-45b2-920c-9b3d5fb7edf3 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:26.555594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac8470-b105-45b2-920c-9b3d5fb7edf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:26.571005 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 776/1551] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:26.574076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2871ee-e154-4a84-9151-33c488fc028a admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:26.580867 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-caac8470-b105-45b2-920c-9b3d5fb7edf3 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:26.580867 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-caac8470-b105-45b2-920c-9b3d5fb7edf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:26.585585 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2871ee-e154-4a84-9151-33c488fc028a admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:26.590344 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76884c46-09bc-4a40-bf8c-59501413317a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:26.591097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76884c46-09bc-4a40-bf8c-59501413317a admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:26.591393 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76884c46-09bc-4a40-bf8c-59501413317a admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:26.591719 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 776/1552] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:33:26.594729 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76884c46-09bc-4a40-bf8c-59501413317a admin admin] PATH_INFO: `/v3/projects/4feaa83c0f6d4a4093b3bc406ede4ac6/users/75e708b2d4c243b9a60b9566688895a5/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:26.595807 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac8470-b105-45b2-920c-9b3d5fb7edf3 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:26.606137 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac8470-b105-45b2-920c-9b3d5fb7edf3 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:26.611727 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c33d0e-4a59-4693-8fed-80825694fdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:26.611864 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76884c46-09bc-4a40-bf8c-59501413317a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4feaa83c0f6d4a4093b3bc406ede4ac6, user_id=75e708b2d4c243b9a60b9566688895a5, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:26.612413 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c33d0e-4a59-4693-8fed-80825694fdf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:26.612602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c33d0e-4a59-4693-8fed-80825694fdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:26.612894 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c33d0e-4a59-4693-8fed-80825694fdf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:26.613560 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c33d0e-4a59-4693-8fed-80825694fdf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:33:26.613804 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c33d0e-4a59-4693-8fed-80825694fdf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:26.615151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76884c46-09bc-4a40-bf8c-59501413317a admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:26.615707 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c33d0e-4a59-4693-8fed-80825694fdf6 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:26.627976 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 777/1553] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:33:26.632722 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c33d0e-4a59-4693-8fed-80825694fdf6 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:26.649492 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c33d0e-4a59-4693-8fed-80825694fdf6 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:26.650074 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf1b68-b801-4cdf-898d-fb8714be262b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:26.650683 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf1b68-b801-4cdf-898d-fb8714be262b admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:26.651033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf1b68-b801-4cdf-898d-fb8714be262b admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:26.651322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf1b68-b801-4cdf-898d-fb8714be262b admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:26.651953 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf1b68-b801-4cdf-898d-fb8714be262b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:26.653871 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf1b68-b801-4cdf-898d-fb8714be262b admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:26.774192 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:26.780043 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 778/1554] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:33:26 2022] POST /identity/v3/projects => generated 399 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:26.780201 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 777/1555] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:26 2022] PUT /identity/v3/projects/4feaa83c0f6d4a4093b3bc406ede4ac6/users/75e708b2d4c243b9a60b9566688895a5/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:26.784331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf1b68-b801-4cdf-898d-fb8714be262b admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:26.793811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81389c2f-c892-442d-aee9-00ffa34db160 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:26.794111 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81389c2f-c892-442d-aee9-00ffa34db160 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:26.794661 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81389c2f-c892-442d-aee9-00ffa34db160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:26.831141 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-81389c2f-c892-442d-aee9-00ffa34db160 None None] MFA Rules not processed for user `75e708b2d4c243b9a60b9566688895a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:26.832501 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-81389c2f-c892-442d-aee9-00ffa34db160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:26.880701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf1b68-b801-4cdf-898d-fb8714be262b admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:26.887464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3004444-87d4-4f2c-bcf9-6d64f7a228dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:26.888185 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3004444-87d4-4f2c-bcf9-6d64f7a228dd admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:26.888553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3004444-87d4-4f2c-bcf9-6d64f7a228dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:26.888844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3004444-87d4-4f2c-bcf9-6d64f7a228dd admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:26.889494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3004444-87d4-4f2c-bcf9-6d64f7a228dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:26.891645 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3004444-87d4-4f2c-bcf9-6d64f7a228dd admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:26.918480 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 778/1556] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:33:26.930460 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81389c2f-c892-442d-aee9-00ffa34db160 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:26.931854 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-81389c2f-c892-442d-aee9-00ffa34db160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:26.989043 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81389c2f-c892-442d-aee9-00ffa34db160 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:26.993476 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc9fe6-2aa7-44b6-b86e-86e82986d859 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:26.994083 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc9fe6-2aa7-44b6-b86e-86e82986d859 service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:26.994360 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc9fe6-2aa7-44b6-b86e-86e82986d859 service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:26.994628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc9fe6-2aa7-44b6-b86e-86e82986d859 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:27.008704 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc9fe6-2aa7-44b6-b86e-86e82986d859 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:27.008935 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 779/1557] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:33:26 2022] POST /identity/v3/users => generated 300 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:27.009922 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3004444-87d4-4f2c-bcf9-6d64f7a228dd admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:27.010034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc9fe6-2aa7-44b6-b86e-86e82986d859 service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:27.019970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 779/1558] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:33:27.022467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3004444-87d4-4f2c-bcf9-6d64f7a228dd admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:27.027544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95429ad-7b0c-483d-ae2c-e0d18d746ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:27.028167 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95429ad-7b0c-483d-ae2c-e0d18d746ebf admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:27.028414 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95429ad-7b0c-483d-ae2c-e0d18d746ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:27.028684 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95429ad-7b0c-483d-ae2c-e0d18d746ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:27.029517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95429ad-7b0c-483d-ae2c-e0d18d746ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:27.031220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95429ad-7b0c-483d-ae2c-e0d18d746ebf admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:27.046269 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 780/1559] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:27.047955 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc9fe6-2aa7-44b6-b86e-86e82986d859 service cinder] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:27.059050 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95429ad-7b0c-483d-ae2c-e0d18d746ebf admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:27.070926 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc9fe6-2aa7-44b6-b86e-86e82986d859 service cinder] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:27.071395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95429ad-7b0c-483d-ae2c-e0d18d746ebf admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:27.076932 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb1b4c-fdc1-483e-bc50-699bedce662b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:27.077545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb1b4c-fdc1-483e-bc50-699bedce662b admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:27.077879 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb1b4c-fdc1-483e-bc50-699bedce662b admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:27.078158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb1b4c-fdc1-483e-bc50-699bedce662b admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:27.078810 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb1b4c-fdc1-483e-bc50-699bedce662b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:27.080624 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb1b4c-fdc1-483e-bc50-699bedce662b admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:27.103581 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9c828-64b6-45b7-9ff2-c0d76e9932d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:27.103581 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9c828-64b6-45b7-9ff2-c0d76e9932d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:27.103581 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9c828-64b6-45b7-9ff2-c0d76e9932d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:27.103581 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9c828-64b6-45b7-9ff2-c0d76e9932d1 admin admin] PATH_INFO: `/v3/users/75e708b2d4c243b9a60b9566688895a5` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:27.103918 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 780/1560] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:27.103988 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9c828-64b6-45b7-9ff2-c0d76e9932d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75e708b2d4c243b9a60b9566688895a5)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:27.104052 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb1b4c-fdc1-483e-bc50-699bedce662b admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:27.104152 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9c828-64b6-45b7-9ff2-c0d76e9932d1 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:27.115175 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb1b4c-fdc1-483e-bc50-699bedce662b admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:27.120043 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69364563-1c51-43a3-86e4-e2e1bd957a48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:27.120828 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69364563-1c51-43a3-86e4-e2e1bd957a48 service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:27.121226 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69364563-1c51-43a3-86e4-e2e1bd957a48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:27.121750 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69364563-1c51-43a3-86e4-e2e1bd957a48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:27.123911 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-69364563-1c51-43a3-86e4-e2e1bd957a48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:27.197042 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69364563-1c51-43a3-86e4-e2e1bd957a48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:27.198486 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69364563-1c51-43a3-86e4-e2e1bd957a48 service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:27.219351 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 781/1561] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:33:27.220742 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69364563-1c51-43a3-86e4-e2e1bd957a48 service cinder] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:27.233982 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69364563-1c51-43a3-86e4-e2e1bd957a48 service cinder] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:27.239893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e03c79-fb32-48ef-91be-cd442ca826ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:27.240566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e03c79-fb32-48ef-91be-cd442ca826ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:27.240756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e03c79-fb32-48ef-91be-cd442ca826ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:27.240998 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e03c79-fb32-48ef-91be-cd442ca826ee admin admin] PATH_INFO: `/v3/projects/0b69107002ab4239bf25be7de374d26d/users/326a2eabb8f74aa79dc79feca17e5bcb/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:27.257477 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e03c79-fb32-48ef-91be-cd442ca826ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b69107002ab4239bf25be7de374d26d, user_id=326a2eabb8f74aa79dc79feca17e5bcb, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:27.260353 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e03c79-fb32-48ef-91be-cd442ca826ee admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:27.290999 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-7bd9c828-64b6-45b7-9ff2-c0d76e9932d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75e708b2d4c243b9a60b9566688895a5'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:27.292285 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-7bd9c828-64b6-45b7-9ff2-c0d76e9932d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75e708b2d4c243b9a60b9566688895a5'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:27.365293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 782/1562] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:27 2022] PUT /identity/v3/projects/0b69107002ab4239bf25be7de374d26d/users/326a2eabb8f74aa79dc79feca17e5bcb/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:27.372152 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-7bd9c828-64b6-45b7-9ff2-c0d76e9932d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75e708b2d4c243b9a60b9566688895a5'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:27.381173 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f28dfb-8dd6-48e5-b0fc-82392c80a33f None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:27.382159 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f28dfb-8dd6-48e5-b0fc-82392c80a33f None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:27.382436 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f28dfb-8dd6-48e5-b0fc-82392c80a33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:27.383803 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-7bd9c828-64b6-45b7-9ff2-c0d76e9932d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75e708b2d4c243b9a60b9566688895a5'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:27.384675 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-7bd9c828-64b6-45b7-9ff2-c0d76e9932d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75e708b2d4c243b9a60b9566688895a5'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:27.406310 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 781/1563] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:33:27 2022] DELETE /identity/v3/users/75e708b2d4c243b9a60b9566688895a5 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:33:27.411068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e4a07-5cc9-4dc8-bd9a-cf9729880f05 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:27.411570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e4a07-5cc9-4dc8-bd9a-cf9729880f05 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:27.411882 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e4a07-5cc9-4dc8-bd9a-cf9729880f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:27.414602 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-50f28dfb-8dd6-48e5-b0fc-82392c80a33f None None] MFA Rules not processed for user `326a2eabb8f74aa79dc79feca17e5bcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:27.416356 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-50f28dfb-8dd6-48e5-b0fc-82392c80a33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:27.434868 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-877e4a07-5cc9-4dc8-bd9a-cf9729880f05 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:27.435753 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-877e4a07-5cc9-4dc8-bd9a-cf9729880f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:27.451399 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:27.503856 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 783/1564] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:27 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:27.508926 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f28dfb-8dd6-48e5-b0fc-82392c80a33f None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:27.511845 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 782/1565] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:27.514728 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-50f28dfb-8dd6-48e5-b0fc-82392c80a33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:27.526038 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e4a07-5cc9-4dc8-bd9a-cf9729880f05 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:27.529736 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-877e4a07-5cc9-4dc8-bd9a-cf9729880f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:27.541259 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f28dfb-8dd6-48e5-b0fc-82392c80a33f None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:27.549153 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318dee3-3efc-4a6b-b04c-a846b91a477b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:27.549153 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318dee3-3efc-4a6b-b04c-a846b91a477b admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:27.549153 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318dee3-3efc-4a6b-b04c-a846b91a477b admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:27.549153 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318dee3-3efc-4a6b-b04c-a846b91a477b admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:27.549508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318dee3-3efc-4a6b-b04c-a846b91a477b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:27.551846 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318dee3-3efc-4a6b-b04c-a846b91a477b admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:27.596904 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e4a07-5cc9-4dc8-bd9a-cf9729880f05 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:27.601154 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743f96f-7abb-41f9-818b-3b46a2a6ed82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:27.601737 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743f96f-7abb-41f9-818b-3b46a2a6ed82 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:27.602013 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743f96f-7abb-41f9-818b-3b46a2a6ed82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:27.602352 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743f96f-7abb-41f9-818b-3b46a2a6ed82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:27.612144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743f96f-7abb-41f9-818b-3b46a2a6ed82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:27.613601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743f96f-7abb-41f9-818b-3b46a2a6ed82 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:27.623932 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 783/1566] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:33:27.660787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 784/1567] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:33:27 2022] POST /identity/v3/projects => generated 401 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:33:27.661972 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743f96f-7abb-41f9-818b-3b46a2a6ed82 service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:27.671938 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743f96f-7abb-41f9-818b-3b46a2a6ed82 service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:27.738178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6038311-5515-4967-b39a-230e39ec91c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:27.738842 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6038311-5515-4967-b39a-230e39ec91c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:27.739122 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6038311-5515-4967-b39a-230e39ec91c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:27.739434 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6038311-5515-4967-b39a-230e39ec91c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:27.740136 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6038311-5515-4967-b39a-230e39ec91c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:27.742602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6038311-5515-4967-b39a-230e39ec91c4 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:27.825270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 784/1568] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:33:27 2022] POST /identity/v3/users => generated 307 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:27.826600 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318dee3-3efc-4a6b-b04c-a846b91a477b admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:27.838757 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318dee3-3efc-4a6b-b04c-a846b91a477b admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:27.843900 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e81ae0-2119-43e8-a560-263bb7311315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:27.844254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e81ae0-2119-43e8-a560-263bb7311315 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:27.844679 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e81ae0-2119-43e8-a560-263bb7311315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:27.844963 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e81ae0-2119-43e8-a560-263bb7311315 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:27.845764 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e81ae0-2119-43e8-a560-263bb7311315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:27.847666 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e81ae0-2119-43e8-a560-263bb7311315 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:27.862725 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 785/1569] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:27.863550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6038311-5515-4967-b39a-230e39ec91c4 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:27.875859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6038311-5515-4967-b39a-230e39ec91c4 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:27.899622 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c8de8-0949-484f-ba75-4f69bcab7b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:27.900354 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c8de8-0949-484f-ba75-4f69bcab7b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:27.900635 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c8de8-0949-484f-ba75-4f69bcab7b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:27.900911 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c8de8-0949-484f-ba75-4f69bcab7b04 admin admin] PATH_INFO: `/v3/projects/deff5351b8c2423789bc928b25df2865/users/acbd802ea3d34a2fa19d0e3b456a8afd/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:27.921453 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c8de8-0949-484f-ba75-4f69bcab7b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deff5351b8c2423789bc928b25df2865, user_id=acbd802ea3d34a2fa19d0e3b456a8afd, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:27.928628 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c8de8-0949-484f-ba75-4f69bcab7b04 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:28.026875 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 785/1570] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:27 2022] PUT /identity/v3/projects/deff5351b8c2423789bc928b25df2865/users/acbd802ea3d34a2fa19d0e3b456a8afd/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:33:28.030208 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e81ae0-2119-43e8-a560-263bb7311315 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:28.042096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e81ae0-2119-43e8-a560-263bb7311315 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:28.112088 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6fafae-5959-4b19-960d-e81127b04151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:28.112719 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fafae-5959-4b19-960d-e81127b04151 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:28.112998 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fafae-5959-4b19-960d-e81127b04151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:28.113271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fafae-5959-4b19-960d-e81127b04151 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:28.114370 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6fafae-5959-4b19-960d-e81127b04151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:28.116683 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6fafae-5959-4b19-960d-e81127b04151 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:28.129129 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c8de8-0949-484f-ba75-4f69bcab7b04 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:28.130991 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 786/1571] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:28.134452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6fafae-5959-4b19-960d-e81127b04151 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:28.134727 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-b82c8de8-0949-484f-ba75-4f69bcab7b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:28.150157 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c8de8-0949-484f-ba75-4f69bcab7b04 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:28.153777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6fafae-5959-4b19-960d-e81127b04151 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:28.155937 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d25e4-75f7-422f-9813-791f06040491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:28.156598 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d25e4-75f7-422f-9813-791f06040491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:28.156924 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d25e4-75f7-422f-9813-791f06040491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:28.157200 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d25e4-75f7-422f-9813-791f06040491 admin admin] PATH_INFO: `/v3/projects/4feaa83c0f6d4a4093b3bc406ede4ac6` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:28.158381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d25e4-75f7-422f-9813-791f06040491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4feaa83c0f6d4a4093b3bc406ede4ac6)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:28.160473 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d25e4-75f7-422f-9813-791f06040491 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:28.160866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdfe6e8-2457-487d-a153-7aee806b8f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:28.161553 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfe6e8-2457-487d-a153-7aee806b8f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:28.161838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfe6e8-2457-487d-a153-7aee806b8f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:28.162119 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfe6e8-2457-487d-a153-7aee806b8f6b admin admin] PATH_INFO: `/v3/projects/deff5351b8c2423789bc928b25df2865/users/acbd802ea3d34a2fa19d0e3b456a8afd/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:28.165032 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdfe6e8-2457-487d-a153-7aee806b8f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=deff5351b8c2423789bc928b25df2865, user_id=acbd802ea3d34a2fa19d0e3b456a8afd, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:28.168118 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdfe6e8-2457-487d-a153-7aee806b8f6b admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:28.180861 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 787/1572] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:28 2022] PUT /identity/v3/projects/deff5351b8c2423789bc928b25df2865/users/acbd802ea3d34a2fa19d0e3b456a8afd/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:28.191712 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e94e53-6eb7-4a0e-877f-ad7de8557f3b None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:28.192227 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e94e53-6eb7-4a0e-877f-ad7de8557f3b None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:28.192718 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e94e53-6eb7-4a0e-877f-ad7de8557f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:28.227842 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-b4e94e53-6eb7-4a0e-877f-ad7de8557f3b None None] MFA Rules not processed for user `acbd802ea3d34a2fa19d0e3b456a8afd`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:28.229365 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-b4e94e53-6eb7-4a0e-877f-ad7de8557f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:28.297435 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b99d25e4-75f7-422f-9813-791f06040491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4feaa83c0f6d4a4093b3bc406ede4ac6', 'request_id': 'req-b99d25e4-75f7-422f-9813-791f06040491'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:28.304605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b99d25e4-75f7-422f-9813-791f06040491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4feaa83c0f6d4a4093b3bc406ede4ac6', 'request_id': 'req-b99d25e4-75f7-422f-9813-791f06040491'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:28.312150 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b99d25e4-75f7-422f-9813-791f06040491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4feaa83c0f6d4a4093b3bc406ede4ac6', 'request_id': 'req-b99d25e4-75f7-422f-9813-791f06040491'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:28.314638 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 788/1573] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:28 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:28.326714 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e94e53-6eb7-4a0e-877f-ad7de8557f3b None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:28.328231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-b4e94e53-6eb7-4a0e-877f-ad7de8557f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:28.366153 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b99d25e4-75f7-422f-9813-791f06040491 admin admin] The token cache is being invalidate because project 4feaa83c0f6d4a4093b3bc406ede4ac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:33:28.366443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b99d25e4-75f7-422f-9813-791f06040491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:28.367156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b99d25e4-75f7-422f-9813-791f06040491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:28.369142 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 786/1574] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:33:28 2022] DELETE /identity/v3/projects/4feaa83c0f6d4a4093b3bc406ede4ac6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:33:28.372337 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:28.375991 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e24088-a6e9-4e6a-ab30-bc821b03cc69 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:28.376544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e24088-a6e9-4e6a-ab30-bc821b03cc69 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:28.377066 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e24088-a6e9-4e6a-ab30-bc821b03cc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:28.402081 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-75e24088-a6e9-4e6a-ab30-bc821b03cc69 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:28.402266 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e94e53-6eb7-4a0e-877f-ad7de8557f3b None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:28.403293 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-75e24088-a6e9-4e6a-ab30-bc821b03cc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:28.463682 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97b5e6-46ae-459f-8a50-38caa3d56974 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:28.464595 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97b5e6-46ae-459f-8a50-38caa3d56974 service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:28.465018 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97b5e6-46ae-459f-8a50-38caa3d56974 service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:28.465434 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97b5e6-46ae-459f-8a50-38caa3d56974 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:28.467777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-1a97b5e6-46ae-459f-8a50-38caa3d56974 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:28.478600 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 787/1575] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:28.488302 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc271466-862e-4d5c-bb06-419a072d406b None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:28.488944 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc271466-862e-4d5c-bb06-419a072d406b None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:28.488944 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc271466-862e-4d5c-bb06-419a072d406b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:28.514464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-cc271466-862e-4d5c-bb06-419a072d406b None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:28.515792 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-cc271466-862e-4d5c-bb06-419a072d406b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:28.525749 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 788/1576] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:28.530089 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc271466-862e-4d5c-bb06-419a072d406b None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:28.543770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc271466-862e-4d5c-bb06-419a072d406b None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:28.549096 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d0ea2-9b7c-4dfd-83b6-536cf25eb65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:28.549809 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d0ea2-9b7c-4dfd-83b6-536cf25eb65b admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:28.550118 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d0ea2-9b7c-4dfd-83b6-536cf25eb65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:28.550398 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d0ea2-9b7c-4dfd-83b6-536cf25eb65b admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:28.551130 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d0ea2-9b7c-4dfd-83b6-536cf25eb65b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:33:28.551439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d0ea2-9b7c-4dfd-83b6-536cf25eb65b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:28.553753 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d0ea2-9b7c-4dfd-83b6-536cf25eb65b admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:28.567300 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97b5e6-46ae-459f-8a50-38caa3d56974 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:28.568829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97b5e6-46ae-459f-8a50-38caa3d56974 service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:28.574550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 789/1577] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:33:28.578695 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d0ea2-9b7c-4dfd-83b6-536cf25eb65b admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:28.585577 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 789/1578] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:28 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:33:28.600538 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d0ea2-9b7c-4dfd-83b6-536cf25eb65b admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:28.617377 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302510ba-344b-4902-84eb-1a9d175e58a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:28.618013 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302510ba-344b-4902-84eb-1a9d175e58a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:28.618364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302510ba-344b-4902-84eb-1a9d175e58a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:28.618790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302510ba-344b-4902-84eb-1a9d175e58a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:28.619486 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302510ba-344b-4902-84eb-1a9d175e58a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:28.621779 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302510ba-344b-4902-84eb-1a9d175e58a7 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:28.747859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:28.775665 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97b5e6-46ae-459f-8a50-38caa3d56974 service cinder] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:28.784057 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 790/1579] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:33:28 2022] POST /identity/v3/projects => generated 375 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:33:28.789535 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97b5e6-46ae-459f-8a50-38caa3d56974 service cinder] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:28.859483 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0121e-344c-41fa-b5f0-751d7c2fc88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:28.860180 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0121e-344c-41fa-b5f0-751d7c2fc88e admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:28.860461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0121e-344c-41fa-b5f0-751d7c2fc88e admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:28.860736 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0121e-344c-41fa-b5f0-751d7c2fc88e admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:28.861436 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0121e-344c-41fa-b5f0-751d7c2fc88e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:28.863536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0121e-344c-41fa-b5f0-751d7c2fc88e admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:28.901859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302510ba-344b-4902-84eb-1a9d175e58a7 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:28.904947 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-302510ba-344b-4902-84eb-1a9d175e58a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:28.963149 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302510ba-344b-4902-84eb-1a9d175e58a7 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:28.967281 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4152f8-7ea6-45ca-a553-8a07cc63a42b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:28.967982 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4152f8-7ea6-45ca-a553-8a07cc63a42b service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:28.968249 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4152f8-7ea6-45ca-a553-8a07cc63a42b service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:28.968519 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4152f8-7ea6-45ca-a553-8a07cc63a42b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:28.970408 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-9b4152f8-7ea6-45ca-a553-8a07cc63a42b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:29.009198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:29.015490 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 790/1580] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:33:28 2022] POST /identity/v3/users => generated 288 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:29.018291 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0121e-344c-41fa-b5f0-751d7c2fc88e admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:29.033901 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0121e-344c-41fa-b5f0-751d7c2fc88e admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:29.043502 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fa3b3-adf6-4b2c-b13b-90ab668d53f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:29.045201 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fa3b3-adf6-4b2c-b13b-90ab668d53f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:29.045675 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fa3b3-adf6-4b2c-b13b-90ab668d53f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:29.046624 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fa3b3-adf6-4b2c-b13b-90ab668d53f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:29.047478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fa3b3-adf6-4b2c-b13b-90ab668d53f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:29.054904 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fa3b3-adf6-4b2c-b13b-90ab668d53f2 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:29.074553 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 791/1581] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:33:29.079957 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fa3b3-adf6-4b2c-b13b-90ab668d53f2 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:29.082739 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4152f8-7ea6-45ca-a553-8a07cc63a42b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:29.086539 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4152f8-7ea6-45ca-a553-8a07cc63a42b service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:29.098478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fa3b3-adf6-4b2c-b13b-90ab668d53f2 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:29.105450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa86d0e-ddaf-424f-8c2c-4de1436f5842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:29.106545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa86d0e-ddaf-424f-8c2c-4de1436f5842 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:29.106996 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa86d0e-ddaf-424f-8c2c-4de1436f5842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:29.107459 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa86d0e-ddaf-424f-8c2c-4de1436f5842 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:29.109969 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa86d0e-ddaf-424f-8c2c-4de1436f5842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:29.112079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa86d0e-ddaf-424f-8c2c-4de1436f5842 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:29.126498 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 791/1582] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:28 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:33:29.131361 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 792/1583] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:29.138362 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4152f8-7ea6-45ca-a553-8a07cc63a42b service cinder] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:29.163148 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4152f8-7ea6-45ca-a553-8a07cc63a42b service cinder] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:29.176511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec4eb4-4bd1-4839-ad14-d4dc5c6453fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:29.177195 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec4eb4-4bd1-4839-ad14-d4dc5c6453fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:29.177467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec4eb4-4bd1-4839-ad14-d4dc5c6453fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:29.177774 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec4eb4-4bd1-4839-ad14-d4dc5c6453fa admin admin] PATH_INFO: `/v3/projects/672d7135ee9f482eb7070c5f8992f333/users/6490cefebe9946ecb1ae99486db82ceb/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:29.198300 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec4eb4-4bd1-4839-ad14-d4dc5c6453fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=672d7135ee9f482eb7070c5f8992f333, user_id=6490cefebe9946ecb1ae99486db82ceb, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:29.201450 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec4eb4-4bd1-4839-ad14-d4dc5c6453fa admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:29.289494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 792/1584] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:29 2022] PUT /identity/v3/projects/672d7135ee9f482eb7070c5f8992f333/users/6490cefebe9946ecb1ae99486db82ceb/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:29.300546 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7f772-b42b-4b0d-9784-c152eb7867b0 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:29.300835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7f772-b42b-4b0d-9784-c152eb7867b0 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:29.301114 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7f772-b42b-4b0d-9784-c152eb7867b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:29.332305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-9dd7f772-b42b-4b0d-9784-c152eb7867b0 None None] MFA Rules not processed for user `6490cefebe9946ecb1ae99486db82ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:29.333733 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-9dd7f772-b42b-4b0d-9784-c152eb7867b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:29.411247 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 793/1585] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:33:29.422840 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec4eb4-4bd1-4839-ad14-d4dc5c6453fa admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:29.424627 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-67ec4eb4-4bd1-4839-ad14-d4dc5c6453fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:29.566861 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec4eb4-4bd1-4839-ad14-d4dc5c6453fa admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:29.568938 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567828f-957a-4b84-b0cc-2d57bc8a2061 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9e8a7a5b8944272a2d1bd2140819ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:29.569557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567828f-957a-4b84-b0cc-2d57bc8a2061 service glance] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:29.569976 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567828f-957a-4b84-b0cc-2d57bc8a2061 service glance] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:29.570256 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567828f-957a-4b84-b0cc-2d57bc8a2061 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:29.579737 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567828f-957a-4b84-b0cc-2d57bc8a2061 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:29.581452 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567828f-957a-4b84-b0cc-2d57bc8a2061 service glance] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:29.592169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 793/1586] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:33:30.459356 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:30.673165 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:32.467196 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:33.673202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:34.626940 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7f772-b42b-4b0d-9784-c152eb7867b0 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:34.628718 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-9dd7f772-b42b-4b0d-9784-c152eb7867b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:34.755629 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7f772-b42b-4b0d-9784-c152eb7867b0 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:34.788832 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6543b2-6fc4-4d34-a386-e6b7afefbc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:34.789654 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6543b2-6fc4-4d34-a386-e6b7afefbc05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:34.790026 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6543b2-6fc4-4d34-a386-e6b7afefbc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:34.790305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6543b2-6fc4-4d34-a386-e6b7afefbc05 admin admin] PATH_INFO: `/v3/users/eda636e8f2cb45708bddd02b501cedfb` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:34.795035 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6543b2-6fc4-4d34-a386-e6b7afefbc05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eda636e8f2cb45708bddd02b501cedfb)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:34.797276 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6543b2-6fc4-4d34-a386-e6b7afefbc05 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:34.976274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:35.007219 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-8f6543b2-6fc4-4d34-a386-e6b7afefbc05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eda636e8f2cb45708bddd02b501cedfb'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:35.007879 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-8f6543b2-6fc4-4d34-a386-e6b7afefbc05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eda636e8f2cb45708bddd02b501cedfb'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:35.066588 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-8f6543b2-6fc4-4d34-a386-e6b7afefbc05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eda636e8f2cb45708bddd02b501cedfb'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:35.080303 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-8f6543b2-6fc4-4d34-a386-e6b7afefbc05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eda636e8f2cb45708bddd02b501cedfb'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:35.080963 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-8f6543b2-6fc4-4d34-a386-e6b7afefbc05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eda636e8f2cb45708bddd02b501cedfb'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:35.095424 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 794/1587] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:33:34 2022] DELETE /identity/v3/users/eda636e8f2cb45708bddd02b501cedfb => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:35.101706 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402a0e2-be41-44c7-9dc4-cc4ff13219d1 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:35.101995 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402a0e2-be41-44c7-9dc4-cc4ff13219d1 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:35.102304 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402a0e2-be41-44c7-9dc4-cc4ff13219d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:35.121701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-d402a0e2-be41-44c7-9dc4-cc4ff13219d1 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:35.123217 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-d402a0e2-be41-44c7-9dc4-cc4ff13219d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:35.206862 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 794/1588] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:35.215237 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6543b2-6fc4-4d34-a386-e6b7afefbc05 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:35.216781 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-8f6543b2-6fc4-4d34-a386-e6b7afefbc05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:35.288765 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6543b2-6fc4-4d34-a386-e6b7afefbc05 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:35.292972 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc010d-65f9-41da-8735-77b6e405361a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:35.293618 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc010d-65f9-41da-8735-77b6e405361a service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:35.293943 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc010d-65f9-41da-8735-77b6e405361a service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:35.294217 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc010d-65f9-41da-8735-77b6e405361a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:35.305289 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc010d-65f9-41da-8735-77b6e405361a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:35.307036 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc010d-65f9-41da-8735-77b6e405361a service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:35.318166 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 795/1589] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:33:35.661741 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:35.720642 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402a0e2-be41-44c7-9dc4-cc4ff13219d1 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:35.722177 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-d402a0e2-be41-44c7-9dc4-cc4ff13219d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:35.735240 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402a0e2-be41-44c7-9dc4-cc4ff13219d1 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:35.739919 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1080c4b-3b82-433a-8e91-516c03eabfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:35.740609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1080c4b-3b82-433a-8e91-516c03eabfcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:35.740888 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1080c4b-3b82-433a-8e91-516c03eabfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:35.741416 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1080c4b-3b82-433a-8e91-516c03eabfcc admin admin] PATH_INFO: `/v3/users/326a2eabb8f74aa79dc79feca17e5bcb` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:35.742555 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1080c4b-3b82-433a-8e91-516c03eabfcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=326a2eabb8f74aa79dc79feca17e5bcb)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:35.744541 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1080c4b-3b82-433a-8e91-516c03eabfcc admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:35.864455 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc010d-65f9-41da-8735-77b6e405361a service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:35.868836 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-61cc010d-65f9-41da-8735-77b6e405361a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:35.883910 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc010d-65f9-41da-8735-77b6e405361a service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:35.895853 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c55d28-0908-4d3a-b065-d15665360c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:35.897240 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c55d28-0908-4d3a-b065-d15665360c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:35.897528 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c55d28-0908-4d3a-b065-d15665360c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:35.898151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c55d28-0908-4d3a-b065-d15665360c15 admin admin] PATH_INFO: `/v3/projects/5c087bf603ff41b1b4ea472ca8a5d8ae` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:35.899557 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c55d28-0908-4d3a-b065-d15665360c15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c087bf603ff41b1b4ea472ca8a5d8ae)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:35.902078 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c55d28-0908-4d3a-b065-d15665360c15 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:35.966461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a1080c4b-3b82-433a-8e91-516c03eabfcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '326a2eabb8f74aa79dc79feca17e5bcb'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:35.967148 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a1080c4b-3b82-433a-8e91-516c03eabfcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '326a2eabb8f74aa79dc79feca17e5bcb'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:36.049137 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-96c55d28-0908-4d3a-b065-d15665360c15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c087bf603ff41b1b4ea472ca8a5d8ae', 'request_id': 'req-96c55d28-0908-4d3a-b065-d15665360c15'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:36.057479 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-96c55d28-0908-4d3a-b065-d15665360c15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c087bf603ff41b1b4ea472ca8a5d8ae', 'request_id': 'req-96c55d28-0908-4d3a-b065-d15665360c15'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:36.123906 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a1080c4b-3b82-433a-8e91-516c03eabfcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '326a2eabb8f74aa79dc79feca17e5bcb'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:36.135359 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a1080c4b-3b82-433a-8e91-516c03eabfcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '326a2eabb8f74aa79dc79feca17e5bcb'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:36.139465 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a1080c4b-3b82-433a-8e91-516c03eabfcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '326a2eabb8f74aa79dc79feca17e5bcb'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:36.157804 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 795/1590] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:33:35 2022] DELETE /identity/v3/users/326a2eabb8f74aa79dc79feca17e5bcb => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:36.162688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f6a7c-48c5-41db-8581-6ad739375bf3 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:36.163074 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f6a7c-48c5-41db-8581-6ad739375bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:36.163422 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f6a7c-48c5-41db-8581-6ad739375bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:36.184527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-7a2f6a7c-48c5-41db-8581-6ad739375bf3 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:36.185822 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-7a2f6a7c-48c5-41db-8581-6ad739375bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:36.210333 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-96c55d28-0908-4d3a-b065-d15665360c15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c087bf603ff41b1b4ea472ca8a5d8ae', 'request_id': 'req-96c55d28-0908-4d3a-b065-d15665360c15'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:36.231149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-96c55d28-0908-4d3a-b065-d15665360c15 admin admin] The token cache is being invalidate because project 5c087bf603ff41b1b4ea472ca8a5d8ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:33:36.231454 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-96c55d28-0908-4d3a-b065-d15665360c15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:36.232240 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-96c55d28-0908-4d3a-b065-d15665360c15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:36.234348 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 796/1591] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:33:35 2022] DELETE /identity/v3/projects/5c087bf603ff41b1b4ea472ca8a5d8ae => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:36.239026 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c55d28-0908-4d3a-b065-d15665360c15 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:36.240678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-96c55d28-0908-4d3a-b065-d15665360c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:36.294920 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 796/1592] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:36.305997 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f6a7c-48c5-41db-8581-6ad739375bf3 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:36.309005 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-7a2f6a7c-48c5-41db-8581-6ad739375bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:36.365842 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=80,keystone:INSERT=5,keystone:DELETE=15 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:36.369652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c55d28-0908-4d3a-b065-d15665360c15 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:36.378810 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90928bf6-f39c-49ff-a569-d4de496e949e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:36.379536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90928bf6-f39c-49ff-a569-d4de496e949e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:36.379884 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90928bf6-f39c-49ff-a569-d4de496e949e admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:36.380227 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90928bf6-f39c-49ff-a569-d4de496e949e admin admin] PATH_INFO: `/v3/users/971afb7817f144098908b5fe959086e6` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:36.381980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90928bf6-f39c-49ff-a569-d4de496e949e admin admin] RBAC: Authorizing `identity:delete_user(user_id=971afb7817f144098908b5fe959086e6)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:36.384231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90928bf6-f39c-49ff-a569-d4de496e949e admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:36.387252 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f6a7c-48c5-41db-8581-6ad739375bf3 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:36.392913 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1497a50-3467-4829-9f25-b43060b1070a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:36.393531 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1497a50-3467-4829-9f25-b43060b1070a service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:36.393813 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1497a50-3467-4829-9f25-b43060b1070a service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:36.395424 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1497a50-3467-4829-9f25-b43060b1070a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:36.409331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1497a50-3467-4829-9f25-b43060b1070a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:36.410787 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1497a50-3467-4829-9f25-b43060b1070a service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:36.423494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 797/1593] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:33:36.654686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-90928bf6-f39c-49ff-a569-d4de496e949e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971afb7817f144098908b5fe959086e6'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:36.655399 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-90928bf6-f39c-49ff-a569-d4de496e949e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971afb7817f144098908b5fe959086e6'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:36.759766 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-90928bf6-f39c-49ff-a569-d4de496e949e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971afb7817f144098908b5fe959086e6'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:36.775840 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-90928bf6-f39c-49ff-a569-d4de496e949e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971afb7817f144098908b5fe959086e6'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:36.776586 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-90928bf6-f39c-49ff-a569-d4de496e949e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971afb7817f144098908b5fe959086e6'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:36.791922 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 797/1594] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:33:36 2022] DELETE /identity/v3/users/971afb7817f144098908b5fe959086e6 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:36.974903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1497a50-3467-4829-9f25-b43060b1070a service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:36.977028 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-d1497a50-3467-4829-9f25-b43060b1070a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:37.004857 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1497a50-3467-4829-9f25-b43060b1070a service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:37.136496 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d94a2-c89e-4343-ac2e-35d4c0eff26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:37.137327 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d94a2-c89e-4343-ac2e-35d4c0eff26f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:37.137935 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d94a2-c89e-4343-ac2e-35d4c0eff26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:37.138573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d94a2-c89e-4343-ac2e-35d4c0eff26f admin admin] PATH_INFO: `/v3/projects/0b69107002ab4239bf25be7de374d26d` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:37.139859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d94a2-c89e-4343-ac2e-35d4c0eff26f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b69107002ab4239bf25be7de374d26d)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:37.142131 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d94a2-c89e-4343-ac2e-35d4c0eff26f admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:37.159193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:37.331804 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-114d94a2-c89e-4343-ac2e-35d4c0eff26f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b69107002ab4239bf25be7de374d26d', 'request_id': 'req-114d94a2-c89e-4343-ac2e-35d4c0eff26f'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:37.342896 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-114d94a2-c89e-4343-ac2e-35d4c0eff26f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b69107002ab4239bf25be7de374d26d', 'request_id': 'req-114d94a2-c89e-4343-ac2e-35d4c0eff26f'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:37.351809 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-114d94a2-c89e-4343-ac2e-35d4c0eff26f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b69107002ab4239bf25be7de374d26d', 'request_id': 'req-114d94a2-c89e-4343-ac2e-35d4c0eff26f'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:37.481238 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-114d94a2-c89e-4343-ac2e-35d4c0eff26f admin admin] The token cache is being invalidate because project 0b69107002ab4239bf25be7de374d26d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:33:37.481531 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-114d94a2-c89e-4343-ac2e-35d4c0eff26f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:37.482202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-114d94a2-c89e-4343-ac2e-35d4c0eff26f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:37.486869 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 798/1595] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:33:36 2022] DELETE /identity/v3/projects/0b69107002ab4239bf25be7de374d26d => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:37.488221 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90928bf6-f39c-49ff-a569-d4de496e949e admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:37.489713 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-90928bf6-f39c-49ff-a569-d4de496e949e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:37.514338 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90928bf6-f39c-49ff-a569-d4de496e949e admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:37.575595 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad3405-b122-42fe-80f6-5bd0c5cfe68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:37.576250 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad3405-b122-42fe-80f6-5bd0c5cfe68e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:37.576534 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad3405-b122-42fe-80f6-5bd0c5cfe68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:37.576814 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad3405-b122-42fe-80f6-5bd0c5cfe68e admin admin] PATH_INFO: `/v3/users/acbd802ea3d34a2fa19d0e3b456a8afd` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:37.578028 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad3405-b122-42fe-80f6-5bd0c5cfe68e admin admin] RBAC: Authorizing `identity:delete_user(user_id=acbd802ea3d34a2fa19d0e3b456a8afd)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:37.580062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad3405-b122-42fe-80f6-5bd0c5cfe68e admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:37.864643 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d8ad3405-b122-42fe-80f6-5bd0c5cfe68e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acbd802ea3d34a2fa19d0e3b456a8afd'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:37.865929 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d8ad3405-b122-42fe-80f6-5bd0c5cfe68e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acbd802ea3d34a2fa19d0e3b456a8afd'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:37.926672 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d94a2-c89e-4343-ac2e-35d4c0eff26f admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:37.928947 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-114d94a2-c89e-4343-ac2e-35d4c0eff26f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:37.946303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d94a2-c89e-4343-ac2e-35d4c0eff26f admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:37.952980 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f221d-769f-4565-906a-a3625c8c0282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:37.954666 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f221d-769f-4565-906a-a3625c8c0282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:37.955115 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f221d-769f-4565-906a-a3625c8c0282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:37.955528 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f221d-769f-4565-906a-a3625c8c0282 admin admin] PATH_INFO: `/v3/projects/5eede7b519da40cbb077a310a2cc5f5e` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:37.957112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f221d-769f-4565-906a-a3625c8c0282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eede7b519da40cbb077a310a2cc5f5e)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:37.959217 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f221d-769f-4565-906a-a3625c8c0282 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:37.963851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d8ad3405-b122-42fe-80f6-5bd0c5cfe68e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acbd802ea3d34a2fa19d0e3b456a8afd'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:37.984997 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d8ad3405-b122-42fe-80f6-5bd0c5cfe68e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acbd802ea3d34a2fa19d0e3b456a8afd'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:37.986253 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d8ad3405-b122-42fe-80f6-5bd0c5cfe68e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acbd802ea3d34a2fa19d0e3b456a8afd'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:38.015234 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 798/1596] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:33:37 2022] DELETE /identity/v3/users/acbd802ea3d34a2fa19d0e3b456a8afd => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:38.112512 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-5b7f221d-769f-4565-906a-a3625c8c0282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eede7b519da40cbb077a310a2cc5f5e', 'request_id': 'req-5b7f221d-769f-4565-906a-a3625c8c0282'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:38.120779 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-5b7f221d-769f-4565-906a-a3625c8c0282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eede7b519da40cbb077a310a2cc5f5e', 'request_id': 'req-5b7f221d-769f-4565-906a-a3625c8c0282'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:38.132039 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-5b7f221d-769f-4565-906a-a3625c8c0282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eede7b519da40cbb077a310a2cc5f5e', 'request_id': 'req-5b7f221d-769f-4565-906a-a3625c8c0282'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:38.229100 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-5b7f221d-769f-4565-906a-a3625c8c0282 admin admin] The token cache is being invalidate because project 5eede7b519da40cbb077a310a2cc5f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:33:38.229748 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-5b7f221d-769f-4565-906a-a3625c8c0282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:38.230152 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-5b7f221d-769f-4565-906a-a3625c8c0282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:38.231933 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 799/1597] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:33:37 2022] DELETE /identity/v3/projects/5eede7b519da40cbb077a310a2cc5f5e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:38.238317 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d20f6e-ca90-40bc-a722-9535afe280ae None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:38.238544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d20f6e-ca90-40bc-a722-9535afe280ae None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:38.238877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d20f6e-ca90-40bc-a722-9535afe280ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:38.269641 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-a7d20f6e-ca90-40bc-a722-9535afe280ae None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:38.271238 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-a7d20f6e-ca90-40bc-a722-9535afe280ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:38.376408 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 799/1598] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:38.378558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe48f9-510a-4705-8c26-4d80c9a8a4ed None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:38.378935 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe48f9-510a-4705-8c26-4d80c9a8a4ed None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:38.379336 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe48f9-510a-4705-8c26-4d80c9a8a4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:38.442509 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-c2fe48f9-510a-4705-8c26-4d80c9a8a4ed None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:38.445890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c2fe48f9-510a-4705-8c26-4d80c9a8a4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:38.456407 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 800/1599] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:38.461468 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d20f6e-ca90-40bc-a722-9535afe280ae None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:38.471449 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d20f6e-ca90-40bc-a722-9535afe280ae None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:38.477821 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b2e2c-dbf5-44d6-a05f-9b05e2e10522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:38.478670 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b2e2c-dbf5-44d6-a05f-9b05e2e10522 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:38.479048 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b2e2c-dbf5-44d6-a05f-9b05e2e10522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:38.479397 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b2e2c-dbf5-44d6-a05f-9b05e2e10522 admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:38.480164 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b2e2c-dbf5-44d6-a05f-9b05e2e10522 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:33:38.480534 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b2e2c-dbf5-44d6-a05f-9b05e2e10522 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:38.482476 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b2e2c-dbf5-44d6-a05f-9b05e2e10522 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:38.497495 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 800/1600] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:33:38.502226 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe48f9-510a-4705-8c26-4d80c9a8a4ed None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:38.514110 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe48f9-510a-4705-8c26-4d80c9a8a4ed None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:38.527036 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a4c85-712f-4400-99f3-a83b6105a799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:38.530119 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a4c85-712f-4400-99f3-a83b6105a799 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:38.535022 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a4c85-712f-4400-99f3-a83b6105a799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:38.535022 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a4c85-712f-4400-99f3-a83b6105a799 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:38.535022 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a4c85-712f-4400-99f3-a83b6105a799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:38.535022 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a4c85-712f-4400-99f3-a83b6105a799 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:38.538903 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b2e2c-dbf5-44d6-a05f-9b05e2e10522 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:38.541148 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-d64b2e2c-dbf5-44d6-a05f-9b05e2e10522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:38.566191 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b2e2c-dbf5-44d6-a05f-9b05e2e10522 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:38.577048 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb02ad-04b4-4eb2-97f4-ba52bbc723c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:38.577750 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb02ad-04b4-4eb2-97f4-ba52bbc723c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:38.578032 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb02ad-04b4-4eb2-97f4-ba52bbc723c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:38.578315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb02ad-04b4-4eb2-97f4-ba52bbc723c6 admin admin] PATH_INFO: `/v3/projects/deff5351b8c2423789bc928b25df2865` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:38.579697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb02ad-04b4-4eb2-97f4-ba52bbc723c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=deff5351b8c2423789bc928b25df2865)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:38.594500 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb02ad-04b4-4eb2-97f4-ba52bbc723c6 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:38.644698 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:38.694752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 801/1601] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:33:38 2022] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:38.698635 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a4c85-712f-4400-99f3-a83b6105a799 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:38.708372 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:38.737962 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-5afb02ad-04b4-4eb2-97f4-ba52bbc723c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deff5351b8c2423789bc928b25df2865', 'request_id': 'req-5afb02ad-04b4-4eb2-97f4-ba52bbc723c6'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:38.762610 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-5afb02ad-04b4-4eb2-97f4-ba52bbc723c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deff5351b8c2423789bc928b25df2865', 'request_id': 'req-5afb02ad-04b4-4eb2-97f4-ba52bbc723c6'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:38.790848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a4c85-712f-4400-99f3-a83b6105a799 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:38.898507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73659e5-7f5b-4ee5-87fa-7bbb475ac7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:38.899783 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73659e5-7f5b-4ee5-87fa-7bbb475ac7da admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:38.899783 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73659e5-7f5b-4ee5-87fa-7bbb475ac7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:38.906146 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73659e5-7f5b-4ee5-87fa-7bbb475ac7da admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:38.906146 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73659e5-7f5b-4ee5-87fa-7bbb475ac7da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:38.906315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-5afb02ad-04b4-4eb2-97f4-ba52bbc723c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deff5351b8c2423789bc928b25df2865', 'request_id': 'req-5afb02ad-04b4-4eb2-97f4-ba52bbc723c6'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:38.906394 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73659e5-7f5b-4ee5-87fa-7bbb475ac7da admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:38.923298 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-5afb02ad-04b4-4eb2-97f4-ba52bbc723c6 admin admin] The token cache is being invalidate because project deff5351b8c2423789bc928b25df2865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:33:38.923652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-5afb02ad-04b4-4eb2-97f4-ba52bbc723c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:38.924388 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-5afb02ad-04b4-4eb2-97f4-ba52bbc723c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:38.926236 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 801/1602] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:33:38 2022] DELETE /identity/v3/projects/deff5351b8c2423789bc928b25df2865 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:33:38.930986 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073dd94-39a9-4f5a-b360-bf7f764c97fb None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:38.931272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073dd94-39a9-4f5a-b360-bf7f764c97fb None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:38.931544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073dd94-39a9-4f5a-b360-bf7f764c97fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:38.952164 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-0073dd94-39a9-4f5a-b360-bf7f764c97fb None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:38.953355 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-0073dd94-39a9-4f5a-b360-bf7f764c97fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:38.966984 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 802/1603] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:38.971265 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcd52d-f766-4ccf-a790-cfc2edbdaab9 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:38.971624 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcd52d-f766-4ccf-a790-cfc2edbdaab9 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:38.971964 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcd52d-f766-4ccf-a790-cfc2edbdaab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:38.994640 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 802/1604] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:33:38 2022] POST /identity/v3/users => generated 288 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:33:38.999130 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73659e5-7f5b-4ee5-87fa-7bbb475ac7da admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:39.001187 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-e73659e5-7f5b-4ee5-87fa-7bbb475ac7da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:39.006444 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-92bcd52d-f766-4ccf-a790-cfc2edbdaab9 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:39.007809 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-92bcd52d-f766-4ccf-a790-cfc2edbdaab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:39.016159 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73659e5-7f5b-4ee5-87fa-7bbb475ac7da admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:39.016658 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 803/1605] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:33:39.020946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcd52d-f766-4ccf-a790-cfc2edbdaab9 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:39.022261 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cfc03-11dc-4e9a-95e8-346e36e5d340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:39.023128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cfc03-11dc-4e9a-95e8-346e36e5d340 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:39.023549 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cfc03-11dc-4e9a-95e8-346e36e5d340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:39.023973 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cfc03-11dc-4e9a-95e8-346e36e5d340 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:39.024753 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cfc03-11dc-4e9a-95e8-346e36e5d340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:39.026755 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cfc03-11dc-4e9a-95e8-346e36e5d340 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:39.031134 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcd52d-f766-4ccf-a790-cfc2edbdaab9 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:39.037858 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335a2b5-8f7b-43dc-a794-dc1779a1eb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:39.038474 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335a2b5-8f7b-43dc-a794-dc1779a1eb50 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:39.038863 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335a2b5-8f7b-43dc-a794-dc1779a1eb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:39.039054 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335a2b5-8f7b-43dc-a794-dc1779a1eb50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:39.039710 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335a2b5-8f7b-43dc-a794-dc1779a1eb50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:33:39.040010 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335a2b5-8f7b-43dc-a794-dc1779a1eb50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:39.041749 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335a2b5-8f7b-43dc-a794-dc1779a1eb50 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:39.045354 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 803/1606] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:39.048629 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cfc03-11dc-4e9a-95e8-346e36e5d340 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:39.061212 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 804/1607] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:33:39.062118 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335a2b5-8f7b-43dc-a794-dc1779a1eb50 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:39.063380 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cfc03-11dc-4e9a-95e8-346e36e5d340 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:39.068951 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c3846-a1c0-4d66-b7f8-e47e0a2f2bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:39.069713 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c3846-a1c0-4d66-b7f8-e47e0a2f2bbe admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:39.070087 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c3846-a1c0-4d66-b7f8-e47e0a2f2bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:39.070214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c3846-a1c0-4d66-b7f8-e47e0a2f2bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:39.071623 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c3846-a1c0-4d66-b7f8-e47e0a2f2bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:39.073593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c3846-a1c0-4d66-b7f8-e47e0a2f2bbe admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:39.076073 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335a2b5-8f7b-43dc-a794-dc1779a1eb50 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:39.081462 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dba5a5-21b0-49ad-b6f6-260c218cec6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:39.082237 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dba5a5-21b0-49ad-b6f6-260c218cec6b admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:39.082525 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dba5a5-21b0-49ad-b6f6-260c218cec6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:39.082799 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dba5a5-21b0-49ad-b6f6-260c218cec6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:39.083473 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dba5a5-21b0-49ad-b6f6-260c218cec6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:39.086211 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dba5a5-21b0-49ad-b6f6-260c218cec6b admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:39.104458 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 804/1608] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:33:39.108635 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c3846-a1c0-4d66-b7f8-e47e0a2f2bbe admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:39.120289 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c3846-a1c0-4d66-b7f8-e47e0a2f2bbe admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:39.127504 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab838c-8883-4c3d-b4b0-b833c30eb805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:39.128964 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab838c-8883-4c3d-b4b0-b833c30eb805 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:39.129396 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab838c-8883-4c3d-b4b0-b833c30eb805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:39.130219 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab838c-8883-4c3d-b4b0-b833c30eb805 admin admin] PATH_INFO: `/v3/projects/96d0b6fa732b496a9bb0832feb39ffaa/users/085478c8189a4584ae58ccc5ce43d71a/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:39.152154 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab838c-8883-4c3d-b4b0-b833c30eb805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d0b6fa732b496a9bb0832feb39ffaa, user_id=085478c8189a4584ae58ccc5ce43d71a, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:39.155154 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab838c-8883-4c3d-b4b0-b833c30eb805 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:39.203604 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 805/1609] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:33:39 2022] POST /identity/v3/projects => generated 389 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:39.205069 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dba5a5-21b0-49ad-b6f6-260c218cec6b admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:39.233556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 805/1610] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:39 2022] PUT /identity/v3/projects/96d0b6fa732b496a9bb0832feb39ffaa/users/085478c8189a4584ae58ccc5ce43d71a/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:39.248086 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a6fab-af63-4168-86d7-f68e8983b4ba None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:39.248388 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a6fab-af63-4168-86d7-f68e8983b4ba None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:39.248714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a6fab-af63-4168-86d7-f68e8983b4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:39.280471 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-e11a6fab-af63-4168-86d7-f68e8983b4ba None None] MFA Rules not processed for user `085478c8189a4584ae58ccc5ce43d71a`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:39.281775 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-e11a6fab-af63-4168-86d7-f68e8983b4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:39.289591 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dba5a5-21b0-49ad-b6f6-260c218cec6b admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:39.378245 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2175fb1-cd6d-4c97-a81b-111f7290754a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:39.379115 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2175fb1-cd6d-4c97-a81b-111f7290754a admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:39.379476 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2175fb1-cd6d-4c97-a81b-111f7290754a admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:39.379865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2175fb1-cd6d-4c97-a81b-111f7290754a admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:39.380749 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2175fb1-cd6d-4c97-a81b-111f7290754a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:39.382080 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 806/1611] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:33:39.384718 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2175fb1-cd6d-4c97-a81b-111f7290754a admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:39.388128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a6fab-af63-4168-86d7-f68e8983b4ba None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:39.410969 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a6fab-af63-4168-86d7-f68e8983b4ba None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:39.418246 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580155ea-dd11-48c0-ad4b-806acd8b7013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:39.418985 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580155ea-dd11-48c0-ad4b-806acd8b7013 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:39.419330 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580155ea-dd11-48c0-ad4b-806acd8b7013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:39.419698 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580155ea-dd11-48c0-ad4b-806acd8b7013 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:39.420473 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580155ea-dd11-48c0-ad4b-806acd8b7013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:39.423737 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580155ea-dd11-48c0-ad4b-806acd8b7013 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:39.500701 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 806/1612] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:33:39 2022] POST /identity/v3/users => generated 295 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:33:39.503288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2175fb1-cd6d-4c97-a81b-111f7290754a admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:39.515023 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2175fb1-cd6d-4c97-a81b-111f7290754a admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:39.521266 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68bb80c-3053-4410-a6ad-b0cc49896cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:39.521919 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bb80c-3053-4410-a6ad-b0cc49896cbb admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:39.522198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bb80c-3053-4410-a6ad-b0cc49896cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:39.522475 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bb80c-3053-4410-a6ad-b0cc49896cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:39.523324 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68bb80c-3053-4410-a6ad-b0cc49896cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:39.525497 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68bb80c-3053-4410-a6ad-b0cc49896cbb admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:39.544398 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 807/1613] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:33:39 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:39.552664 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580155ea-dd11-48c0-ad4b-806acd8b7013 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:39.558580 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 807/1614] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:33:39.559733 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68bb80c-3053-4410-a6ad-b0cc49896cbb admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:39.574903 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68bb80c-3053-4410-a6ad-b0cc49896cbb admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:39.642130 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580155ea-dd11-48c0-ad4b-806acd8b7013 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:39.665531 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5150c-0c04-4ced-a629-e0333f1bf298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:39.668742 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5150c-0c04-4ced-a629-e0333f1bf298 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:39.669290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5150c-0c04-4ced-a629-e0333f1bf298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:39.669864 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5150c-0c04-4ced-a629-e0333f1bf298 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:39.672311 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5150c-0c04-4ced-a629-e0333f1bf298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:39.676442 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5150c-0c04-4ced-a629-e0333f1bf298 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:39.722873 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8bb6b-1ce6-4847-97a0-6ad4c2830576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:39.722873 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8bb6b-1ce6-4847-97a0-6ad4c2830576 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:39.722873 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8bb6b-1ce6-4847-97a0-6ad4c2830576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:39.722873 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8bb6b-1ce6-4847-97a0-6ad4c2830576 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:39.723293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8bb6b-1ce6-4847-97a0-6ad4c2830576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:39.723293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8bb6b-1ce6-4847-97a0-6ad4c2830576 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:39.735070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 808/1615] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:39.738221 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8bb6b-1ce6-4847-97a0-6ad4c2830576 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:39.757469 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8bb6b-1ce6-4847-97a0-6ad4c2830576 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:39.764277 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37cf0a-d22a-42f2-bfbf-0a2a65071c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:39.765496 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37cf0a-d22a-42f2-bfbf-0a2a65071c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:39.765954 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37cf0a-d22a-42f2-bfbf-0a2a65071c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:39.767166 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37cf0a-d22a-42f2-bfbf-0a2a65071c0c admin admin] PATH_INFO: `/v3/projects/78b25ab7383243169ea44173e486c894/users/a3674046b0354a70bf7f5eee3862e101/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:39.790086 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37cf0a-d22a-42f2-bfbf-0a2a65071c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b25ab7383243169ea44173e486c894, user_id=a3674046b0354a70bf7f5eee3862e101, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:39.792734 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37cf0a-d22a-42f2-bfbf-0a2a65071c0c admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:39.831846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 808/1616] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:33:39 2022] POST /identity/v3/users => generated 294 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:39.833003 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5150c-0c04-4ced-a629-e0333f1bf298 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:39.848870 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5150c-0c04-4ced-a629-e0333f1bf298 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:39.856071 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a1b81-8ed2-4a6e-84da-ba2856bc00ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:39.856735 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a1b81-8ed2-4a6e-84da-ba2856bc00ec admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:39.857036 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a1b81-8ed2-4a6e-84da-ba2856bc00ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:39.857325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a1b81-8ed2-4a6e-84da-ba2856bc00ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:39.857969 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a1b81-8ed2-4a6e-84da-ba2856bc00ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:39.859662 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a1b81-8ed2-4a6e-84da-ba2856bc00ec admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:39.873696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 809/1617] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:33:39.877713 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a1b81-8ed2-4a6e-84da-ba2856bc00ec admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:39.891587 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a1b81-8ed2-4a6e-84da-ba2856bc00ec admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:39.897663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 809/1618] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:39 2022] PUT /identity/v3/projects/78b25ab7383243169ea44173e486c894/users/a3674046b0354a70bf7f5eee3862e101/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:39.910603 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab965f1b-34d7-4377-b1b9-c2761e70f226 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:39.911207 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab965f1b-34d7-4377-b1b9-c2761e70f226 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:39.911705 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab965f1b-34d7-4377-b1b9-c2761e70f226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:39.948942 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-ab965f1b-34d7-4377-b1b9-c2761e70f226 None None] MFA Rules not processed for user `a3674046b0354a70bf7f5eee3862e101`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:39.950555 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-ab965f1b-34d7-4377-b1b9-c2761e70f226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:39.956552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:39.981718 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17552e-7dbd-402d-ab67-e2aa38873fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:39.981718 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17552e-7dbd-402d-ab67-e2aa38873fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:39.981718 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17552e-7dbd-402d-ab67-e2aa38873fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:39.981718 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17552e-7dbd-402d-ab67-e2aa38873fb0 admin admin] PATH_INFO: `/v3/projects/1cbc2696837f44b8a1921f092afd0b34/users/7b3d229d1fce47faa6e2612114b4e72b/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:40.000084 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17552e-7dbd-402d-ab67-e2aa38873fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cbc2696837f44b8a1921f092afd0b34, user_id=7b3d229d1fce47faa6e2612114b4e72b, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:40.000764 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17552e-7dbd-402d-ab67-e2aa38873fb0 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:40.043821 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 810/1619] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:40.048184 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab965f1b-34d7-4377-b1b9-c2761e70f226 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:40.067149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab965f1b-34d7-4377-b1b9-c2761e70f226 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:40.070974 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef4076-8079-410e-957b-d4db64ae23e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:40.071522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef4076-8079-410e-957b-d4db64ae23e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:40.071806 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef4076-8079-410e-957b-d4db64ae23e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:40.072135 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef4076-8079-410e-957b-d4db64ae23e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:40.076866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef4076-8079-410e-957b-d4db64ae23e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:40.076866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef4076-8079-410e-957b-d4db64ae23e8 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:40.089576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 810/1620] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:39 2022] PUT /identity/v3/projects/1cbc2696837f44b8a1921f092afd0b34/users/7b3d229d1fce47faa6e2612114b4e72b/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:33:40.094536 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17552e-7dbd-402d-ab67-e2aa38873fb0 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:40.219376 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17552e-7dbd-402d-ab67-e2aa38873fb0 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:40.228529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e09c8d-03f0-455c-8f9a-7e98236f3e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:40.229251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e09c8d-03f0-455c-8f9a-7e98236f3e78 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:40.229532 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e09c8d-03f0-455c-8f9a-7e98236f3e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:40.229799 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e09c8d-03f0-455c-8f9a-7e98236f3e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:40.230522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e09c8d-03f0-455c-8f9a-7e98236f3e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:40.232412 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e09c8d-03f0-455c-8f9a-7e98236f3e78 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:40.249533 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 811/1621] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:33:40 2022] POST /identity/v3/projects => generated 389 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:40.253896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef4076-8079-410e-957b-d4db64ae23e8 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:40.255401 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 811/1622] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:33:40.261320 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e09c8d-03f0-455c-8f9a-7e98236f3e78 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:40.277413 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e09c8d-03f0-455c-8f9a-7e98236f3e78 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:40.370697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef4076-8079-410e-957b-d4db64ae23e8 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:40.383267 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b0a2c-9fd9-48d6-a823-a586b9bc7bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:40.384140 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b0a2c-9fd9-48d6-a823-a586b9bc7bbb admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:40.384509 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b0a2c-9fd9-48d6-a823-a586b9bc7bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:40.384857 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b0a2c-9fd9-48d6-a823-a586b9bc7bbb admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:40.385758 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b0a2c-9fd9-48d6-a823-a586b9bc7bbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:40.388993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b0a2c-9fd9-48d6-a823-a586b9bc7bbb admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:40.390475 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29b7db-3b5e-4f53-96b1-a78d5e0f0680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:40.391658 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29b7db-3b5e-4f53-96b1-a78d5e0f0680 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:40.392138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29b7db-3b5e-4f53-96b1-a78d5e0f0680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:40.392775 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29b7db-3b5e-4f53-96b1-a78d5e0f0680 admin admin] PATH_INFO: `/v3/projects/1cbc2696837f44b8a1921f092afd0b34/users/7b3d229d1fce47faa6e2612114b4e72b/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:40.395188 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29b7db-3b5e-4f53-96b1-a78d5e0f0680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cbc2696837f44b8a1921f092afd0b34, user_id=7b3d229d1fce47faa6e2612114b4e72b, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:40.400557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29b7db-3b5e-4f53-96b1-a78d5e0f0680 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:40.416140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 812/1623] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:40 2022] PUT /identity/v3/projects/1cbc2696837f44b8a1921f092afd0b34/users/7b3d229d1fce47faa6e2612114b4e72b/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:33:40.427478 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d93b8-bc22-43a1-a88b-ced20ba47745 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:40.431381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d93b8-bc22-43a1-a88b-ced20ba47745 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:40.431381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d93b8-bc22-43a1-a88b-ced20ba47745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:40.469442 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-ee6d93b8-bc22-43a1-a88b-ced20ba47745 None None] MFA Rules not processed for user `7b3d229d1fce47faa6e2612114b4e72b`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:40.469793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ee6d93b8-bc22-43a1-a88b-ced20ba47745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:40.541965 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 812/1624] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:33:40 2022] POST /identity/v3/users => generated 301 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:40.543468 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b0a2c-9fd9-48d6-a823-a586b9bc7bbb admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:40.556502 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b0a2c-9fd9-48d6-a823-a586b9bc7bbb admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:40.576360 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 813/1625] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:40.589313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d93b8-bc22-43a1-a88b-ced20ba47745 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:40.591916 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ee6d93b8-bc22-43a1-a88b-ced20ba47745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:40.657420 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea5446-5dd9-458e-8f22-876061746d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:40.658887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea5446-5dd9-458e-8f22-876061746d91 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:40.659181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea5446-5dd9-458e-8f22-876061746d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:40.659459 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea5446-5dd9-458e-8f22-876061746d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:40.660772 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea5446-5dd9-458e-8f22-876061746d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:40.663938 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea5446-5dd9-458e-8f22-876061746d91 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:40.676694 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 813/1626] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:40.677410 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d93b8-bc22-43a1-a88b-ced20ba47745 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:40.681527 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea5446-5dd9-458e-8f22-876061746d91 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:40.683900 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60c5f1-75a6-4054-baa7-813598ade9ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:40.685013 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60c5f1-75a6-4054-baa7-813598ade9ce service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:40.685293 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60c5f1-75a6-4054-baa7-813598ade9ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:40.685561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60c5f1-75a6-4054-baa7-813598ade9ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:40.692493 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea5446-5dd9-458e-8f22-876061746d91 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:40.697776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6d909-a36d-471d-9f66-9469f379021d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:40.698444 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6d909-a36d-471d-9f66-9469f379021d admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:40.698725 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6d909-a36d-471d-9f66-9469f379021d admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:40.699054 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6d909-a36d-471d-9f66-9469f379021d admin admin] PATH_INFO: `/v3/projects/c6c40ec9784840029568e6ffd9ab632d/users/e7bcba58b7a247df9b390fbf31d91109/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:40.731666 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6d909-a36d-471d-9f66-9469f379021d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c40ec9784840029568e6ffd9ab632d, user_id=e7bcba58b7a247df9b390fbf31d91109, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:40.735139 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6d909-a36d-471d-9f66-9469f379021d admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:40.760780 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60c5f1-75a6-4054-baa7-813598ade9ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:40.762272 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60c5f1-75a6-4054-baa7-813598ade9ce service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:40.772093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 814/1627] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:33:40.828067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 814/1628] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:40 2022] PUT /identity/v3/projects/c6c40ec9784840029568e6ffd9ab632d/users/e7bcba58b7a247df9b390fbf31d91109/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:33:40.831980 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60c5f1-75a6-4054-baa7-813598ade9ce service cinder] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:40.847981 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60c5f1-75a6-4054-baa7-813598ade9ce service cinder] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:40.902979 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:40.954404 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b30da4-d065-452d-befb-e06de347fd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:40.956534 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b30da4-d065-452d-befb-e06de347fd6d admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:40.956852 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b30da4-d065-452d-befb-e06de347fd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:40.957817 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b30da4-d065-452d-befb-e06de347fd6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:40.958503 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b30da4-d065-452d-befb-e06de347fd6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:40.969309 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b30da4-d065-452d-befb-e06de347fd6d admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:40.999012 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 815/1629] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:41.000803 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6d909-a36d-471d-9f66-9469f379021d admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:41.017678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6d909-a36d-471d-9f66-9469f379021d admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:41.024021 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf32312-3051-42e1-aa6e-d9dd2a841ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:41.024643 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf32312-3051-42e1-aa6e-d9dd2a841ee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:41.024975 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf32312-3051-42e1-aa6e-d9dd2a841ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:41.025252 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf32312-3051-42e1-aa6e-d9dd2a841ee5 admin admin] PATH_INFO: `/v3/projects/c6c40ec9784840029568e6ffd9ab632d/users/e7bcba58b7a247df9b390fbf31d91109/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:41.027636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf32312-3051-42e1-aa6e-d9dd2a841ee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c40ec9784840029568e6ffd9ab632d, user_id=e7bcba58b7a247df9b390fbf31d91109, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:41.030075 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf32312-3051-42e1-aa6e-d9dd2a841ee5 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:41.053194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 815/1630] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:40 2022] PUT /identity/v3/projects/c6c40ec9784840029568e6ffd9ab632d/users/e7bcba58b7a247df9b390fbf31d91109/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:41.066745 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3a8a9-5e59-4afc-8208-68a6be36a6b0 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:41.067112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3a8a9-5e59-4afc-8208-68a6be36a6b0 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:41.067395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3a8a9-5e59-4afc-8208-68a6be36a6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:41.143221 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-e0d3a8a9-5e59-4afc-8208-68a6be36a6b0 None None] MFA Rules not processed for user `e7bcba58b7a247df9b390fbf31d91109`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:41.143221 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-e0d3a8a9-5e59-4afc-8208-68a6be36a6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:41.273788 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 816/1631] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:41 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:41.394405 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf32312-3051-42e1-aa6e-d9dd2a841ee5 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:41.396546 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-0cf32312-3051-42e1-aa6e-d9dd2a841ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:41.464329 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf32312-3051-42e1-aa6e-d9dd2a841ee5 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:41.468290 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec8c41-d4b0-40e5-bcee-e0031711bf01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:41.468933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec8c41-d4b0-40e5-bcee-e0031711bf01 service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:41.469213 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec8c41-d4b0-40e5-bcee-e0031711bf01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:41.469485 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec8c41-d4b0-40e5-bcee-e0031711bf01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:41.481876 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec8c41-d4b0-40e5-bcee-e0031711bf01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:41.483387 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec8c41-d4b0-40e5-bcee-e0031711bf01 service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:41.499456 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 816/1632] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:41 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:33:41.714172 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3a8a9-5e59-4afc-8208-68a6be36a6b0 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:41.797344 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3a8a9-5e59-4afc-8208-68a6be36a6b0 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:41.812012 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a054f-2aeb-408e-8602-0483aa0fce09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:41.812012 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a054f-2aeb-408e-8602-0483aa0fce09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:41.812012 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a054f-2aeb-408e-8602-0483aa0fce09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:41.812012 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a054f-2aeb-408e-8602-0483aa0fce09 admin admin] PATH_INFO: `/v3/users/a3674046b0354a70bf7f5eee3862e101` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:41.812516 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a054f-2aeb-408e-8602-0483aa0fce09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3674046b0354a70bf7f5eee3862e101)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:41.812516 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a054f-2aeb-408e-8602-0483aa0fce09 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:42.060162 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-c19a054f-2aeb-408e-8602-0483aa0fce09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3674046b0354a70bf7f5eee3862e101'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:42.061012 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-c19a054f-2aeb-408e-8602-0483aa0fce09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3674046b0354a70bf7f5eee3862e101'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:42.182511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-c19a054f-2aeb-408e-8602-0483aa0fce09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3674046b0354a70bf7f5eee3862e101'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:42.204620 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:42.218455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-c19a054f-2aeb-408e-8602-0483aa0fce09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3674046b0354a70bf7f5eee3862e101'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:42.220124 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-c19a054f-2aeb-408e-8602-0483aa0fce09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3674046b0354a70bf7f5eee3862e101'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:42.250087 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 817/1633] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:33:41 2022] DELETE /identity/v3/users/a3674046b0354a70bf7f5eee3862e101 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:33:42.254709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d3a52-4b02-4fd0-931f-ddae6d81d7bc None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:42.255217 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d3a52-4b02-4fd0-931f-ddae6d81d7bc None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:42.255295 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d3a52-4b02-4fd0-931f-ddae6d81d7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:42.284084 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-dc8d3a52-4b02-4fd0-931f-ddae6d81d7bc None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:42.285362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-dc8d3a52-4b02-4fd0-931f-ddae6d81d7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:42.338874 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:42.391893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 817/1634] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:42.404542 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a054f-2aeb-408e-8602-0483aa0fce09 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:42.406306 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c19a054f-2aeb-408e-8602-0483aa0fce09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:42.488729 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a054f-2aeb-408e-8602-0483aa0fce09 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:42.494291 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c961e8e-e6af-4206-9201-fbefea4de371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:42.495227 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c961e8e-e6af-4206-9201-fbefea4de371 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:42.495738 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c961e8e-e6af-4206-9201-fbefea4de371 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:42.496246 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c961e8e-e6af-4206-9201-fbefea4de371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:42.508255 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c961e8e-e6af-4206-9201-fbefea4de371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:42.510759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c961e8e-e6af-4206-9201-fbefea4de371 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:42.523636 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 818/1635] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:33:43.126020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d3a52-4b02-4fd0-931f-ddae6d81d7bc None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:43.127587 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-dc8d3a52-4b02-4fd0-931f-ddae6d81d7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:43.142339 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d3a52-4b02-4fd0-931f-ddae6d81d7bc None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:43.148137 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02a1a1-8de7-485c-bea4-5c409b67bc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:43.148790 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02a1a1-8de7-485c-bea4-5c409b67bc6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:43.149070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02a1a1-8de7-485c-bea4-5c409b67bc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:43.149342 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02a1a1-8de7-485c-bea4-5c409b67bc6d admin admin] PATH_INFO: `/v3/projects/78b25ab7383243169ea44173e486c894` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:43.150538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02a1a1-8de7-485c-bea4-5c409b67bc6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=78b25ab7383243169ea44173e486c894)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:43.152491 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02a1a1-8de7-485c-bea4-5c409b67bc6d admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:43.322427 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-6f02a1a1-8de7-485c-bea4-5c409b67bc6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78b25ab7383243169ea44173e486c894', 'request_id': 'req-6f02a1a1-8de7-485c-bea4-5c409b67bc6d'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:43.328153 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-6f02a1a1-8de7-485c-bea4-5c409b67bc6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78b25ab7383243169ea44173e486c894', 'request_id': 'req-6f02a1a1-8de7-485c-bea4-5c409b67bc6d'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:43.445058 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-6f02a1a1-8de7-485c-bea4-5c409b67bc6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78b25ab7383243169ea44173e486c894', 'request_id': 'req-6f02a1a1-8de7-485c-bea4-5c409b67bc6d'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:43.466798 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-6f02a1a1-8de7-485c-bea4-5c409b67bc6d admin admin] The token cache is being invalidate because project 78b25ab7383243169ea44173e486c894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:33:43.467148 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-6f02a1a1-8de7-485c-bea4-5c409b67bc6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:43.467870 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-6f02a1a1-8de7-485c-bea4-5c409b67bc6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:43.469396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 818/1636] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:33:43 2022] DELETE /identity/v3/projects/78b25ab7383243169ea44173e486c894 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:43.473327 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c961e8e-e6af-4206-9201-fbefea4de371 service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:43.485070 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c961e8e-e6af-4206-9201-fbefea4de371 service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:43.556549 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b896ee-f201-4230-8c90-9af05d6c6e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:43.557199 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b896ee-f201-4230-8c90-9af05d6c6e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:43.557479 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b896ee-f201-4230-8c90-9af05d6c6e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:43.557748 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b896ee-f201-4230-8c90-9af05d6c6e46 admin admin] PATH_INFO: `/v3/users/e7bcba58b7a247df9b390fbf31d91109` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:43.559997 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b896ee-f201-4230-8c90-9af05d6c6e46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7bcba58b7a247df9b390fbf31d91109)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:43.562132 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b896ee-f201-4230-8c90-9af05d6c6e46 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:43.577078 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:43.796830 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b8b896ee-f201-4230-8c90-9af05d6c6e46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7bcba58b7a247df9b390fbf31d91109'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:43.797512 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b8b896ee-f201-4230-8c90-9af05d6c6e46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7bcba58b7a247df9b390fbf31d91109'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:43.907048 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b8b896ee-f201-4230-8c90-9af05d6c6e46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7bcba58b7a247df9b390fbf31d91109'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:43.915499 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b8b896ee-f201-4230-8c90-9af05d6c6e46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7bcba58b7a247df9b390fbf31d91109'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:43.916684 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b8b896ee-f201-4230-8c90-9af05d6c6e46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7bcba58b7a247df9b390fbf31d91109'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:43.935440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 819/1637] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:33:43 2022] DELETE /identity/v3/users/e7bcba58b7a247df9b390fbf31d91109 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:44.422776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02a1a1-8de7-485c-bea4-5c409b67bc6d admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:44.424434 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-6f02a1a1-8de7-485c-bea4-5c409b67bc6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:44.440894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02a1a1-8de7-485c-bea4-5c409b67bc6d admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:44.450764 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:44.505487 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55e3a3-55ad-492a-852d-b0969558a8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:44.506172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55e3a3-55ad-492a-852d-b0969558a8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:44.506462 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55e3a3-55ad-492a-852d-b0969558a8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:44.506691 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55e3a3-55ad-492a-852d-b0969558a8c3 admin admin] PATH_INFO: `/v3/projects/c6c40ec9784840029568e6ffd9ab632d` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:44.508054 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55e3a3-55ad-492a-852d-b0969558a8c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6c40ec9784840029568e6ffd9ab632d)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:44.509939 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55e3a3-55ad-492a-852d-b0969558a8c3 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:44.623109 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2a55e3a3-55ad-492a-852d-b0969558a8c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6c40ec9784840029568e6ffd9ab632d', 'request_id': 'req-2a55e3a3-55ad-492a-852d-b0969558a8c3'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:44.629386 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2a55e3a3-55ad-492a-852d-b0969558a8c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6c40ec9784840029568e6ffd9ab632d', 'request_id': 'req-2a55e3a3-55ad-492a-852d-b0969558a8c3'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:44.644803 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:44.758743 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2a55e3a3-55ad-492a-852d-b0969558a8c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6c40ec9784840029568e6ffd9ab632d', 'request_id': 'req-2a55e3a3-55ad-492a-852d-b0969558a8c3'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:44.776541 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2a55e3a3-55ad-492a-852d-b0969558a8c3 admin admin] The token cache is being invalidate because project c6c40ec9784840029568e6ffd9ab632d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:33:44.776840 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2a55e3a3-55ad-492a-852d-b0969558a8c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:44.777501 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2a55e3a3-55ad-492a-852d-b0969558a8c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:44.779129 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 819/1638] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:33:44 2022] DELETE /identity/v3/projects/c6c40ec9784840029568e6ffd9ab632d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:44.785154 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cc76f-98b6-447f-9e9f-b938dd36d6ec None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:44.785727 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cc76f-98b6-447f-9e9f-b938dd36d6ec None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:44.785727 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cc76f-98b6-447f-9e9f-b938dd36d6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:44.813163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-6e0cc76f-98b6-447f-9e9f-b938dd36d6ec None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:44.814456 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-6e0cc76f-98b6-447f-9e9f-b938dd36d6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:44.882299 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 820/1639] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:44.890418 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff0e96-13ef-4b1e-a91b-9fdcf447773a None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:44.890702 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff0e96-13ef-4b1e-a91b-9fdcf447773a None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:44.891011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff0e96-13ef-4b1e-a91b-9fdcf447773a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:44.912809 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-e5ff0e96-13ef-4b1e-a91b-9fdcf447773a None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:44.914261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-e5ff0e96-13ef-4b1e-a91b-9fdcf447773a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:44.923509 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 820/1640] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:44.927857 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cc76f-98b6-447f-9e9f-b938dd36d6ec None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:44.937845 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cc76f-98b6-447f-9e9f-b938dd36d6ec None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:44.942546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e7595-0503-4cfb-9e1b-c6b000c2c9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:44.943178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e7595-0503-4cfb-9e1b-c6b000c2c9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:44.943492 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e7595-0503-4cfb-9e1b-c6b000c2c9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:44.943763 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e7595-0503-4cfb-9e1b-c6b000c2c9d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:44.944398 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e7595-0503-4cfb-9e1b-c6b000c2c9d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:33:44.944697 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e7595-0503-4cfb-9e1b-c6b000c2c9d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:44.946278 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e7595-0503-4cfb-9e1b-c6b000c2c9d7 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:44.957541 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 821/1641] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:33:44.963092 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff0e96-13ef-4b1e-a91b-9fdcf447773a None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:44.972318 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff0e96-13ef-4b1e-a91b-9fdcf447773a None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:44.978206 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7e9ce-e157-4b8a-b87d-a25c7e796480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:44.978838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7e9ce-e157-4b8a-b87d-a25c7e796480 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:44.979118 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7e9ce-e157-4b8a-b87d-a25c7e796480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:44.979385 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7e9ce-e157-4b8a-b87d-a25c7e796480 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:44.980033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7e9ce-e157-4b8a-b87d-a25c7e796480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:44.982470 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7e9ce-e157-4b8a-b87d-a25c7e796480 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:45.105235 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 821/1642] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:33:44 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:45.111091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e7595-0503-4cfb-9e1b-c6b000c2c9d7 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:45.127255 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e7595-0503-4cfb-9e1b-c6b000c2c9d7 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:45.192439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac393cd-0b06-46ae-b559-14b0b05a221f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:45.192439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac393cd-0b06-46ae-b559-14b0b05a221f admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:45.192439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac393cd-0b06-46ae-b559-14b0b05a221f admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:45.192439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac393cd-0b06-46ae-b559-14b0b05a221f admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:45.192999 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac393cd-0b06-46ae-b559-14b0b05a221f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:45.192999 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac393cd-0b06-46ae-b559-14b0b05a221f admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:45.216528 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7e9ce-e157-4b8a-b87d-a25c7e796480 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:45.228383 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-27f7e9ce-e157-4b8a-b87d-a25c7e796480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:45.232238 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7e9ce-e157-4b8a-b87d-a25c7e796480 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:45.236913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91753f17-878a-45fe-b7f2-630a9b41d6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:45.237537 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91753f17-878a-45fe-b7f2-630a9b41d6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:45.237817 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91753f17-878a-45fe-b7f2-630a9b41d6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:45.238091 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91753f17-878a-45fe-b7f2-630a9b41d6f9 admin admin] PATH_INFO: `/v3/users/085478c8189a4584ae58ccc5ce43d71a` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:45.239259 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91753f17-878a-45fe-b7f2-630a9b41d6f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=085478c8189a4584ae58ccc5ce43d71a)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:45.241459 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91753f17-878a-45fe-b7f2-630a9b41d6f9 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:45.486407 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 822/1643] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:33:45 2022] POST /identity/v3/users => generated 289 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:45.486407 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac393cd-0b06-46ae-b559-14b0b05a221f admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:45.496570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac393cd-0b06-46ae-b559-14b0b05a221f admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:45.501662 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aca2ec-d524-4f66-bde5-04c9f6e948a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:45.502258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aca2ec-d524-4f66-bde5-04c9f6e948a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:45.502529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aca2ec-d524-4f66-bde5-04c9f6e948a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:45.502795 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aca2ec-d524-4f66-bde5-04c9f6e948a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:45.503469 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aca2ec-d524-4f66-bde5-04c9f6e948a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:45.505086 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aca2ec-d524-4f66-bde5-04c9f6e948a1 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:45.516745 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 823/1644] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:33:45.520854 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aca2ec-d524-4f66-bde5-04c9f6e948a1 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:45.531275 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aca2ec-d524-4f66-bde5-04c9f6e948a1 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:45.535892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0201e-1773-450c-a6e3-9a17cc04120b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:45.536480 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0201e-1773-450c-a6e3-9a17cc04120b admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:45.536753 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0201e-1773-450c-a6e3-9a17cc04120b admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:45.537019 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0201e-1773-450c-a6e3-9a17cc04120b admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:45.537919 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0201e-1773-450c-a6e3-9a17cc04120b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:45.543433 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0201e-1773-450c-a6e3-9a17cc04120b admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:45.549811 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 824/1645] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:33:45.553860 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0201e-1773-450c-a6e3-9a17cc04120b admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:45.564015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0201e-1773-450c-a6e3-9a17cc04120b admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:45.569278 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3402d-cf16-4d6c-90a7-1045d759971f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:45.573085 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3402d-cf16-4d6c-90a7-1045d759971f admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:45.573085 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3402d-cf16-4d6c-90a7-1045d759971f admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:45.573085 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3402d-cf16-4d6c-90a7-1045d759971f admin admin] PATH_INFO: `/v3/projects/6a0b18f4410b4b4ab0d15f024a4a1084/users/c4773b9f4e1f42b09a748b317d27207e/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:45.586482 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3402d-cf16-4d6c-90a7-1045d759971f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a0b18f4410b4b4ab0d15f024a4a1084, user_id=c4773b9f4e1f42b09a748b317d27207e, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:45.589507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3402d-cf16-4d6c-90a7-1045d759971f admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:45.817341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 825/1646] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:45 2022] PUT /identity/v3/projects/6a0b18f4410b4b4ab0d15f024a4a1084/users/c4773b9f4e1f42b09a748b317d27207e/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:33:45.827446 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8aab96-f1f4-432f-8b0d-aa1353b8e6d7 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:45.827761 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8aab96-f1f4-432f-8b0d-aa1353b8e6d7 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:45.828038 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8aab96-f1f4-432f-8b0d-aa1353b8e6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:45.855683 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-91753f17-878a-45fe-b7f2-630a9b41d6f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '085478c8189a4584ae58ccc5ce43d71a'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:45.856488 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-91753f17-878a-45fe-b7f2-630a9b41d6f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '085478c8189a4584ae58ccc5ce43d71a'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:45.875109 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-cf8aab96-f1f4-432f-8b0d-aa1353b8e6d7 None None] MFA Rules not processed for user `c4773b9f4e1f42b09a748b317d27207e`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:45.876342 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-cf8aab96-f1f4-432f-8b0d-aa1353b8e6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:45.946595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 826/1647] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:33:45.957962 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8aab96-f1f4-432f-8b0d-aa1353b8e6d7 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:45.959555 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-cf8aab96-f1f4-432f-8b0d-aa1353b8e6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:45.987578 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-91753f17-878a-45fe-b7f2-630a9b41d6f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '085478c8189a4584ae58ccc5ce43d71a'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:46.001816 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-91753f17-878a-45fe-b7f2-630a9b41d6f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '085478c8189a4584ae58ccc5ce43d71a'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:46.002555 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-91753f17-878a-45fe-b7f2-630a9b41d6f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '085478c8189a4584ae58ccc5ce43d71a'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:46.020669 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 822/1648] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:33:45 2022] DELETE /identity/v3/users/085478c8189a4584ae58ccc5ce43d71a => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:33:46.020824 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8aab96-f1f4-432f-8b0d-aa1353b8e6d7 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:46.020935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8e7d5-21ef-49a6-a980-dd7f4c0760f9 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:46.020935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8e7d5-21ef-49a6-a980-dd7f4c0760f9 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:46.020935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8e7d5-21ef-49a6-a980-dd7f4c0760f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:46.040714 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-70b8e7d5-21ef-49a6-a980-dd7f4c0760f9 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:46.041945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-70b8e7d5-21ef-49a6-a980-dd7f4c0760f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:46.071342 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeea523-e910-4111-855b-448ab8ce6e24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:46.071961 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeea523-e910-4111-855b-448ab8ce6e24 service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:46.072237 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeea523-e910-4111-855b-448ab8ce6e24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:46.072506 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeea523-e910-4111-855b-448ab8ce6e24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:46.104509 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 823/1649] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:33:46.114452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8e7d5-21ef-49a6-a980-dd7f4c0760f9 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:46.121765 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-70b8e7d5-21ef-49a6-a980-dd7f4c0760f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:46.135910 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeea523-e910-4111-855b-448ab8ce6e24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:46.137423 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeea523-e910-4111-855b-448ab8ce6e24 service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:46.147601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 827/1650] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:33:46.178876 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8e7d5-21ef-49a6-a980-dd7f4c0760f9 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:46.182671 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca890c6-1b9e-43c2-82de-75b9d578cc4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:46.183614 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca890c6-1b9e-43c2-82de-75b9d578cc4f service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:46.183882 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca890c6-1b9e-43c2-82de-75b9d578cc4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:46.184158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca890c6-1b9e-43c2-82de-75b9d578cc4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:46.193726 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca890c6-1b9e-43c2-82de-75b9d578cc4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:46.195194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca890c6-1b9e-43c2-82de-75b9d578cc4f service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:46.205261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 824/1651] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:33:46.714862 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeea523-e910-4111-855b-448ab8ce6e24 service cinder] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:46.716481 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-dbeea523-e910-4111-855b-448ab8ce6e24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:46.759315 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeea523-e910-4111-855b-448ab8ce6e24 service cinder] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:46.771099 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704e1e3-6cda-4f82-8dab-e078226500ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:46.772532 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704e1e3-6cda-4f82-8dab-e078226500ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:46.773103 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704e1e3-6cda-4f82-8dab-e078226500ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:46.773103 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704e1e3-6cda-4f82-8dab-e078226500ff admin admin] PATH_INFO: `/v3/projects/96d0b6fa732b496a9bb0832feb39ffaa` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:46.774239 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704e1e3-6cda-4f82-8dab-e078226500ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=96d0b6fa732b496a9bb0832feb39ffaa)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:46.776546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704e1e3-6cda-4f82-8dab-e078226500ff admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:46.935461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2704e1e3-6cda-4f82-8dab-e078226500ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96d0b6fa732b496a9bb0832feb39ffaa', 'request_id': 'req-2704e1e3-6cda-4f82-8dab-e078226500ff'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:46.941068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2704e1e3-6cda-4f82-8dab-e078226500ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96d0b6fa732b496a9bb0832feb39ffaa', 'request_id': 'req-2704e1e3-6cda-4f82-8dab-e078226500ff'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:46.948629 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2704e1e3-6cda-4f82-8dab-e078226500ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96d0b6fa732b496a9bb0832feb39ffaa', 'request_id': 'req-2704e1e3-6cda-4f82-8dab-e078226500ff'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:47.003911 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:47.049756 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2704e1e3-6cda-4f82-8dab-e078226500ff admin admin] The token cache is being invalidate because project 96d0b6fa732b496a9bb0832feb39ffaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:33:47.053724 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2704e1e3-6cda-4f82-8dab-e078226500ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:47.053724 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2704e1e3-6cda-4f82-8dab-e078226500ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:47.053724 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 828/1652] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:33:46 2022] DELETE /identity/v3/projects/96d0b6fa732b496a9bb0832feb39ffaa => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:47.056521 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca890c6-1b9e-43c2-82de-75b9d578cc4f service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:47.066797 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca890c6-1b9e-43c2-82de-75b9d578cc4f service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:47.129942 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d46d9-9090-4343-acf6-dc16bbc51c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:47.130577 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d46d9-9090-4343-acf6-dc16bbc51c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:47.131679 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d46d9-9090-4343-acf6-dc16bbc51c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:47.132118 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d46d9-9090-4343-acf6-dc16bbc51c1d admin admin] PATH_INFO: `/v3/users/7b3d229d1fce47faa6e2612114b4e72b` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:47.133946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d46d9-9090-4343-acf6-dc16bbc51c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b3d229d1fce47faa6e2612114b4e72b)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:47.136609 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d46d9-9090-4343-acf6-dc16bbc51c1d admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:47.193313 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:47.339034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a74d46d9-9090-4343-acf6-dc16bbc51c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b3d229d1fce47faa6e2612114b4e72b'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:47.339766 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a74d46d9-9090-4343-acf6-dc16bbc51c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b3d229d1fce47faa6e2612114b4e72b'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:47.466662 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a74d46d9-9090-4343-acf6-dc16bbc51c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b3d229d1fce47faa6e2612114b4e72b'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:47.480563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a74d46d9-9090-4343-acf6-dc16bbc51c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b3d229d1fce47faa6e2612114b4e72b'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:47.481211 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a74d46d9-9090-4343-acf6-dc16bbc51c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b3d229d1fce47faa6e2612114b4e72b'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:47.494385 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 825/1653] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:33:47 2022] DELETE /identity/v3/users/7b3d229d1fce47faa6e2612114b4e72b => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:47.995348 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704e1e3-6cda-4f82-8dab-e078226500ff admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:47.996882 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-2704e1e3-6cda-4f82-8dab-e078226500ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:48.010415 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704e1e3-6cda-4f82-8dab-e078226500ff admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:48.075745 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6a732-9c2a-4509-bad7-906b5a353c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:48.076409 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6a732-9c2a-4509-bad7-906b5a353c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:48.076652 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6a732-9c2a-4509-bad7-906b5a353c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:48.076925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6a732-9c2a-4509-bad7-906b5a353c4f admin admin] PATH_INFO: `/v3/projects/1cbc2696837f44b8a1921f092afd0b34` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:48.078064 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6a732-9c2a-4509-bad7-906b5a353c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cbc2696837f44b8a1921f092afd0b34)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:48.080046 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6a732-9c2a-4509-bad7-906b5a353c4f admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:48.231076 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2fc6a732-9c2a-4509-bad7-906b5a353c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cbc2696837f44b8a1921f092afd0b34', 'request_id': 'req-2fc6a732-9c2a-4509-bad7-906b5a353c4f'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:48.236983 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2fc6a732-9c2a-4509-bad7-906b5a353c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cbc2696837f44b8a1921f092afd0b34', 'request_id': 'req-2fc6a732-9c2a-4509-bad7-906b5a353c4f'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:48.243862 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2fc6a732-9c2a-4509-bad7-906b5a353c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cbc2696837f44b8a1921f092afd0b34', 'request_id': 'req-2fc6a732-9c2a-4509-bad7-906b5a353c4f'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:48.318069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2fc6a732-9c2a-4509-bad7-906b5a353c4f admin admin] The token cache is being invalidate because project 1cbc2696837f44b8a1921f092afd0b34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:33:48.318364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2fc6a732-9c2a-4509-bad7-906b5a353c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:48.319240 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2fc6a732-9c2a-4509-bad7-906b5a353c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:48.320800 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 829/1654] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:33:47 2022] DELETE /identity/v3/projects/1cbc2696837f44b8a1921f092afd0b34 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:48.325738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2f7d3-52ca-4f56-badb-abc00f956c0c None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:48.326237 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2f7d3-52ca-4f56-badb-abc00f956c0c None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:48.326340 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2f7d3-52ca-4f56-badb-abc00f956c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:48.346677 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-5cf2f7d3-52ca-4f56-badb-abc00f956c0c None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:48.347970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-5cf2f7d3-52ca-4f56-badb-abc00f956c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:48.409190 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 826/1655] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:33:48.417483 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe2de4-0ebe-4955-a82a-7a2325621d54 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:48.417846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe2de4-0ebe-4955-a82a-7a2325621d54 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:48.418184 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe2de4-0ebe-4955-a82a-7a2325621d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:48.443133 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-ddbe2de4-0ebe-4955-a82a-7a2325621d54 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:48.444902 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ddbe2de4-0ebe-4955-a82a-7a2325621d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:48.457426 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 830/1656] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:48.461852 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2f7d3-52ca-4f56-badb-abc00f956c0c None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:48.471585 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2f7d3-52ca-4f56-badb-abc00f956c0c None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:48.476987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5835561-0826-46f7-809c-f5f780808d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:48.477594 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5835561-0826-46f7-809c-f5f780808d00 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:48.477874 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5835561-0826-46f7-809c-f5f780808d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:48.478149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5835561-0826-46f7-809c-f5f780808d00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:48.478804 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5835561-0826-46f7-809c-f5f780808d00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:33:48.479142 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5835561-0826-46f7-809c-f5f780808d00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:48.480739 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5835561-0826-46f7-809c-f5f780808d00 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:48.495043 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 827/1657] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:33:48.504121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe2de4-0ebe-4955-a82a-7a2325621d54 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:48.514138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe2de4-0ebe-4955-a82a-7a2325621d54 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:48.519000 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8f4eb-30c2-431f-8296-3f41b26b7a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:48.519606 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8f4eb-30c2-431f-8296-3f41b26b7a8b admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:48.519884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8f4eb-30c2-431f-8296-3f41b26b7a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:48.520157 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8f4eb-30c2-431f-8296-3f41b26b7a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:48.520802 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8f4eb-30c2-431f-8296-3f41b26b7a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:48.522906 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8f4eb-30c2-431f-8296-3f41b26b7a8b admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:48.617884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 831/1658] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:33:48 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:48.622019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5835561-0826-46f7-809c-f5f780808d00 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:48.632380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5835561-0826-46f7-809c-f5f780808d00 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:48.693587 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb9b80-3868-4eea-bb01-db479ef69962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:48.694322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb9b80-3868-4eea-bb01-db479ef69962 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:48.694579 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb9b80-3868-4eea-bb01-db479ef69962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:48.694922 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb9b80-3868-4eea-bb01-db479ef69962 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:48.695487 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb9b80-3868-4eea-bb01-db479ef69962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:48.697421 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb9b80-3868-4eea-bb01-db479ef69962 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:48.751156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:48.885099 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 828/1659] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:33:48 2022] POST /identity/v3/users => generated 288 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:48.889305 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8f4eb-30c2-431f-8296-3f41b26b7a8b admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:48.900601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8f4eb-30c2-431f-8296-3f41b26b7a8b admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:48.905067 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ede342-a9b9-4a5b-88d2-203e9872d2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:48.905719 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ede342-a9b9-4a5b-88d2-203e9872d2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:48.906099 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ede342-a9b9-4a5b-88d2-203e9872d2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:48.906303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ede342-a9b9-4a5b-88d2-203e9872d2d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:48.906993 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ede342-a9b9-4a5b-88d2-203e9872d2d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:48.913798 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ede342-a9b9-4a5b-88d2-203e9872d2d8 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:48.918958 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 832/1660] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:48.922890 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb9b80-3868-4eea-bb01-db479ef69962 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:48.934058 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb9b80-3868-4eea-bb01-db479ef69962 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:48.938914 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663c026-350c-4135-9b93-d891b5e24325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:48.939468 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663c026-350c-4135-9b93-d891b5e24325 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:48.939748 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663c026-350c-4135-9b93-d891b5e24325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:48.940020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663c026-350c-4135-9b93-d891b5e24325 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:48.940664 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663c026-350c-4135-9b93-d891b5e24325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:48.942343 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663c026-350c-4135-9b93-d891b5e24325 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:48.953561 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 829/1661] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:33:48.957589 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ede342-a9b9-4a5b-88d2-203e9872d2d8 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:48.970119 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ede342-a9b9-4a5b-88d2-203e9872d2d8 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:48.974810 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea3f69-26bd-471e-a8f8-62ae1e9caf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:48.975563 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea3f69-26bd-471e-a8f8-62ae1e9caf7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:48.976129 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea3f69-26bd-471e-a8f8-62ae1e9caf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:48.976129 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea3f69-26bd-471e-a8f8-62ae1e9caf7d admin admin] PATH_INFO: `/v3/projects/d97174a6dfe54ccdb5d8a3167350a5aa/users/2a1db958cbf34025bb4df77ead1b3940/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:48.987284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:49.003771 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea3f69-26bd-471e-a8f8-62ae1e9caf7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d97174a6dfe54ccdb5d8a3167350a5aa, user_id=2a1db958cbf34025bb4df77ead1b3940, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:49.008349 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea3f69-26bd-471e-a8f8-62ae1e9caf7d admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:49.105353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 833/1662] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:48 2022] PUT /identity/v3/projects/d97174a6dfe54ccdb5d8a3167350a5aa/users/2a1db958cbf34025bb4df77ead1b3940/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:49.118912 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce1f18-73f0-473f-93b0-e5053a3496ed None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:49.119199 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce1f18-73f0-473f-93b0-e5053a3496ed None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:49.119474 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce1f18-73f0-473f-93b0-e5053a3496ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:49.166748 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-acce1f18-73f0-473f-93b0-e5053a3496ed None None] MFA Rules not processed for user `2a1db958cbf34025bb4df77ead1b3940`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:49.168090 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-acce1f18-73f0-473f-93b0-e5053a3496ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:49.251983 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 830/1663] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:49.258374 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea3f69-26bd-471e-a8f8-62ae1e9caf7d admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:49.324525 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea3f69-26bd-471e-a8f8-62ae1e9caf7d admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:49.329293 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11226c47-134c-42f3-8bad-661619dcb642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:49.332781 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11226c47-134c-42f3-8bad-661619dcb642 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:49.332781 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11226c47-134c-42f3-8bad-661619dcb642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:49.332781 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11226c47-134c-42f3-8bad-661619dcb642 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:49.332781 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11226c47-134c-42f3-8bad-661619dcb642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:49.333217 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11226c47-134c-42f3-8bad-661619dcb642 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:49.482248 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 834/1664] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:33:49 2022] POST /identity/v3/projects => generated 377 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:49.486265 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce1f18-73f0-473f-93b0-e5053a3496ed None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:49.499226 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce1f18-73f0-473f-93b0-e5053a3496ed None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:49.559919 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff0f32-4f8d-4d95-a5d6-1b05a8da4b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:49.560526 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff0f32-4f8d-4d95-a5d6-1b05a8da4b9f admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:49.560808 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff0f32-4f8d-4d95-a5d6-1b05a8da4b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:49.561079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff0f32-4f8d-4d95-a5d6-1b05a8da4b9f admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:49.561704 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff0f32-4f8d-4d95-a5d6-1b05a8da4b9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:49.563671 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff0f32-4f8d-4d95-a5d6-1b05a8da4b9f admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:49.713556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 831/1665] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:33:49 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:49.717682 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11226c47-134c-42f3-8bad-661619dcb642 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:49.728838 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11226c47-134c-42f3-8bad-661619dcb642 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:49.733662 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861af3f-67f0-438a-8c5c-980b90944160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:49.734652 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861af3f-67f0-438a-8c5c-980b90944160 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:49.735034 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861af3f-67f0-438a-8c5c-980b90944160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:49.735330 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861af3f-67f0-438a-8c5c-980b90944160 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:49.736100 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861af3f-67f0-438a-8c5c-980b90944160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:49.737756 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861af3f-67f0-438a-8c5c-980b90944160 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:49.752101 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 835/1666] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:49.757535 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff0f32-4f8d-4d95-a5d6-1b05a8da4b9f admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:49.770403 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff0f32-4f8d-4d95-a5d6-1b05a8da4b9f admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:49.776446 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b13f7-3ede-4a75-9084-af58c5b0b441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:49.777114 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b13f7-3ede-4a75-9084-af58c5b0b441 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:49.777425 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b13f7-3ede-4a75-9084-af58c5b0b441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:49.777724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b13f7-3ede-4a75-9084-af58c5b0b441 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:49.778370 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b13f7-3ede-4a75-9084-af58c5b0b441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:49.780057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b13f7-3ede-4a75-9084-af58c5b0b441 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:49.790402 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 832/1667] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:49.812188 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861af3f-67f0-438a-8c5c-980b90944160 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:49.823562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861af3f-67f0-438a-8c5c-980b90944160 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:49.828272 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea17577-0d39-4508-9f6d-e68940838043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:49.828982 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea17577-0d39-4508-9f6d-e68940838043 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:49.829236 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea17577-0d39-4508-9f6d-e68940838043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:49.834127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea17577-0d39-4508-9f6d-e68940838043 admin admin] PATH_INFO: `/v3/projects/598eb30efa814e6e8cf37897db49d5c3/users/7ee67309f5a64c2bbdfc67edd09348d8/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:49.845267 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea17577-0d39-4508-9f6d-e68940838043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=598eb30efa814e6e8cf37897db49d5c3, user_id=7ee67309f5a64c2bbdfc67edd09348d8, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:49.848069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea17577-0d39-4508-9f6d-e68940838043 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:49.930339 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 836/1668] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:49 2022] PUT /identity/v3/projects/598eb30efa814e6e8cf37897db49d5c3/users/7ee67309f5a64c2bbdfc67edd09348d8/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:33:49.940849 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b101639-f4dc-4159-8928-5341451507b7 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:49.941211 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b101639-f4dc-4159-8928-5341451507b7 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:49.941498 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b101639-f4dc-4159-8928-5341451507b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:49.970312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-6b101639-f4dc-4159-8928-5341451507b7 None None] MFA Rules not processed for user `7ee67309f5a64c2bbdfc67edd09348d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:49.971635 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-6b101639-f4dc-4159-8928-5341451507b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:50.043973 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 833/1669] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:50.048640 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea17577-0d39-4508-9f6d-e68940838043 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:50.115485 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea17577-0d39-4508-9f6d-e68940838043 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:50.120710 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a829e-7e8e-4840-860b-054059ca06c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:50.121315 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a829e-7e8e-4840-860b-054059ca06c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:50.121591 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a829e-7e8e-4840-860b-054059ca06c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:50.121866 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a829e-7e8e-4840-860b-054059ca06c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:50.122509 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a829e-7e8e-4840-860b-054059ca06c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:50.124529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a829e-7e8e-4840-860b-054059ca06c6 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:50.224744 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 837/1670] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:33:50 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:50.227647 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b101639-f4dc-4159-8928-5341451507b7 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:50.238629 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b101639-f4dc-4159-8928-5341451507b7 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:50.306762 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762ef7c-d01b-4e02-aef1-d3045f2d3a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:50.310687 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762ef7c-d01b-4e02-aef1-d3045f2d3a54 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:50.310687 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762ef7c-d01b-4e02-aef1-d3045f2d3a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:50.310687 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:50.310687 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762ef7c-d01b-4e02-aef1-d3045f2d3a54 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:50.311259 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762ef7c-d01b-4e02-aef1-d3045f2d3a54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:50.313401 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762ef7c-d01b-4e02-aef1-d3045f2d3a54 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:50.427403 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 834/1671] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:33:50 2022] POST /identity/v3/users => generated 295 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:50.431906 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a829e-7e8e-4840-860b-054059ca06c6 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:50.442425 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a829e-7e8e-4840-860b-054059ca06c6 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:50.447664 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ace0b-8978-47e1-a32b-23f7efad0cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:50.448282 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ace0b-8978-47e1-a32b-23f7efad0cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:50.448566 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ace0b-8978-47e1-a32b-23f7efad0cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:50.448839 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ace0b-8978-47e1-a32b-23f7efad0cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:50.449505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ace0b-8978-47e1-a32b-23f7efad0cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:50.451145 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ace0b-8978-47e1-a32b-23f7efad0cb7 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:50.461844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 838/1672] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:50.465997 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762ef7c-d01b-4e02-aef1-d3045f2d3a54 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:50.479248 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762ef7c-d01b-4e02-aef1-d3045f2d3a54 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:50.480598 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20ff68-c868-4943-9918-69d3ce9b227f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:50.481237 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20ff68-c868-4943-9918-69d3ce9b227f admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:50.481512 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20ff68-c868-4943-9918-69d3ce9b227f admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:50.481783 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20ff68-c868-4943-9918-69d3ce9b227f admin admin] PATH_INFO: `/v3/projects/6f35b98bcee44920889fdb881550cdb3/users/6de14d780cb1488cbeb8804663bc6988/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:50.497414 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20ff68-c868-4943-9918-69d3ce9b227f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f35b98bcee44920889fdb881550cdb3, user_id=6de14d780cb1488cbeb8804663bc6988, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:50.500357 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20ff68-c868-4943-9918-69d3ce9b227f admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:50.588586 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 835/1673] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:50 2022] PUT /identity/v3/projects/6f35b98bcee44920889fdb881550cdb3/users/6de14d780cb1488cbeb8804663bc6988/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:50.592464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ace0b-8978-47e1-a32b-23f7efad0cb7 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:50.606650 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ace0b-8978-47e1-a32b-23f7efad0cb7 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:50.684718 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228dea7-08e8-4c24-8a6a-e5537e2f29a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:50.685373 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228dea7-08e8-4c24-8a6a-e5537e2f29a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:50.685687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228dea7-08e8-4c24-8a6a-e5537e2f29a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:50.686017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228dea7-08e8-4c24-8a6a-e5537e2f29a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:50.686700 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228dea7-08e8-4c24-8a6a-e5537e2f29a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:50.689505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228dea7-08e8-4c24-8a6a-e5537e2f29a5 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:50.703510 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 839/1674] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:50.708110 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20ff68-c868-4943-9918-69d3ce9b227f admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:50.720266 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20ff68-c868-4943-9918-69d3ce9b227f admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:50.725204 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb948d-246b-4b93-8785-c959dc76b5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:50.726400 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb948d-246b-4b93-8785-c959dc76b5d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:50.726673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb948d-246b-4b93-8785-c959dc76b5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:50.726988 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb948d-246b-4b93-8785-c959dc76b5d4 admin admin] PATH_INFO: `/v3/projects/6f35b98bcee44920889fdb881550cdb3/users/6de14d780cb1488cbeb8804663bc6988/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:50.729179 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb948d-246b-4b93-8785-c959dc76b5d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f35b98bcee44920889fdb881550cdb3, user_id=6de14d780cb1488cbeb8804663bc6988, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:50.732060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb948d-246b-4b93-8785-c959dc76b5d4 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:50.744573 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 836/1675] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:50 2022] PUT /identity/v3/projects/6f35b98bcee44920889fdb881550cdb3/users/6de14d780cb1488cbeb8804663bc6988/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:50.755300 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da62890-9897-45c7-8198-b6f536e93d64 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:50.755583 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da62890-9897-45c7-8198-b6f536e93d64 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:50.755851 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da62890-9897-45c7-8198-b6f536e93d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:50.787663 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-8da62890-9897-45c7-8198-b6f536e93d64 None None] MFA Rules not processed for user `6de14d780cb1488cbeb8804663bc6988`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:50.789558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-8da62890-9897-45c7-8198-b6f536e93d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:50.793456 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:50.892356 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 840/1676] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:51.175571 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb948d-246b-4b93-8785-c959dc76b5d4 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:51.177310 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-73cb948d-246b-4b93-8785-c959dc76b5d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:51.262685 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb948d-246b-4b93-8785-c959dc76b5d4 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:51.266870 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d135ea9-3569-43eb-a4e4-3061a721d7de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:51.267593 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d135ea9-3569-43eb-a4e4-3061a721d7de service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:51.267865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d135ea9-3569-43eb-a4e4-3061a721d7de service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:51.268136 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d135ea9-3569-43eb-a4e4-3061a721d7de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:51.341341 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d135ea9-3569-43eb-a4e4-3061a721d7de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:51.342789 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d135ea9-3569-43eb-a4e4-3061a721d7de service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:51.352489 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 837/1677] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:33:51.461304 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:52.501553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:52.598984 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:53.223391 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:53.719245 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:54.638011 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da62890-9897-45c7-8198-b6f536e93d64 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:54.640506 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-8da62890-9897-45c7-8198-b6f536e93d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:54.656429 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da62890-9897-45c7-8198-b6f536e93d64 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:54.661985 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b06313-e5c5-4148-a3fa-81d464a1c747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:54.663249 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b06313-e5c5-4148-a3fa-81d464a1c747 service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:54.663509 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b06313-e5c5-4148-a3fa-81d464a1c747 service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:54.664068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b06313-e5c5-4148-a3fa-81d464a1c747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:54.756236 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b06313-e5c5-4148-a3fa-81d464a1c747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:54.761021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b06313-e5c5-4148-a3fa-81d464a1c747 service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:54.778444 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 841/1678] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:33:55.068311 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:55.518917 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:56.399779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d135ea9-3569-43eb-a4e4-3061a721d7de service cinder] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:56.403577 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-6d135ea9-3569-43eb-a4e4-3061a721d7de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:56.491185 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d135ea9-3569-43eb-a4e4-3061a721d7de service cinder] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:56.499730 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986fccc-e7df-48c2-895a-8fb4de99fc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:56.499730 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986fccc-e7df-48c2-895a-8fb4de99fc36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:56.499730 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986fccc-e7df-48c2-895a-8fb4de99fc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:56.499730 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986fccc-e7df-48c2-895a-8fb4de99fc36 admin admin] PATH_INFO: `/v3/users/6490cefebe9946ecb1ae99486db82ceb` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:56.500133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986fccc-e7df-48c2-895a-8fb4de99fc36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6490cefebe9946ecb1ae99486db82ceb)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:56.500307 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986fccc-e7df-48c2-895a-8fb4de99fc36 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:56.729744 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b06313-e5c5-4148-a3fa-81d464a1c747 service cinder] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:56.741989 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b06313-e5c5-4148-a3fa-81d464a1c747 service cinder] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:56.752807 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9a797-7e3d-4db6-b671-358838eb1399 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:56.753929 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9a797-7e3d-4db6-b671-358838eb1399 service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:56.754350 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9a797-7e3d-4db6-b671-358838eb1399 service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:56.754940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9a797-7e3d-4db6-b671-358838eb1399 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:56.767558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9a797-7e3d-4db6-b671-358838eb1399 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:56.769897 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9a797-7e3d-4db6-b671-358838eb1399 service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:56.781720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 842/1679] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:33:56.834836 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e986fccc-e7df-48c2-895a-8fb4de99fc36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6490cefebe9946ecb1ae99486db82ceb'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:56.835600 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e986fccc-e7df-48c2-895a-8fb4de99fc36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6490cefebe9946ecb1ae99486db82ceb'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:56.856042 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:56.961060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e986fccc-e7df-48c2-895a-8fb4de99fc36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6490cefebe9946ecb1ae99486db82ceb'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:56.978485 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e986fccc-e7df-48c2-895a-8fb4de99fc36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6490cefebe9946ecb1ae99486db82ceb'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:56.980325 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e986fccc-e7df-48c2-895a-8fb4de99fc36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6490cefebe9946ecb1ae99486db82ceb'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:56.998231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 838/1680] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:33:56 2022] DELETE /identity/v3/users/6490cefebe9946ecb1ae99486db82ceb => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:57.002789 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d64b9-4793-4cf7-b3d6-87beda43e8d9 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:57.003139 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d64b9-4793-4cf7-b3d6-87beda43e8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:57.003418 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d64b9-4793-4cf7-b3d6-87beda43e8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:57.023597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-709d64b9-4793-4cf7-b3d6-87beda43e8d9 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:57.025100 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-709d64b9-4793-4cf7-b3d6-87beda43e8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:57.090786 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:57.134152 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 843/1681] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:57.144413 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986fccc-e7df-48c2-895a-8fb4de99fc36 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:57.145992 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-e986fccc-e7df-48c2-895a-8fb4de99fc36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:57.227073 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986fccc-e7df-48c2-895a-8fb4de99fc36 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:57.231191 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c67a3e-df6b-4969-a476-f690d8a648f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:57.231821 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c67a3e-df6b-4969-a476-f690d8a648f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:57.232085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c67a3e-df6b-4969-a476-f690d8a648f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:57.232347 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c67a3e-df6b-4969-a476-f690d8a648f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:57.242065 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c67a3e-df6b-4969-a476-f690d8a648f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:57.243550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c67a3e-df6b-4969-a476-f690d8a648f4 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:57.253572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 839/1682] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:33:57.678242 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0bdc9-ee6b-4b1e-8431-fa9ed74c9e86 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:57.678555 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0bdc9-ee6b-4b1e-8431-fa9ed74c9e86 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:57.679129 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0bdc9-ee6b-4b1e-8431-fa9ed74c9e86 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:57.680910 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 844/1683] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 19 02:33:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:33:57.712861 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81cae9-27c4-4ad5-adb1-511cf38a3057 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:57.713374 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81cae9-27c4-4ad5-adb1-511cf38a3057 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:57.713449 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81cae9-27c4-4ad5-adb1-511cf38a3057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:57.735284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-5e81cae9-27c4-4ad5-adb1-511cf38a3057 None None] MFA Rules not processed for user `a66b9bc695b44877a06f17ea6bbeb27a`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:57.736401 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-5e81cae9-27c4-4ad5-adb1-511cf38a3057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:57.799683 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 840/1684] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 19 02:33:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:57.811684 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055804a-947a-4fac-9a9a-50e0091dc3ad None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:57.812109 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055804a-947a-4fac-9a9a-50e0091dc3ad None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:57.812201 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055804a-947a-4fac-9a9a-50e0091dc3ad None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:57.813541 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 845/1685] 10.222.0.16 () {54 vars in 961 bytes} [Wed Oct 19 02:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:33:57.820442 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac198b-878f-493b-8381-7678c094e562 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:57.820442 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac198b-878f-493b-8381-7678c094e562 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:57.820442 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac198b-878f-493b-8381-7678c094e562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:57.824257 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055804a-947a-4fac-9a9a-50e0091dc3ad None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:57.826296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-f055804a-947a-4fac-9a9a-50e0091dc3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:57.844313 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-5cac198b-878f-493b-8381-7678c094e562 None None] MFA Rules not processed for user `a66b9bc695b44877a06f17ea6bbeb27a`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:57.845690 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-5cac198b-878f-493b-8381-7678c094e562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:57.847775 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055804a-947a-4fac-9a9a-50e0091dc3ad None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:57.853137 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e08ce-692f-40a0-8d20-e2271362c32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:57.854047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e08ce-692f-40a0-8d20-e2271362c32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:57.854630 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e08ce-692f-40a0-8d20-e2271362c32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:57.854954 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e08ce-692f-40a0-8d20-e2271362c32c admin admin] PATH_INFO: `/v3/projects/672d7135ee9f482eb7070c5f8992f333` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:57.857442 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 841/1686] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 19 02:33:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:33:57.863971 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e08ce-692f-40a0-8d20-e2271362c32c admin admin] RBAC: Authorizing `identity:delete_project(project_id=672d7135ee9f482eb7070c5f8992f333)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:57.866073 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e08ce-692f-40a0-8d20-e2271362c32c admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:57.869055 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac198b-878f-493b-8381-7678c094e562 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:57.879491 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac198b-878f-493b-8381-7678c094e562 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:57.885146 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f6b96-56f3-4b99-80e9-70f9c062dbc8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66b9bc695b44877a06f17ea6bbeb27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:57.886501 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f6b96-56f3-4b99-80e9-70f9c062dbc8 service placement] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:57.886501 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f6b96-56f3-4b99-80e9-70f9c062dbc8 service placement] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:57.886501 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f6b96-56f3-4b99-80e9-70f9c062dbc8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:57.895331 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f6b96-56f3-4b99-80e9-70f9c062dbc8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:57.896935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f6b96-56f3-4b99-80e9-70f9c062dbc8 service placement] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:57.907418 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 842/1687] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:33:57.908216 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f6b96-56f3-4b99-80e9-70f9c062dbc8 service placement] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:57.909502 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-a86f6b96-56f3-4b99-80e9-70f9c062dbc8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:57.923644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f6b96-56f3-4b99-80e9-70f9c062dbc8 service placement] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:57.928783 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc1003-ca32-4188-bf01-64ce75f3f59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:57.929404 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc1003-ca32-4188-bf01-64ce75f3f59f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:57.929682 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc1003-ca32-4188-bf01-64ce75f3f59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:57.929955 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc1003-ca32-4188-bf01-64ce75f3f59f admin admin] PATH_INFO: `/v3/users/c1bb331f86884db48dbe8d2d2f70d15f` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:57.931119 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc1003-ca32-4188-bf01-64ce75f3f59f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1bb331f86884db48dbe8d2d2f70d15f)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:57.933020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc1003-ca32-4188-bf01-64ce75f3f59f admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:57.992443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-0a5e08ce-692f-40a0-8d20-e2271362c32c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '672d7135ee9f482eb7070c5f8992f333', 'request_id': 'req-0a5e08ce-692f-40a0-8d20-e2271362c32c'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:57.998412 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-0a5e08ce-692f-40a0-8d20-e2271362c32c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '672d7135ee9f482eb7070c5f8992f333', 'request_id': 'req-0a5e08ce-692f-40a0-8d20-e2271362c32c'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:58.005641 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-0a5e08ce-692f-40a0-8d20-e2271362c32c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '672d7135ee9f482eb7070c5f8992f333', 'request_id': 'req-0a5e08ce-692f-40a0-8d20-e2271362c32c'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:58.133618 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-0a5e08ce-692f-40a0-8d20-e2271362c32c admin admin] The token cache is being invalidate because project 672d7135ee9f482eb7070c5f8992f333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:33:58.134128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-0a5e08ce-692f-40a0-8d20-e2271362c32c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:58.135692 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-0a5e08ce-692f-40a0-8d20-e2271362c32c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:58.137930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 846/1688] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:33:57 2022] DELETE /identity/v3/projects/672d7135ee9f482eb7070c5f8992f333 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:58.142845 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01c880-a3b4-49c0-a3bd-0482810c71be None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:58.143130 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01c880-a3b4-49c0-a3bd-0482810c71be None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:58.143683 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01c880-a3b4-49c0-a3bd-0482810c71be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:58.161808 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d3bc1003-ca32-4188-bf01-64ce75f3f59f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1bb331f86884db48dbe8d2d2f70d15f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:58.161808 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d3bc1003-ca32-4188-bf01-64ce75f3f59f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1bb331f86884db48dbe8d2d2f70d15f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:58.165358 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-7e01c880-a3b4-49c0-a3bd-0482810c71be None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:58.166770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-7e01c880-a3b4-49c0-a3bd-0482810c71be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:58.234381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 847/1689] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:58.243000 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c58a6b-b1bb-4a3a-8bcc-375daa4cf2b8 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:58.243268 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c58a6b-b1bb-4a3a-8bcc-375daa4cf2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:58.243466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c58a6b-b1bb-4a3a-8bcc-375daa4cf2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:58.256003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d3bc1003-ca32-4188-bf01-64ce75f3f59f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1bb331f86884db48dbe8d2d2f70d15f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:58.264401 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-c7c58a6b-b1bb-4a3a-8bcc-375daa4cf2b8 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:58.265661 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c7c58a6b-b1bb-4a3a-8bcc-375daa4cf2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:58.279233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 848/1690] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:33:58.280439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c58a6b-b1bb-4a3a-8bcc-375daa4cf2b8 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:58.291853 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c58a6b-b1bb-4a3a-8bcc-375daa4cf2b8 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:58.292737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d3bc1003-ca32-4188-bf01-64ce75f3f59f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1bb331f86884db48dbe8d2d2f70d15f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:58.293621 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d3bc1003-ca32-4188-bf01-64ce75f3f59f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1bb331f86884db48dbe8d2d2f70d15f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:58.298629 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fb6ae-28a2-4a3c-8e33-7578fb233596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:58.298629 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fb6ae-28a2-4a3c-8e33-7578fb233596 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:58.298629 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fb6ae-28a2-4a3c-8e33-7578fb233596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:58.298629 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fb6ae-28a2-4a3c-8e33-7578fb233596 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:58.299015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fb6ae-28a2-4a3c-8e33-7578fb233596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:33:58.299112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fb6ae-28a2-4a3c-8e33-7578fb233596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:58.300900 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fb6ae-28a2-4a3c-8e33-7578fb233596 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:58.309752 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 843/1691] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:33:57 2022] DELETE /identity/v3/users/c1bb331f86884db48dbe8d2d2f70d15f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:33:58.316511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 849/1692] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:33:58.321779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc1003-ca32-4188-bf01-64ce75f3f59f admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:58.387095 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc1003-ca32-4188-bf01-64ce75f3f59f admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:58.391783 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63bb05-2502-4e82-b8b9-2c0ac5623ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:58.392419 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63bb05-2502-4e82-b8b9-2c0ac5623ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:58.392698 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63bb05-2502-4e82-b8b9-2c0ac5623ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:58.392971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63bb05-2502-4e82-b8b9-2c0ac5623ff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:58.393635 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63bb05-2502-4e82-b8b9-2c0ac5623ff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:58.395613 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63bb05-2502-4e82-b8b9-2c0ac5623ff3 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:58.556239 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 844/1693] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:33:58 2022] POST /identity/v3/projects => generated 385 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:33:58.560601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fb6ae-28a2-4a3c-8e33-7578fb233596 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:58.572109 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fb6ae-28a2-4a3c-8e33-7578fb233596 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:58.598530 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63bb05-2502-4e82-b8b9-2c0ac5623ff3 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:58.600565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-6e63bb05-2502-4e82-b8b9-2c0ac5623ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:58.651396 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d62930-781c-4ca9-9fef-ebb596a5d7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:58.652870 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d62930-781c-4ca9-9fef-ebb596a5d7c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:58.652870 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d62930-781c-4ca9-9fef-ebb596a5d7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:58.652870 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d62930-781c-4ca9-9fef-ebb596a5d7c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:58.653315 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d62930-781c-4ca9-9fef-ebb596a5d7c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:58.655288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d62930-781c-4ca9-9fef-ebb596a5d7c1 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:58.679931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63bb05-2502-4e82-b8b9-2c0ac5623ff3 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:58.684905 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706871e5-cc0b-4f57-a0a2-64e8a81a3f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:58.685534 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706871e5-cc0b-4f57-a0a2-64e8a81a3f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:58.685820 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706871e5-cc0b-4f57-a0a2-64e8a81a3f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:58.686093 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706871e5-cc0b-4f57-a0a2-64e8a81a3f1a admin admin] PATH_INFO: `/v3/projects/aef20a912464440f86c4660de7c8a1ac` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:58.687234 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706871e5-cc0b-4f57-a0a2-64e8a81a3f1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=aef20a912464440f86c4660de7c8a1ac)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:58.689143 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706871e5-cc0b-4f57-a0a2-64e8a81a3f1a admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:58.777773 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 850/1694] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:33:58 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:58.782776 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d62930-781c-4ca9-9fef-ebb596a5d7c1 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:58.792898 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d62930-781c-4ca9-9fef-ebb596a5d7c1 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:58.797548 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57905b8f-fa68-4b4b-9201-37c340dd1c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:58.798146 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57905b8f-fa68-4b4b-9201-37c340dd1c1e admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:58.798419 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57905b8f-fa68-4b4b-9201-37c340dd1c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:58.798688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57905b8f-fa68-4b4b-9201-37c340dd1c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:58.799360 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57905b8f-fa68-4b4b-9201-37c340dd1c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:58.800938 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57905b8f-fa68-4b4b-9201-37c340dd1c1e admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:58.815966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 851/1695] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:33:58.817016 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57905b8f-fa68-4b4b-9201-37c340dd1c1e admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:58.827795 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57905b8f-fa68-4b4b-9201-37c340dd1c1e admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:58.832675 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699536f-b106-4732-9a98-13e51fc5efda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:58.833260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699536f-b106-4732-9a98-13e51fc5efda admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:58.833570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699536f-b106-4732-9a98-13e51fc5efda admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:58.833842 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699536f-b106-4732-9a98-13e51fc5efda admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:58.834479 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699536f-b106-4732-9a98-13e51fc5efda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:58.836196 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699536f-b106-4732-9a98-13e51fc5efda admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:58.846267 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 852/1696] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:58.850403 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699536f-b106-4732-9a98-13e51fc5efda admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:58.860926 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699536f-b106-4732-9a98-13e51fc5efda admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:58.864006 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-706871e5-cc0b-4f57-a0a2-64e8a81a3f1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aef20a912464440f86c4660de7c8a1ac', 'request_id': 'req-706871e5-cc0b-4f57-a0a2-64e8a81a3f1a'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:58.871231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-706871e5-cc0b-4f57-a0a2-64e8a81a3f1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aef20a912464440f86c4660de7c8a1ac', 'request_id': 'req-706871e5-cc0b-4f57-a0a2-64e8a81a3f1a'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:58.896342 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:58.919384 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c8916-ec62-43f6-b3ec-9055fa36c988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:58.920191 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c8916-ec62-43f6-b3ec-9055fa36c988 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:58.920474 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c8916-ec62-43f6-b3ec-9055fa36c988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:58.920752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c8916-ec62-43f6-b3ec-9055fa36c988 admin admin] PATH_INFO: `/v3/projects/48f847956efe4dffb8a983bbfb3a86e0/users/5e559e8ecb6d4c26a60f668fbfa9411e/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:58.937056 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c8916-ec62-43f6-b3ec-9055fa36c988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48f847956efe4dffb8a983bbfb3a86e0, user_id=5e559e8ecb6d4c26a60f668fbfa9411e, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:58.939915 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c8916-ec62-43f6-b3ec-9055fa36c988 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:58.987694 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-706871e5-cc0b-4f57-a0a2-64e8a81a3f1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aef20a912464440f86c4660de7c8a1ac', 'request_id': 'req-706871e5-cc0b-4f57-a0a2-64e8a81a3f1a'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:59.001065 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-706871e5-cc0b-4f57-a0a2-64e8a81a3f1a admin admin] The token cache is being invalidate because project aef20a912464440f86c4660de7c8a1ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:33:59.001358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-706871e5-cc0b-4f57-a0a2-64e8a81a3f1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:59.002037 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-706871e5-cc0b-4f57-a0a2-64e8a81a3f1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:33:59.003588 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 845/1697] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:33:58 2022] DELETE /identity/v3/projects/aef20a912464440f86c4660de7c8a1ac => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:33:59.008072 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563856d-870d-4e37-9a7e-1338fab20512 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:59.008352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563856d-870d-4e37-9a7e-1338fab20512 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:59.008631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563856d-870d-4e37-9a7e-1338fab20512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:59.029700 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-0563856d-870d-4e37-9a7e-1338fab20512 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:59.030871 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-0563856d-870d-4e37-9a7e-1338fab20512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:59.040426 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 846/1698] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:33:59.047983 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcfcfd-5076-4244-9dde-736e6be6f3c3 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:59.048278 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcfcfd-5076-4244-9dde-736e6be6f3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:59.048602 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcfcfd-5076-4244-9dde-736e6be6f3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:59.057307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 853/1699] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:58 2022] PUT /identity/v3/projects/48f847956efe4dffb8a983bbfb3a86e0/users/5e559e8ecb6d4c26a60f668fbfa9411e/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:33:59.069122 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8460f-c80f-47f5-a323-1a2fc57931d9 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:59.069587 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8460f-c80f-47f5-a323-1a2fc57931d9 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:59.069587 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8460f-c80f-47f5-a323-1a2fc57931d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:59.070622 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-b6dcfcfd-5076-4244-9dde-736e6be6f3c3 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:59.071873 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-b6dcfcfd-5076-4244-9dde-736e6be6f3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:59.097616 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-01d8460f-c80f-47f5-a323-1a2fc57931d9 None None] MFA Rules not processed for user `5e559e8ecb6d4c26a60f668fbfa9411e`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:59.099052 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-01d8460f-c80f-47f5-a323-1a2fc57931d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:59.135315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 847/1700] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:33:59.139602 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcfcfd-5076-4244-9dde-736e6be6f3c3 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:59.150907 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcfcfd-5076-4244-9dde-736e6be6f3c3 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:59.155722 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c249c6-73e9-4f70-8377-4f0e08b1b440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:59.156339 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c249c6-73e9-4f70-8377-4f0e08b1b440 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:59.156621 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c249c6-73e9-4f70-8377-4f0e08b1b440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:59.156897 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c249c6-73e9-4f70-8377-4f0e08b1b440 admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:59.157549 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c249c6-73e9-4f70-8377-4f0e08b1b440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:33:59.157870 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c249c6-73e9-4f70-8377-4f0e08b1b440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:59.159504 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c249c6-73e9-4f70-8377-4f0e08b1b440 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:59.172289 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 848/1701] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:33:59.173875 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 854/1702] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:33:59.176586 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c249c6-73e9-4f70-8377-4f0e08b1b440 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:59.185107 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8460f-c80f-47f5-a323-1a2fc57931d9 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:59.186453 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-01d8460f-c80f-47f5-a323-1a2fc57931d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:59.190024 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c249c6-73e9-4f70-8377-4f0e08b1b440 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:59.194958 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a0071-38b8-4d61-b068-77c277d7def4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:59.195656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a0071-38b8-4d61-b068-77c277d7def4 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:59.195940 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a0071-38b8-4d61-b068-77c277d7def4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:59.196217 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a0071-38b8-4d61-b068-77c277d7def4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:59.197374 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a0071-38b8-4d61-b068-77c277d7def4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:59.198849 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a0071-38b8-4d61-b068-77c277d7def4 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:59.257958 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8460f-c80f-47f5-a323-1a2fc57931d9 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:59.261651 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d089cb-d0c1-40fe-aa44-dd686095a139 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:59.262264 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d089cb-d0c1-40fe-aa44-dd686095a139 service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:59.262544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d089cb-d0c1-40fe-aa44-dd686095a139 service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:59.262866 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d089cb-d0c1-40fe-aa44-dd686095a139 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:59.271904 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d089cb-d0c1-40fe-aa44-dd686095a139 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:59.276300 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d089cb-d0c1-40fe-aa44-dd686095a139 service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:59.283850 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 855/1703] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:33:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:33:59.325280 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:33:59.334245 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 849/1704] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:33:59 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:59.340461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d089cb-d0c1-40fe-aa44-dd686095a139 service cinder] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:59.357649 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d089cb-d0c1-40fe-aa44-dd686095a139 service cinder] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:59.436504 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95675de-d780-47e5-86be-b7c53a4dc02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:59.437218 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95675de-d780-47e5-86be-b7c53a4dc02b admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:59.437502 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95675de-d780-47e5-86be-b7c53a4dc02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:59.437784 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95675de-d780-47e5-86be-b7c53a4dc02b admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:59.438411 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95675de-d780-47e5-86be-b7c53a4dc02b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:59.440365 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95675de-d780-47e5-86be-b7c53a4dc02b admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:59.536359 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 856/1705] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:33:59 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:33:59.540762 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a0071-38b8-4d61-b068-77c277d7def4 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:59.550968 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a0071-38b8-4d61-b068-77c277d7def4 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:59.556162 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683df94-41b1-4593-8984-65fb15d8c753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:59.562480 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683df94-41b1-4593-8984-65fb15d8c753 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:59.562480 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683df94-41b1-4593-8984-65fb15d8c753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:59.562480 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683df94-41b1-4593-8984-65fb15d8c753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:59.562480 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683df94-41b1-4593-8984-65fb15d8c753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:59.562480 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683df94-41b1-4593-8984-65fb15d8c753 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:59.569630 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 850/1706] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:59.573689 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95675de-d780-47e5-86be-b7c53a4dc02b admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:59.583970 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95675de-d780-47e5-86be-b7c53a4dc02b admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:59.591121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a00744-d883-4c4e-88d0-6b43c18ebec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:59.591121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a00744-d883-4c4e-88d0-6b43c18ebec0 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:59.591121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a00744-d883-4c4e-88d0-6b43c18ebec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:59.591121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a00744-d883-4c4e-88d0-6b43c18ebec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:59.591472 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a00744-d883-4c4e-88d0-6b43c18ebec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:59.592376 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a00744-d883-4c4e-88d0-6b43c18ebec0 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:59.602922 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 857/1707] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:33:59.607459 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683df94-41b1-4593-8984-65fb15d8c753 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:33:59.618282 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683df94-41b1-4593-8984-65fb15d8c753 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:33:59.629116 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40b33d-f17b-4cac-854d-7b6dd0360ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:33:59.629116 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40b33d-f17b-4cac-854d-7b6dd0360ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:59.629116 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40b33d-f17b-4cac-854d-7b6dd0360ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:59.629116 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40b33d-f17b-4cac-854d-7b6dd0360ffc admin admin] PATH_INFO: `/v3/projects/b945879624a94ba980b5ae1764e1b2ac/users/765792db4c7a443c80c555e4c39f189d/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:59.639676 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40b33d-f17b-4cac-854d-7b6dd0360ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b945879624a94ba980b5ae1764e1b2ac, user_id=765792db4c7a443c80c555e4c39f189d, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:33:59.642378 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40b33d-f17b-4cac-854d-7b6dd0360ffc admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:33:59.833627 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 851/1708] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:33:59 2022] PUT /identity/v3/projects/b945879624a94ba980b5ae1764e1b2ac/users/765792db4c7a443c80c555e4c39f189d/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:33:59.843955 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea9bcd-3624-4a95-b7a1-fee57603c689 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:33:59.844429 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea9bcd-3624-4a95-b7a1-fee57603c689 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:33:59.844519 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea9bcd-3624-4a95-b7a1-fee57603c689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:33:59.874439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-45ea9bcd-3624-4a95-b7a1-fee57603c689 None None] MFA Rules not processed for user `765792db4c7a443c80c555e4c39f189d`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:33:59.875671 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-45ea9bcd-3624-4a95-b7a1-fee57603c689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:33:59.941655 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 858/1709] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:33:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:33:59.946616 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40b33d-f17b-4cac-854d-7b6dd0360ffc admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:00.019487 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40b33d-f17b-4cac-854d-7b6dd0360ffc admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:00.026451 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf007b2-f0e9-48a4-8831-622ad7d8e97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:00.027104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf007b2-f0e9-48a4-8831-622ad7d8e97f admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:00.027396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf007b2-f0e9-48a4-8831-622ad7d8e97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:00.027674 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf007b2-f0e9-48a4-8831-622ad7d8e97f admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:00.028382 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf007b2-f0e9-48a4-8831-622ad7d8e97f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:00.030384 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf007b2-f0e9-48a4-8831-622ad7d8e97f admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:00.143126 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 852/1710] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:33:59 2022] POST /identity/v3/projects => generated 373 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:00.147194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea9bcd-3624-4a95-b7a1-fee57603c689 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:00.159084 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea9bcd-3624-4a95-b7a1-fee57603c689 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:00.235503 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eabb751-f3fc-45e1-bb4f-39fabedacf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:00.236115 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabb751-f3fc-45e1-bb4f-39fabedacf73 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:00.236389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabb751-f3fc-45e1-bb4f-39fabedacf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:00.236699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabb751-f3fc-45e1-bb4f-39fabedacf73 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:00.237337 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eabb751-f3fc-45e1-bb4f-39fabedacf73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:00.239432 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eabb751-f3fc-45e1-bb4f-39fabedacf73 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:00.325709 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 859/1711] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:34:00 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:00.329522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf007b2-f0e9-48a4-8831-622ad7d8e97f admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:00.340718 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf007b2-f0e9-48a4-8831-622ad7d8e97f admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:00.345342 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57840be5-28cb-4269-9a3c-6565227d698c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:00.345939 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57840be5-28cb-4269-9a3c-6565227d698c admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:00.363668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57840be5-28cb-4269-9a3c-6565227d698c admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:00.363668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57840be5-28cb-4269-9a3c-6565227d698c admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:00.363668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57840be5-28cb-4269-9a3c-6565227d698c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:00.363668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57840be5-28cb-4269-9a3c-6565227d698c admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:00.363668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 853/1712] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:00.367040 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eabb751-f3fc-45e1-bb4f-39fabedacf73 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:00.377722 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eabb751-f3fc-45e1-bb4f-39fabedacf73 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:00.386887 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4384c7-fd7c-4f73-b6b0-df88ba640762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:00.388432 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4384c7-fd7c-4f73-b6b0-df88ba640762 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:00.388432 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4384c7-fd7c-4f73-b6b0-df88ba640762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:00.388432 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4384c7-fd7c-4f73-b6b0-df88ba640762 admin admin] PATH_INFO: `/v3/projects/e5f2ba4185294dae9ed44cccd53f12c7/users/ad536ce6355b482990c66a6e93525eea/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:00.406661 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4384c7-fd7c-4f73-b6b0-df88ba640762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5f2ba4185294dae9ed44cccd53f12c7, user_id=ad536ce6355b482990c66a6e93525eea, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:00.411539 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4384c7-fd7c-4f73-b6b0-df88ba640762 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:00.538730 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 860/1713] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:00 2022] PUT /identity/v3/projects/e5f2ba4185294dae9ed44cccd53f12c7/users/ad536ce6355b482990c66a6e93525eea/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:00.543186 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:00.547748 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57840be5-28cb-4269-9a3c-6565227d698c admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:00.557041 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57840be5-28cb-4269-9a3c-6565227d698c admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:00.617100 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d40fd-5ed5-4a23-af98-843e8d3a1983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:00.617716 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d40fd-5ed5-4a23-af98-843e8d3a1983 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:00.617998 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d40fd-5ed5-4a23-af98-843e8d3a1983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:00.618271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d40fd-5ed5-4a23-af98-843e8d3a1983 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:00.618952 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d40fd-5ed5-4a23-af98-843e8d3a1983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:00.620566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d40fd-5ed5-4a23-af98-843e8d3a1983 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:00.630351 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 854/1714] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:34:00.635093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4384c7-fd7c-4f73-b6b0-df88ba640762 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:00.645473 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4384c7-fd7c-4f73-b6b0-df88ba640762 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:00.651376 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfa4ab-6068-46cf-943b-c8d2a4552bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:00.652045 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfa4ab-6068-46cf-943b-c8d2a4552bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:00.652317 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfa4ab-6068-46cf-943b-c8d2a4552bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:00.652583 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfa4ab-6068-46cf-943b-c8d2a4552bb0 admin admin] PATH_INFO: `/v3/projects/e5f2ba4185294dae9ed44cccd53f12c7/users/ad536ce6355b482990c66a6e93525eea/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:00.654645 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdfa4ab-6068-46cf-943b-c8d2a4552bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5f2ba4185294dae9ed44cccd53f12c7, user_id=ad536ce6355b482990c66a6e93525eea, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:00.657907 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdfa4ab-6068-46cf-943b-c8d2a4552bb0 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:00.670225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 861/1715] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:00 2022] PUT /identity/v3/projects/e5f2ba4185294dae9ed44cccd53f12c7/users/ad536ce6355b482990c66a6e93525eea/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:00.682043 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e2558-ba67-45ae-ad95-06dde7907d63 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:00.682356 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e2558-ba67-45ae-ad95-06dde7907d63 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:00.682708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e2558-ba67-45ae-ad95-06dde7907d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:00.711132 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-f16e2558-ba67-45ae-ad95-06dde7907d63 None None] MFA Rules not processed for user `ad536ce6355b482990c66a6e93525eea`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:00.712331 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-f16e2558-ba67-45ae-ad95-06dde7907d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:00.786727 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 855/1716] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:00.839816 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:00.923620 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfa4ab-6068-46cf-943b-c8d2a4552bb0 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:00.925666 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-fbdfa4ab-6068-46cf-943b-c8d2a4552bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:00.990464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfa4ab-6068-46cf-943b-c8d2a4552bb0 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:00.994883 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c160abb-8430-4a6d-b988-da2243259d2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:00.995524 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c160abb-8430-4a6d-b988-da2243259d2b service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:00.995794 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c160abb-8430-4a6d-b988-da2243259d2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:00.996065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c160abb-8430-4a6d-b988-da2243259d2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:01.006168 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c160abb-8430-4a6d-b988-da2243259d2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:01.008222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c160abb-8430-4a6d-b988-da2243259d2b service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:01.018410 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 862/1717] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:34:01.165313 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:01.410872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:01.885208 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:02.004513 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e2558-ba67-45ae-ad95-06dde7907d63 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:02.006170 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-f16e2558-ba67-45ae-ad95-06dde7907d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:02.076888 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e2558-ba67-45ae-ad95-06dde7907d63 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:02.082846 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97c2e0-cd94-49e8-aad0-85ca18ee9980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:02.083562 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97c2e0-cd94-49e8-aad0-85ca18ee9980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:02.083911 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97c2e0-cd94-49e8-aad0-85ca18ee9980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:02.084241 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97c2e0-cd94-49e8-aad0-85ca18ee9980 admin admin] PATH_INFO: `/v3/users/2a1db958cbf34025bb4df77ead1b3940` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:02.085813 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97c2e0-cd94-49e8-aad0-85ca18ee9980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1db958cbf34025bb4df77ead1b3940)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:02.087826 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97c2e0-cd94-49e8-aad0-85ca18ee9980 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:02.136241 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:02.206963 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c160abb-8430-4a6d-b988-da2243259d2b service cinder] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:02.218856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c160abb-8430-4a6d-b988-da2243259d2b service cinder] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:02.224204 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cf958-f6e7-4fb8-b525-6d616c6d6517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:02.225047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cf958-f6e7-4fb8-b525-6d616c6d6517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:02.225255 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cf958-f6e7-4fb8-b525-6d616c6d6517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:02.225570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cf958-f6e7-4fb8-b525-6d616c6d6517 admin admin] PATH_INFO: `/v3/users/765792db4c7a443c80c555e4c39f189d` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:02.227538 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cf958-f6e7-4fb8-b525-6d616c6d6517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=765792db4c7a443c80c555e4c39f189d)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:02.229523 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cf958-f6e7-4fb8-b525-6d616c6d6517 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:02.317134 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2c97c2e0-cd94-49e8-aad0-85ca18ee9980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1db958cbf34025bb4df77ead1b3940'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:02.317784 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2c97c2e0-cd94-49e8-aad0-85ca18ee9980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1db958cbf34025bb4df77ead1b3940'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:02.392864 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2c97c2e0-cd94-49e8-aad0-85ca18ee9980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1db958cbf34025bb4df77ead1b3940'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:02.406735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2c97c2e0-cd94-49e8-aad0-85ca18ee9980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1db958cbf34025bb4df77ead1b3940'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:02.407442 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2c97c2e0-cd94-49e8-aad0-85ca18ee9980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1db958cbf34025bb4df77ead1b3940'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:02.420572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 856/1718] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:34:02 2022] DELETE /identity/v3/users/2a1db958cbf34025bb4df77ead1b3940 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:02.424774 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb48db3-3363-4127-8a50-e4d3c46580a3 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:02.425059 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb48db3-3363-4127-8a50-e4d3c46580a3 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:02.425334 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb48db3-3363-4127-8a50-e4d3c46580a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:02.444262 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-fbb48db3-3363-4127-8a50-e4d3c46580a3 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:02.445918 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-fbb48db3-3363-4127-8a50-e4d3c46580a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:02.453695 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-8a4cf958-f6e7-4fb8-b525-6d616c6d6517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '765792db4c7a443c80c555e4c39f189d'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:02.454334 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-8a4cf958-f6e7-4fb8-b525-6d616c6d6517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '765792db4c7a443c80c555e4c39f189d'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:02.505013 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 857/1719] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:34:02.508144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-8a4cf958-f6e7-4fb8-b525-6d616c6d6517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '765792db4c7a443c80c555e4c39f189d'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:02.516141 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-8a4cf958-f6e7-4fb8-b525-6d616c6d6517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '765792db4c7a443c80c555e4c39f189d'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:02.519847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb48db3-3363-4127-8a50-e4d3c46580a3 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:02.519963 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-8a4cf958-f6e7-4fb8-b525-6d616c6d6517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '765792db4c7a443c80c555e4c39f189d'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:02.520068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-fbb48db3-3363-4127-8a50-e4d3c46580a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:02.535467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 863/1720] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:34:02 2022] DELETE /identity/v3/users/765792db4c7a443c80c555e4c39f189d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:02.540392 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35fecd-cd87-4241-bc87-80d5734f9be1 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:02.540736 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35fecd-cd87-4241-bc87-80d5734f9be1 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:02.541071 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35fecd-cd87-4241-bc87-80d5734f9be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:02.560429 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-eb35fecd-cd87-4241-bc87-80d5734f9be1 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:02.561625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-eb35fecd-cd87-4241-bc87-80d5734f9be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:02.580468 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb48db3-3363-4127-8a50-e4d3c46580a3 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:02.622292 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 864/1721] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:02.630045 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5983b-599d-4a3d-a274-a2cf97638a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:02.630758 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5983b-599d-4a3d-a274-a2cf97638a75 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:02.631135 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5983b-599d-4a3d-a274-a2cf97638a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:02.631414 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5983b-599d-4a3d-a274-a2cf97638a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:02.633559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35fecd-cd87-4241-bc87-80d5734f9be1 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:02.646018 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5983b-599d-4a3d-a274-a2cf97638a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:02.660148 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5983b-599d-4a3d-a274-a2cf97638a75 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:02.660253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35fecd-cd87-4241-bc87-80d5734f9be1 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:02.660253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778d3e7-47bd-485e-b39d-9cf19ba004fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:02.660253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778d3e7-47bd-485e-b39d-9cf19ba004fa service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:02.660253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778d3e7-47bd-485e-b39d-9cf19ba004fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:02.660595 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 858/1722] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:34:02.660686 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778d3e7-47bd-485e-b39d-9cf19ba004fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:02.672018 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778d3e7-47bd-485e-b39d-9cf19ba004fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:02.673946 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778d3e7-47bd-485e-b39d-9cf19ba004fa service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:02.684956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 865/1723] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:34:02.797520 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:02.896878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:02.966545 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:03.352821 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5983b-599d-4a3d-a274-a2cf97638a75 service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:03.354407 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-57d5983b-599d-4a3d-a274-a2cf97638a75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:03.380743 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5983b-599d-4a3d-a274-a2cf97638a75 service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:03.387956 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126f25f-0665-45b7-a521-c9fc438a1204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:03.388731 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126f25f-0665-45b7-a521-c9fc438a1204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:03.389010 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126f25f-0665-45b7-a521-c9fc438a1204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:03.389287 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126f25f-0665-45b7-a521-c9fc438a1204 admin admin] PATH_INFO: `/v3/projects/b945879624a94ba980b5ae1764e1b2ac` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:03.390537 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126f25f-0665-45b7-a521-c9fc438a1204 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b945879624a94ba980b5ae1764e1b2ac)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:03.392520 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126f25f-0665-45b7-a521-c9fc438a1204 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:03.411404 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778d3e7-47bd-485e-b39d-9cf19ba004fa service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:03.413975 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-b778d3e7-47bd-485e-b39d-9cf19ba004fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:03.427845 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778d3e7-47bd-485e-b39d-9cf19ba004fa service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:03.434065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c42d2-8eca-4e3d-9b69-ccfdeb693ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:03.434991 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c42d2-8eca-4e3d-9b69-ccfdeb693ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:03.435271 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c42d2-8eca-4e3d-9b69-ccfdeb693ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:03.435543 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c42d2-8eca-4e3d-9b69-ccfdeb693ea2 admin admin] PATH_INFO: `/v3/projects/d97174a6dfe54ccdb5d8a3167350a5aa` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:03.443283 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c42d2-8eca-4e3d-9b69-ccfdeb693ea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d97174a6dfe54ccdb5d8a3167350a5aa)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:03.443283 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c42d2-8eca-4e3d-9b69-ccfdeb693ea2 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:03.565814 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-5126f25f-0665-45b7-a521-c9fc438a1204 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b945879624a94ba980b5ae1764e1b2ac', 'request_id': 'req-5126f25f-0665-45b7-a521-c9fc438a1204'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:03.571788 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-5126f25f-0665-45b7-a521-c9fc438a1204 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b945879624a94ba980b5ae1764e1b2ac', 'request_id': 'req-5126f25f-0665-45b7-a521-c9fc438a1204'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:03.629786 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b18c42d2-8eca-4e3d-9b69-ccfdeb693ea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd97174a6dfe54ccdb5d8a3167350a5aa', 'request_id': 'req-b18c42d2-8eca-4e3d-9b69-ccfdeb693ea2'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:03.635690 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b18c42d2-8eca-4e3d-9b69-ccfdeb693ea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd97174a6dfe54ccdb5d8a3167350a5aa', 'request_id': 'req-b18c42d2-8eca-4e3d-9b69-ccfdeb693ea2'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:03.642106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b18c42d2-8eca-4e3d-9b69-ccfdeb693ea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd97174a6dfe54ccdb5d8a3167350a5aa', 'request_id': 'req-b18c42d2-8eca-4e3d-9b69-ccfdeb693ea2'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:03.684868 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-5126f25f-0665-45b7-a521-c9fc438a1204 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b945879624a94ba980b5ae1764e1b2ac', 'request_id': 'req-5126f25f-0665-45b7-a521-c9fc438a1204'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:03.697549 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-5126f25f-0665-45b7-a521-c9fc438a1204 admin admin] The token cache is being invalidate because project b945879624a94ba980b5ae1764e1b2ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:34:03.697874 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-5126f25f-0665-45b7-a521-c9fc438a1204 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:03.698524 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-5126f25f-0665-45b7-a521-c9fc438a1204 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:03.700128 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 859/1724] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:34:03 2022] DELETE /identity/v3/projects/b945879624a94ba980b5ae1764e1b2ac => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:34:03.704166 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126f25f-0665-45b7-a521-c9fc438a1204 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:03.705625 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-5126f25f-0665-45b7-a521-c9fc438a1204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:03.771186 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126f25f-0665-45b7-a521-c9fc438a1204 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:03.829106 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df91d6-0eb9-4b2b-9fb3-83d88464fcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:03.829737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df91d6-0eb9-4b2b-9fb3-83d88464fcfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:03.830017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df91d6-0eb9-4b2b-9fb3-83d88464fcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:03.830287 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df91d6-0eb9-4b2b-9fb3-83d88464fcfa admin admin] PATH_INFO: `/v3/users/ad536ce6355b482990c66a6e93525eea` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:03.831491 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df91d6-0eb9-4b2b-9fb3-83d88464fcfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad536ce6355b482990c66a6e93525eea)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:03.833409 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df91d6-0eb9-4b2b-9fb3-83d88464fcfa admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:03.935450 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b18c42d2-8eca-4e3d-9b69-ccfdeb693ea2 admin admin] The token cache is being invalidate because project d97174a6dfe54ccdb5d8a3167350a5aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:34:03.935746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b18c42d2-8eca-4e3d-9b69-ccfdeb693ea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:03.936399 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b18c42d2-8eca-4e3d-9b69-ccfdeb693ea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:03.938804 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 866/1725] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:34:03 2022] DELETE /identity/v3/projects/d97174a6dfe54ccdb5d8a3167350a5aa => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:34:03.941619 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c42d2-8eca-4e3d-9b69-ccfdeb693ea2 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:03.942878 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-b18c42d2-8eca-4e3d-9b69-ccfdeb693ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:03.956043 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c42d2-8eca-4e3d-9b69-ccfdeb693ea2 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:03.961196 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c6c9e-cafd-43b7-98a5-038c6a13b6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:03.961819 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c6c9e-cafd-43b7-98a5-038c6a13b6f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:03.962104 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c6c9e-cafd-43b7-98a5-038c6a13b6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:03.962382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c6c9e-cafd-43b7-98a5-038c6a13b6f3 admin admin] PATH_INFO: `/v3/users/7ee67309f5a64c2bbdfc67edd09348d8` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:03.963649 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c6c9e-cafd-43b7-98a5-038c6a13b6f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ee67309f5a64c2bbdfc67edd09348d8)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:03.978953 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c6c9e-cafd-43b7-98a5-038c6a13b6f3 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:04.168031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-47df91d6-0eb9-4b2b-9fb3-83d88464fcfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad536ce6355b482990c66a6e93525eea'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:04.168737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-47df91d6-0eb9-4b2b-9fb3-83d88464fcfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad536ce6355b482990c66a6e93525eea'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:04.330638 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-47df91d6-0eb9-4b2b-9fb3-83d88464fcfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad536ce6355b482990c66a6e93525eea'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:04.345367 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-47df91d6-0eb9-4b2b-9fb3-83d88464fcfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad536ce6355b482990c66a6e93525eea'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:04.345622 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-748c6c9e-cafd-43b7-98a5-038c6a13b6f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ee67309f5a64c2bbdfc67edd09348d8'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:04.346049 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-47df91d6-0eb9-4b2b-9fb3-83d88464fcfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad536ce6355b482990c66a6e93525eea'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:04.346370 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-748c6c9e-cafd-43b7-98a5-038c6a13b6f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ee67309f5a64c2bbdfc67edd09348d8'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:04.353657 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:04.360718 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 860/1726] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:34:03 2022] DELETE /identity/v3/users/ad536ce6355b482990c66a6e93525eea => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:34:04.393779 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-748c6c9e-cafd-43b7-98a5-038c6a13b6f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ee67309f5a64c2bbdfc67edd09348d8'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:04.396584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:04.405666 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-748c6c9e-cafd-43b7-98a5-038c6a13b6f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ee67309f5a64c2bbdfc67edd09348d8'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:04.407218 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-748c6c9e-cafd-43b7-98a5-038c6a13b6f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ee67309f5a64c2bbdfc67edd09348d8'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:04.429796 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 867/1727] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:34:03 2022] DELETE /identity/v3/users/7ee67309f5a64c2bbdfc67edd09348d8 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:04.879622 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df91d6-0eb9-4b2b-9fb3-83d88464fcfa admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:04.881774 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-47df91d6-0eb9-4b2b-9fb3-83d88464fcfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:04.939085 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c6c9e-cafd-43b7-98a5-038c6a13b6f3 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:04.941612 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-748c6c9e-cafd-43b7-98a5-038c6a13b6f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:04.972433 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df91d6-0eb9-4b2b-9fb3-83d88464fcfa admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:05.055457 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c6c9e-cafd-43b7-98a5-038c6a13b6f3 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:05.056888 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7015556-fbb6-4647-8dc3-6cadd9639cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:05.057807 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7015556-fbb6-4647-8dc3-6cadd9639cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:05.058296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7015556-fbb6-4647-8dc3-6cadd9639cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:05.059014 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7015556-fbb6-4647-8dc3-6cadd9639cb7 admin admin] PATH_INFO: `/v3/projects/598eb30efa814e6e8cf37897db49d5c3` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:05.060665 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7015556-fbb6-4647-8dc3-6cadd9639cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=598eb30efa814e6e8cf37897db49d5c3)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:05.063917 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7015556-fbb6-4647-8dc3-6cadd9639cb7 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:05.069199 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f55e96-41d6-47b2-bfa7-4a9eb0a5f58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:05.069671 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f55e96-41d6-47b2-bfa7-4a9eb0a5f58c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:05.069671 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f55e96-41d6-47b2-bfa7-4a9eb0a5f58c admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:05.070459 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f55e96-41d6-47b2-bfa7-4a9eb0a5f58c admin admin] PATH_INFO: `/v3/projects/e5f2ba4185294dae9ed44cccd53f12c7` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:05.072749 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f55e96-41d6-47b2-bfa7-4a9eb0a5f58c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5f2ba4185294dae9ed44cccd53f12c7)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:05.074200 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f55e96-41d6-47b2-bfa7-4a9eb0a5f58c admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:05.218654 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-c7015556-fbb6-4647-8dc3-6cadd9639cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '598eb30efa814e6e8cf37897db49d5c3', 'request_id': 'req-c7015556-fbb6-4647-8dc3-6cadd9639cb7'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:05.223165 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-28f55e96-41d6-47b2-bfa7-4a9eb0a5f58c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5f2ba4185294dae9ed44cccd53f12c7', 'request_id': 'req-28f55e96-41d6-47b2-bfa7-4a9eb0a5f58c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:05.229737 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-c7015556-fbb6-4647-8dc3-6cadd9639cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '598eb30efa814e6e8cf37897db49d5c3', 'request_id': 'req-c7015556-fbb6-4647-8dc3-6cadd9639cb7'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:05.239720 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-28f55e96-41d6-47b2-bfa7-4a9eb0a5f58c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5f2ba4185294dae9ed44cccd53f12c7', 'request_id': 'req-28f55e96-41d6-47b2-bfa7-4a9eb0a5f58c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:05.239960 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-c7015556-fbb6-4647-8dc3-6cadd9639cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '598eb30efa814e6e8cf37897db49d5c3', 'request_id': 'req-c7015556-fbb6-4647-8dc3-6cadd9639cb7'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:05.342897 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-c7015556-fbb6-4647-8dc3-6cadd9639cb7 admin admin] The token cache is being invalidate because project 598eb30efa814e6e8cf37897db49d5c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:34:05.343200 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-c7015556-fbb6-4647-8dc3-6cadd9639cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:05.344074 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-c7015556-fbb6-4647-8dc3-6cadd9639cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:05.345693 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 868/1728] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:34:04 2022] DELETE /identity/v3/projects/598eb30efa814e6e8cf37897db49d5c3 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:05.349866 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7015556-fbb6-4647-8dc3-6cadd9639cb7 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:05.351966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c7015556-fbb6-4647-8dc3-6cadd9639cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:05.411293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-28f55e96-41d6-47b2-bfa7-4a9eb0a5f58c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5f2ba4185294dae9ed44cccd53f12c7', 'request_id': 'req-28f55e96-41d6-47b2-bfa7-4a9eb0a5f58c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:05.430606 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-28f55e96-41d6-47b2-bfa7-4a9eb0a5f58c admin admin] The token cache is being invalidate because project e5f2ba4185294dae9ed44cccd53f12c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:34:05.431023 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-28f55e96-41d6-47b2-bfa7-4a9eb0a5f58c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:05.431728 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-28f55e96-41d6-47b2-bfa7-4a9eb0a5f58c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:05.433487 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 861/1729] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:34:04 2022] DELETE /identity/v3/projects/e5f2ba4185294dae9ed44cccd53f12c7 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:05.438370 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f6e34-ffa6-42ff-b86d-977cd35c49bb None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:05.438895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f6e34-ffa6-42ff-b86d-977cd35c49bb None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:05.439172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f6e34-ffa6-42ff-b86d-977cd35c49bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:05.457550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7015556-fbb6-4647-8dc3-6cadd9639cb7 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:05.464311 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1cd1c-1049-40e1-9682-eaadc8bd5e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:05.464971 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1cd1c-1049-40e1-9682-eaadc8bd5e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:05.465166 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-d90f6e34-ffa6-42ff-b86d-977cd35c49bb None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:05.465401 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1cd1c-1049-40e1-9682-eaadc8bd5e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:05.465625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1cd1c-1049-40e1-9682-eaadc8bd5e4a admin admin] PATH_INFO: `/v3/users/6de14d780cb1488cbeb8804663bc6988` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:05.466422 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-d90f6e34-ffa6-42ff-b86d-977cd35c49bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:05.466889 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1cd1c-1049-40e1-9682-eaadc8bd5e4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6de14d780cb1488cbeb8804663bc6988)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:05.468872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1cd1c-1049-40e1-9682-eaadc8bd5e4a admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:05.475141 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 862/1730] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:34:05.492967 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e3ba2-de9c-478b-ab72-be4a32dab871 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:05.493443 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e3ba2-de9c-478b-ab72-be4a32dab871 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:05.494056 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e3ba2-de9c-478b-ab72-be4a32dab871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:05.524199 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-5b6e3ba2-de9c-478b-ab72-be4a32dab871 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:05.525437 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-5b6e3ba2-de9c-478b-ab72-be4a32dab871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:05.533382 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 863/1731] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:34:05.537501 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e3ba2-de9c-478b-ab72-be4a32dab871 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:05.548378 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e3ba2-de9c-478b-ab72-be4a32dab871 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:05.553444 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4e8f7-7e16-483a-ab4a-1128bf5e2ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:05.555132 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4e8f7-7e16-483a-ab4a-1128bf5e2ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:05.555132 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4e8f7-7e16-483a-ab4a-1128bf5e2ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:05.561315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4e8f7-7e16-483a-ab4a-1128bf5e2ac1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:05.561315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4e8f7-7e16-483a-ab4a-1128bf5e2ac1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:34:05.561315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4e8f7-7e16-483a-ab4a-1128bf5e2ac1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:05.561315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4e8f7-7e16-483a-ab4a-1128bf5e2ac1 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:05.569918 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 864/1732] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:34:05.574759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4e8f7-7e16-483a-ab4a-1128bf5e2ac1 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:05.584621 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4e8f7-7e16-483a-ab4a-1128bf5e2ac1 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:05.590145 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78f600-4dd0-4a1a-85b6-8957ad03bd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:05.590723 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78f600-4dd0-4a1a-85b6-8957ad03bd98 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:05.592409 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78f600-4dd0-4a1a-85b6-8957ad03bd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:05.592409 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78f600-4dd0-4a1a-85b6-8957ad03bd98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:05.592409 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78f600-4dd0-4a1a-85b6-8957ad03bd98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:05.593986 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78f600-4dd0-4a1a-85b6-8957ad03bd98 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:05.687661 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 865/1733] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:34:05 2022] POST /identity/v3/projects => generated 355 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:34:05.691794 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78f600-4dd0-4a1a-85b6-8957ad03bd98 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:05.755591 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78f600-4dd0-4a1a-85b6-8957ad03bd98 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:05.756644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-bad1cd1c-1049-40e1-9682-eaadc8bd5e4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6de14d780cb1488cbeb8804663bc6988'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:05.757368 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-bad1cd1c-1049-40e1-9682-eaadc8bd5e4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6de14d780cb1488cbeb8804663bc6988'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:05.761068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17e048-2000-400e-bb69-77e132094e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:05.761669 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17e048-2000-400e-bb69-77e132094e79 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:05.761944 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17e048-2000-400e-bb69-77e132094e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:05.762213 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17e048-2000-400e-bb69-77e132094e79 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:05.762865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17e048-2000-400e-bb69-77e132094e79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:05.764849 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17e048-2000-400e-bb69-77e132094e79 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:05.843698 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-bad1cd1c-1049-40e1-9682-eaadc8bd5e4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6de14d780cb1488cbeb8804663bc6988'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:05.852236 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-bad1cd1c-1049-40e1-9682-eaadc8bd5e4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6de14d780cb1488cbeb8804663bc6988'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:05.852885 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-bad1cd1c-1049-40e1-9682-eaadc8bd5e4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6de14d780cb1488cbeb8804663bc6988'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:05.871775 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 869/1734] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:34:05 2022] DELETE /identity/v3/users/6de14d780cb1488cbeb8804663bc6988 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:05.891772 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 866/1735] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:34:05 2022] POST /identity/v3/users => generated 278 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:34:05.895474 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1cd1c-1049-40e1-9682-eaadc8bd5e4a admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:05.897395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-bad1cd1c-1049-40e1-9682-eaadc8bd5e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:05.981058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1cd1c-1049-40e1-9682-eaadc8bd5e4a admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:05.986303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9490cd7-e55b-44eb-83ba-76972a866645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:05.987255 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9490cd7-e55b-44eb-83ba-76972a866645 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:05.987682 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9490cd7-e55b-44eb-83ba-76972a866645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:05.988008 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9490cd7-e55b-44eb-83ba-76972a866645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:05.988694 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9490cd7-e55b-44eb-83ba-76972a866645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:05.990325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9490cd7-e55b-44eb-83ba-76972a866645 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:06.000848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 870/1736] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:06.005134 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17e048-2000-400e-bb69-77e132094e79 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:06.006784 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:06.016864 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17e048-2000-400e-bb69-77e132094e79 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:06.021529 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b95962-1ed1-4046-be89-812f54b21f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:06.022125 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b95962-1ed1-4046-be89-812f54b21f09 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:06.022403 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b95962-1ed1-4046-be89-812f54b21f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:06.023365 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b95962-1ed1-4046-be89-812f54b21f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:06.023843 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b95962-1ed1-4046-be89-812f54b21f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:06.025466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b95962-1ed1-4046-be89-812f54b21f09 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:06.035425 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 867/1737] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:06.044751 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9490cd7-e55b-44eb-83ba-76972a866645 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:06.055648 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9490cd7-e55b-44eb-83ba-76972a866645 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:06.060506 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b838d19-792c-4fae-ba29-faf16ebed6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:06.061416 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b838d19-792c-4fae-ba29-faf16ebed6f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:06.061919 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b838d19-792c-4fae-ba29-faf16ebed6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:06.062366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b838d19-792c-4fae-ba29-faf16ebed6f4 admin admin] PATH_INFO: `/v3/projects/d553ef591ea34294b0e73ac536b14e7d/users/262ea4b2bf4d4cab986564cde8f259c9/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:06.065245 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:06.081377 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b838d19-792c-4fae-ba29-faf16ebed6f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d553ef591ea34294b0e73ac536b14e7d, user_id=262ea4b2bf4d4cab986564cde8f259c9, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:06.084451 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b838d19-792c-4fae-ba29-faf16ebed6f4 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:06.200453 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 871/1738] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:06 2022] PUT /identity/v3/projects/d553ef591ea34294b0e73ac536b14e7d/users/262ea4b2bf4d4cab986564cde8f259c9/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:06.217946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce963f3-b98c-47ae-a450-e063f02a286e None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:06.218130 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce963f3-b98c-47ae-a450-e063f02a286e None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:06.218522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce963f3-b98c-47ae-a450-e063f02a286e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:06.249084 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-fce963f3-b98c-47ae-a450-e063f02a286e None None] MFA Rules not processed for user `262ea4b2bf4d4cab986564cde8f259c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:06.250330 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-fce963f3-b98c-47ae-a450-e063f02a286e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:06.324770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 868/1739] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:06.329162 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b838d19-792c-4fae-ba29-faf16ebed6f4 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:06.391722 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce963f3-b98c-47ae-a450-e063f02a286e None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:06.393161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-fce963f3-b98c-47ae-a450-e063f02a286e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:06.420078 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b838d19-792c-4fae-ba29-faf16ebed6f4 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:06.425637 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279691cb-a071-441b-a0d8-91dfcf277fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:06.426273 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279691cb-a071-441b-a0d8-91dfcf277fcc admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:06.426548 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279691cb-a071-441b-a0d8-91dfcf277fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:06.426882 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279691cb-a071-441b-a0d8-91dfcf277fcc admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:06.427486 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279691cb-a071-441b-a0d8-91dfcf277fcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:06.430017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279691cb-a071-441b-a0d8-91dfcf277fcc admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:06.481296 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce963f3-b98c-47ae-a450-e063f02a286e None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:06.486256 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b8018-cd23-4169-8348-4d8dd32c609d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:06.486977 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b8018-cd23-4169-8348-4d8dd32c609d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:06.487263 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b8018-cd23-4169-8348-4d8dd32c609d admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:06.487541 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b8018-cd23-4169-8348-4d8dd32c609d admin admin] PATH_INFO: `/v3/projects/6f35b98bcee44920889fdb881550cdb3` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:06.488769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b8018-cd23-4169-8348-4d8dd32c609d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f35b98bcee44920889fdb881550cdb3)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:06.490762 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b8018-cd23-4169-8348-4d8dd32c609d admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:06.574396 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 872/1740] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:34:06 2022] POST /identity/v3/projects => generated 355 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:34:06.578242 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279691cb-a071-441b-a0d8-91dfcf277fcc admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:06.644837 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-6f2b8018-cd23-4169-8348-4d8dd32c609d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f35b98bcee44920889fdb881550cdb3', 'request_id': 'req-6f2b8018-cd23-4169-8348-4d8dd32c609d'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:06.653075 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-6f2b8018-cd23-4169-8348-4d8dd32c609d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f35b98bcee44920889fdb881550cdb3', 'request_id': 'req-6f2b8018-cd23-4169-8348-4d8dd32c609d'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:06.656467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279691cb-a071-441b-a0d8-91dfcf277fcc admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:06.743752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425de779-3d1e-42ce-aaa1-7f4d782c980d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:06.744378 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425de779-3d1e-42ce-aaa1-7f4d782c980d admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:06.744655 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425de779-3d1e-42ce-aaa1-7f4d782c980d admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:06.745042 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425de779-3d1e-42ce-aaa1-7f4d782c980d admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:06.745695 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425de779-3d1e-42ce-aaa1-7f4d782c980d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:06.747676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425de779-3d1e-42ce-aaa1-7f4d782c980d admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:06.850706 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-6f2b8018-cd23-4169-8348-4d8dd32c609d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f35b98bcee44920889fdb881550cdb3', 'request_id': 'req-6f2b8018-cd23-4169-8348-4d8dd32c609d'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:06.862619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-6f2b8018-cd23-4169-8348-4d8dd32c609d admin admin] The token cache is being invalidate because project 6f35b98bcee44920889fdb881550cdb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:34:06.862942 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-6f2b8018-cd23-4169-8348-4d8dd32c609d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:06.863588 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-6f2b8018-cd23-4169-8348-4d8dd32c609d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:06.865129 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 869/1741] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:34:06 2022] DELETE /identity/v3/projects/6f35b98bcee44920889fdb881550cdb3 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:06.870363 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314505c-9f91-4a46-b029-52400f418ebd None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:06.870646 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314505c-9f91-4a46-b029-52400f418ebd None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:06.870945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314505c-9f91-4a46-b029-52400f418ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:06.886726 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 873/1742] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:34:06 2022] POST /identity/v3/users => generated 284 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:34:06.890601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425de779-3d1e-42ce-aaa1-7f4d782c980d admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:06.892316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-425de779-3d1e-42ce-aaa1-7f4d782c980d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:06.892432 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-0314505c-9f91-4a46-b029-52400f418ebd None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:06.893505 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-0314505c-9f91-4a46-b029-52400f418ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:06.901676 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 870/1743] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:34:06.904824 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425de779-3d1e-42ce-aaa1-7f4d782c980d admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:06.909633 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50033225-a2c4-42b6-a4ee-48aff606e1b2 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:06.909783 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603b22d-bb9d-4173-ad39-5b9575551a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:06.910013 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50033225-a2c4-42b6-a4ee-48aff606e1b2 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:06.910299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50033225-a2c4-42b6-a4ee-48aff606e1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:06.910390 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603b22d-bb9d-4173-ad39-5b9575551a84 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:06.910630 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603b22d-bb9d-4173-ad39-5b9575551a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:06.910929 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603b22d-bb9d-4173-ad39-5b9575551a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:06.911579 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603b22d-bb9d-4173-ad39-5b9575551a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:06.913168 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603b22d-bb9d-4173-ad39-5b9575551a84 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:06.923456 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 874/1744] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:34:06.927517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603b22d-bb9d-4173-ad39-5b9575551a84 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:06.931825 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-50033225-a2c4-42b6-a4ee-48aff606e1b2 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:06.933034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-50033225-a2c4-42b6-a4ee-48aff606e1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:06.938433 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603b22d-bb9d-4173-ad39-5b9575551a84 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:06.941835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 871/1745] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:34:06.947216 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50033225-a2c4-42b6-a4ee-48aff606e1b2 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:06.950718 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8826b25-9854-484c-89c5-79076ead45d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:06.950718 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8826b25-9854-484c-89c5-79076ead45d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:06.950718 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8826b25-9854-484c-89c5-79076ead45d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:06.950718 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8826b25-9854-484c-89c5-79076ead45d0 admin admin] PATH_INFO: `/v3/projects/a9ac02b310ff49d29efa758365cd47ee/users/3ec556ed4c2c4497836e01a413c5c83c/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:06.957190 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50033225-a2c4-42b6-a4ee-48aff606e1b2 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:06.963355 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62387679-f16c-4b62-a314-b60b436c027f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:06.964295 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62387679-f16c-4b62-a314-b60b436c027f admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:06.964809 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62387679-f16c-4b62-a314-b60b436c027f admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:06.965242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62387679-f16c-4b62-a314-b60b436c027f admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:06.965907 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62387679-f16c-4b62-a314-b60b436c027f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:34:06.966214 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62387679-f16c-4b62-a314-b60b436c027f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:06.967870 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62387679-f16c-4b62-a314-b60b436c027f admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:06.971293 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8826b25-9854-484c-89c5-79076ead45d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ac02b310ff49d29efa758365cd47ee, user_id=3ec556ed4c2c4497836e01a413c5c83c, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:06.974120 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8826b25-9854-484c-89c5-79076ead45d0 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:06.982348 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 872/1746] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:34:06.983128 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62387679-f16c-4b62-a314-b60b436c027f admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:06.985182 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-62387679-f16c-4b62-a314-b60b436c027f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:06.998391 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62387679-f16c-4b62-a314-b60b436c027f admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:07.003055 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394899f-60ed-4b69-878f-4ea33f01994b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:07.003668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394899f-60ed-4b69-878f-4ea33f01994b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:07.003946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394899f-60ed-4b69-878f-4ea33f01994b admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:07.004223 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394899f-60ed-4b69-878f-4ea33f01994b admin admin] PATH_INFO: `/v3/users/5b490147c7124412803a7155325b416c` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:07.008215 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394899f-60ed-4b69-878f-4ea33f01994b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b490147c7124412803a7155325b416c)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:07.008215 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394899f-60ed-4b69-878f-4ea33f01994b admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:07.063155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 875/1747] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:06 2022] PUT /identity/v3/projects/a9ac02b310ff49d29efa758365cd47ee/users/3ec556ed4c2c4497836e01a413c5c83c/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:34:07.064139 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8826b25-9854-484c-89c5-79076ead45d0 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:07.065833 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-f8826b25-9854-484c-89c5-79076ead45d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:07.131809 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8826b25-9854-484c-89c5-79076ead45d0 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:07.136620 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e851f41-cc67-418d-be68-b563a5625fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:07.137273 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e851f41-cc67-418d-be68-b563a5625fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:07.137573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e851f41-cc67-418d-be68-b563a5625fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:07.137850 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e851f41-cc67-418d-be68-b563a5625fd9 admin admin] PATH_INFO: `/v3/users/5e559e8ecb6d4c26a60f668fbfa9411e` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:07.139022 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e851f41-cc67-418d-be68-b563a5625fd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e559e8ecb6d4c26a60f668fbfa9411e)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:07.140990 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e851f41-cc67-418d-be68-b563a5625fd9 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:07.214680 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-1394899f-60ed-4b69-878f-4ea33f01994b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b490147c7124412803a7155325b416c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:07.215337 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-1394899f-60ed-4b69-878f-4ea33f01994b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b490147c7124412803a7155325b416c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:07.267726 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-1394899f-60ed-4b69-878f-4ea33f01994b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b490147c7124412803a7155325b416c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:07.280930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-1394899f-60ed-4b69-878f-4ea33f01994b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b490147c7124412803a7155325b416c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:07.281566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-1394899f-60ed-4b69-878f-4ea33f01994b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b490147c7124412803a7155325b416c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:07.291809 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:07.296745 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 873/1748] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:34:06 2022] DELETE /identity/v3/users/5b490147c7124412803a7155325b416c => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:07.297513 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394899f-60ed-4b69-878f-4ea33f01994b admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:07.298974 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-1394899f-60ed-4b69-878f-4ea33f01994b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:07.307724 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-3e851f41-cc67-418d-be68-b563a5625fd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e559e8ecb6d4c26a60f668fbfa9411e'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:07.308425 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-3e851f41-cc67-418d-be68-b563a5625fd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e559e8ecb6d4c26a60f668fbfa9411e'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:07.363140 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394899f-60ed-4b69-878f-4ea33f01994b admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:07.367843 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b29f7-f48d-4afa-a3ff-025f1382ae7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:07.368444 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b29f7-f48d-4afa-a3ff-025f1382ae7e admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:07.368722 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b29f7-f48d-4afa-a3ff-025f1382ae7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:07.368996 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b29f7-f48d-4afa-a3ff-025f1382ae7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:07.369624 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b29f7-f48d-4afa-a3ff-025f1382ae7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:07.371645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b29f7-f48d-4afa-a3ff-025f1382ae7e admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:07.377455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:07.378231 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-3e851f41-cc67-418d-be68-b563a5625fd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e559e8ecb6d4c26a60f668fbfa9411e'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:07.386447 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-3e851f41-cc67-418d-be68-b563a5625fd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e559e8ecb6d4c26a60f668fbfa9411e'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:07.387336 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-3e851f41-cc67-418d-be68-b563a5625fd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e559e8ecb6d4c26a60f668fbfa9411e'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:07.406039 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 876/1749] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:34:07 2022] DELETE /identity/v3/users/5e559e8ecb6d4c26a60f668fbfa9411e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:07.409617 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e851f41-cc67-418d-be68-b563a5625fd9 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:07.411053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-3e851f41-cc67-418d-be68-b563a5625fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:07.471476 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 874/1750] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:34:07 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:07.473202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bfe1b-9379-4707-aedb-7c1862ef70cc None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:07.473695 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bfe1b-9379-4707-aedb-7c1862ef70cc None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:07.474195 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bfe1b-9379-4707-aedb-7c1862ef70cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:07.480271 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e851f41-cc67-418d-be68-b563a5625fd9 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:07.496916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-cd6bfe1b-9379-4707-aedb-7c1862ef70cc None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:07.498168 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-cd6bfe1b-9379-4707-aedb-7c1862ef70cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:07.551933 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4c304-e5ae-4bf5-ab8b-20468bd97f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:07.552597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4c304-e5ae-4bf5-ab8b-20468bd97f14 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:07.552883 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4c304-e5ae-4bf5-ab8b-20468bd97f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:07.553158 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4c304-e5ae-4bf5-ab8b-20468bd97f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:07.554333 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc4c304-e5ae-4bf5-ab8b-20468bd97f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:07.556055 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc4c304-e5ae-4bf5-ab8b-20468bd97f14 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:07.566869 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 877/1751] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:07.572098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd098464-1604-4f9f-b812-49011175803b None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:07.572385 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd098464-1604-4f9f-b812-49011175803b None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:07.572489 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 875/1752] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:07.572653 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd098464-1604-4f9f-b812-49011175803b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:07.573269 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bfe1b-9379-4707-aedb-7c1862ef70cc None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:07.574565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-cd6bfe1b-9379-4707-aedb-7c1862ef70cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:07.587993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bfe1b-9379-4707-aedb-7c1862ef70cc None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:07.592486 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-bd098464-1604-4f9f-b812-49011175803b None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:07.592941 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290d296-3306-4738-8485-05df1e958697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:07.593446 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290d296-3306-4738-8485-05df1e958697 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:07.593712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-bd098464-1604-4f9f-b812-49011175803b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:07.593867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290d296-3306-4738-8485-05df1e958697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:07.593966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290d296-3306-4738-8485-05df1e958697 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:07.594632 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2290d296-3306-4738-8485-05df1e958697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:07.596609 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2290d296-3306-4738-8485-05df1e958697 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:07.601650 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 878/1753] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:07.602586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd098464-1604-4f9f-b812-49011175803b None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:07.612197 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd098464-1604-4f9f-b812-49011175803b None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:07.618133 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ceb6a2-6c40-423c-b1ac-c9da4feaed9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:07.618861 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceb6a2-6c40-423c-b1ac-c9da4feaed9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:07.619143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceb6a2-6c40-423c-b1ac-c9da4feaed9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:07.619417 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceb6a2-6c40-423c-b1ac-c9da4feaed9e admin admin] PATH_INFO: `/v3/projects/a9ac02b310ff49d29efa758365cd47ee/users/3ec556ed4c2c4497836e01a413c5c83c/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:07.621360 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ceb6a2-6c40-423c-b1ac-c9da4feaed9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ac02b310ff49d29efa758365cd47ee, user_id=3ec556ed4c2c4497836e01a413c5c83c, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:07.624105 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ceb6a2-6c40-423c-b1ac-c9da4feaed9e admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:07.635840 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 879/1754] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:07 2022] PUT /identity/v3/projects/a9ac02b310ff49d29efa758365cd47ee/users/3ec556ed4c2c4497836e01a413c5c83c/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:07.645285 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ceb6a2-6c40-423c-b1ac-c9da4feaed9e admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:07.646971 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-85ceb6a2-6c40-423c-b1ac-c9da4feaed9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:07.703757 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ceb6a2-6c40-423c-b1ac-c9da4feaed9e admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:07.707414 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461a259-f0c1-48fa-87a9-a1f58d9bae29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:07.708012 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461a259-f0c1-48fa-87a9-a1f58d9bae29 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:07.708303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461a259-f0c1-48fa-87a9-a1f58d9bae29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:07.708584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461a259-f0c1-48fa-87a9-a1f58d9bae29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:07.722594 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 876/1755] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:34:07 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:07.722594 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290d296-3306-4738-8485-05df1e958697 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:07.722594 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-2290d296-3306-4738-8485-05df1e958697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:07.774350 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461a259-f0c1-48fa-87a9-a1f58d9bae29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:07.775944 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461a259-f0c1-48fa-87a9-a1f58d9bae29 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:07.787392 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290d296-3306-4738-8485-05df1e958697 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:07.789421 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 880/1756] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:34:07.790999 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00792cfb-f4bf-4ed4-97b1-e7729b1c5767 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:07.791364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00792cfb-f4bf-4ed4-97b1-e7729b1c5767 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:07.791608 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00792cfb-f4bf-4ed4-97b1-e7729b1c5767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:07.792931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364c9c7-f795-48dc-ac79-ce63fb99520a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:07.793562 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364c9c7-f795-48dc-ac79-ce63fb99520a service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:07.793844 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364c9c7-f795-48dc-ac79-ce63fb99520a service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:07.794171 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364c9c7-f795-48dc-ac79-ce63fb99520a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:07.807456 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364c9c7-f795-48dc-ac79-ce63fb99520a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:07.809248 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364c9c7-f795-48dc-ac79-ce63fb99520a service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:07.821777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 877/1757] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:34:07.822748 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364c9c7-f795-48dc-ac79-ce63fb99520a service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:07.838762 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364c9c7-f795-48dc-ac79-ce63fb99520a service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:07.843332 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-00792cfb-f4bf-4ed4-97b1-e7729b1c5767 None None] MFA Rules not processed for user `3ec556ed4c2c4497836e01a413c5c83c`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:07.844646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-00792cfb-f4bf-4ed4-97b1-e7729b1c5767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:07.845494 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948af9f6-e713-431d-88c5-8b8c51794979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:07.846118 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948af9f6-e713-431d-88c5-8b8c51794979 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:07.846390 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948af9f6-e713-431d-88c5-8b8c51794979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:07.846669 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948af9f6-e713-431d-88c5-8b8c51794979 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:07.847972 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948af9f6-e713-431d-88c5-8b8c51794979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:07.850086 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948af9f6-e713-431d-88c5-8b8c51794979 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:07.865282 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 878/1758] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:07.869929 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948af9f6-e713-431d-88c5-8b8c51794979 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:07.886671 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948af9f6-e713-431d-88c5-8b8c51794979 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:07.891851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:07.895978 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81533ba6-5725-4f1c-aadb-1abdd846ffe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:07.896840 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81533ba6-5725-4f1c-aadb-1abdd846ffe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:07.897271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81533ba6-5725-4f1c-aadb-1abdd846ffe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:07.898631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81533ba6-5725-4f1c-aadb-1abdd846ffe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:07.900210 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81533ba6-5725-4f1c-aadb-1abdd846ffe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:07.902476 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81533ba6-5725-4f1c-aadb-1abdd846ffe5 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:07.921376 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 879/1759] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:34:07.925282 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81533ba6-5725-4f1c-aadb-1abdd846ffe5 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:07.940368 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81533ba6-5725-4f1c-aadb-1abdd846ffe5 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:07.943177 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 881/1760] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:07 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:07.948006 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed1278-29c6-4a9f-acbb-f0aad98a0ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:07.948727 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed1278-29c6-4a9f-acbb-f0aad98a0ae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:07.949009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed1278-29c6-4a9f-acbb-f0aad98a0ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:07.949394 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed1278-29c6-4a9f-acbb-f0aad98a0ae0 admin admin] PATH_INFO: `/v3/projects/7ed465b2fa524f1d9b5f36d7c4f35f99/users/872db8bebb214d82a9731ab0a848b155/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:07.958230 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00792cfb-f4bf-4ed4-97b1-e7729b1c5767 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:07.959859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-00792cfb-f4bf-4ed4-97b1-e7729b1c5767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:07.973384 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed1278-29c6-4a9f-acbb-f0aad98a0ae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed465b2fa524f1d9b5f36d7c4f35f99, user_id=872db8bebb214d82a9731ab0a848b155, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:07.977420 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed1278-29c6-4a9f-acbb-f0aad98a0ae0 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:08.025525 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00792cfb-f4bf-4ed4-97b1-e7729b1c5767 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:08.029219 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a30778-2a82-4043-86d2-91e050ee6aeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:08.029832 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a30778-2a82-4043-86d2-91e050ee6aeb service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:08.030110 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a30778-2a82-4043-86d2-91e050ee6aeb service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:08.030382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a30778-2a82-4043-86d2-91e050ee6aeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:08.040706 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a30778-2a82-4043-86d2-91e050ee6aeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:08.042145 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a30778-2a82-4043-86d2-91e050ee6aeb service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:08.052945 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 882/1761] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:07 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:34:08.058538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 880/1762] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:07 2022] PUT /identity/v3/projects/7ed465b2fa524f1d9b5f36d7c4f35f99/users/872db8bebb214d82a9731ab0a848b155/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:08.069292 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247c77b-7c14-4db0-b0b7-16013a439194 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:08.069629 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247c77b-7c14-4db0-b0b7-16013a439194 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:08.070058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247c77b-7c14-4db0-b0b7-16013a439194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:08.117639 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-a247c77b-7c14-4db0-b0b7-16013a439194 None None] MFA Rules not processed for user `872db8bebb214d82a9731ab0a848b155`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:08.118979 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-a247c77b-7c14-4db0-b0b7-16013a439194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:08.207569 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 883/1763] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:08.213066 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed1278-29c6-4a9f-acbb-f0aad98a0ae0 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:08.267155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247c77b-7c14-4db0-b0b7-16013a439194 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:08.295794 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed1278-29c6-4a9f-acbb-f0aad98a0ae0 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:08.301976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79b641-c5f7-43fe-bfdc-810784c259af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:08.303025 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79b641-c5f7-43fe-bfdc-810784c259af admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:08.303318 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79b641-c5f7-43fe-bfdc-810784c259af admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:08.303599 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79b641-c5f7-43fe-bfdc-810784c259af admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:08.304606 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79b641-c5f7-43fe-bfdc-810784c259af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:08.306382 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79b641-c5f7-43fe-bfdc-810784c259af admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:08.340686 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247c77b-7c14-4db0-b0b7-16013a439194 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:08.344619 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1f9bb-db6b-4e11-82ff-5aebad2cb659 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:08.345223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1f9bb-db6b-4e11-82ff-5aebad2cb659 service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:08.345496 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1f9bb-db6b-4e11-82ff-5aebad2cb659 service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:08.345765 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1f9bb-db6b-4e11-82ff-5aebad2cb659 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:08.347749 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c4c1f9bb-db6b-4e11-82ff-5aebad2cb659 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:08.407873 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1f9bb-db6b-4e11-82ff-5aebad2cb659 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:08.409317 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1f9bb-db6b-4e11-82ff-5aebad2cb659 service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:08.418875 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 884/1764] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:34:08.439134 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 881/1765] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:34:08 2022] POST /identity/v3/projects => generated 385 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:08.440220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1f9bb-db6b-4e11-82ff-5aebad2cb659 service cinder] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:08.451510 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1f9bb-db6b-4e11-82ff-5aebad2cb659 service cinder] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:08.471624 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:08.476714 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79b641-c5f7-43fe-bfdc-810784c259af admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:08.478696 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-2c79b641-c5f7-43fe-bfdc-810784c259af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:08.516571 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fddac-11e2-46da-9157-d5a68d36a5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:08.517191 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fddac-11e2-46da-9157-d5a68d36a5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:08.517904 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fddac-11e2-46da-9157-d5a68d36a5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:08.517904 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fddac-11e2-46da-9157-d5a68d36a5e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:08.518383 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40fddac-11e2-46da-9157-d5a68d36a5e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:08.520398 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40fddac-11e2-46da-9157-d5a68d36a5e6 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:08.553415 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79b641-c5f7-43fe-bfdc-810784c259af admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:08.558390 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0daf4-2c17-47dd-b4af-7b41fc04ca6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:08.559048 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0daf4-2c17-47dd-b4af-7b41fc04ca6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:08.559355 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0daf4-2c17-47dd-b4af-7b41fc04ca6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:08.559880 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0daf4-2c17-47dd-b4af-7b41fc04ca6c admin admin] PATH_INFO: `/v3/projects/31c7823acb3b4cc283fb7ddc9bf0e2a2` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:08.561028 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0daf4-2c17-47dd-b4af-7b41fc04ca6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=31c7823acb3b4cc283fb7ddc9bf0e2a2)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:08.563107 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0daf4-2c17-47dd-b4af-7b41fc04ca6c admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:08.627680 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 885/1766] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:34:08 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:08.628660 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fddac-11e2-46da-9157-d5a68d36a5e6 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:08.630330 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-d40fddac-11e2-46da-9157-d5a68d36a5e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:08.642694 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fddac-11e2-46da-9157-d5a68d36a5e6 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:08.647528 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97af4ce-093c-4667-a2bb-1bd5e0ca0959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:08.648797 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97af4ce-093c-4667-a2bb-1bd5e0ca0959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:08.649402 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97af4ce-093c-4667-a2bb-1bd5e0ca0959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:08.649509 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97af4ce-093c-4667-a2bb-1bd5e0ca0959 admin admin] PATH_INFO: `/v3/projects/48f847956efe4dffb8a983bbfb3a86e0` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:08.651498 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97af4ce-093c-4667-a2bb-1bd5e0ca0959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48f847956efe4dffb8a983bbfb3a86e0)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:08.653493 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97af4ce-093c-4667-a2bb-1bd5e0ca0959 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:08.669960 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-89e0daf4-2c17-47dd-b4af-7b41fc04ca6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31c7823acb3b4cc283fb7ddc9bf0e2a2', 'request_id': 'req-89e0daf4-2c17-47dd-b4af-7b41fc04ca6c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:08.675669 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-89e0daf4-2c17-47dd-b4af-7b41fc04ca6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31c7823acb3b4cc283fb7ddc9bf0e2a2', 'request_id': 'req-89e0daf4-2c17-47dd-b4af-7b41fc04ca6c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:08.863951 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-89e0daf4-2c17-47dd-b4af-7b41fc04ca6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31c7823acb3b4cc283fb7ddc9bf0e2a2', 'request_id': 'req-89e0daf4-2c17-47dd-b4af-7b41fc04ca6c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:08.876094 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b97af4ce-093c-4667-a2bb-1bd5e0ca0959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48f847956efe4dffb8a983bbfb3a86e0', 'request_id': 'req-b97af4ce-093c-4667-a2bb-1bd5e0ca0959'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:08.883606 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-89e0daf4-2c17-47dd-b4af-7b41fc04ca6c admin admin] The token cache is being invalidate because project 31c7823acb3b4cc283fb7ddc9bf0e2a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:34:08.883606 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-89e0daf4-2c17-47dd-b4af-7b41fc04ca6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:08.883606 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-89e0daf4-2c17-47dd-b4af-7b41fc04ca6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:08.883825 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b97af4ce-093c-4667-a2bb-1bd5e0ca0959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48f847956efe4dffb8a983bbfb3a86e0', 'request_id': 'req-b97af4ce-093c-4667-a2bb-1bd5e0ca0959'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:08.883899 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 882/1767] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:34:08 2022] DELETE /identity/v3/projects/31c7823acb3b4cc283fb7ddc9bf0e2a2 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:34:08.884341 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0daf4-2c17-47dd-b4af-7b41fc04ca6c admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:08.885689 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-89e0daf4-2c17-47dd-b4af-7b41fc04ca6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:08.895696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b97af4ce-093c-4667-a2bb-1bd5e0ca0959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48f847956efe4dffb8a983bbfb3a86e0', 'request_id': 'req-b97af4ce-093c-4667-a2bb-1bd5e0ca0959'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:08.954420 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0daf4-2c17-47dd-b4af-7b41fc04ca6c admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:09.007282 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b97af4ce-093c-4667-a2bb-1bd5e0ca0959 admin admin] The token cache is being invalidate because project 48f847956efe4dffb8a983bbfb3a86e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:34:09.009760 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b97af4ce-093c-4667-a2bb-1bd5e0ca0959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:09.009760 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b97af4ce-093c-4667-a2bb-1bd5e0ca0959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:09.013927 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 886/1768] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:34:08 2022] DELETE /identity/v3/projects/48f847956efe4dffb8a983bbfb3a86e0 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:09.014969 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97af4ce-093c-4667-a2bb-1bd5e0ca0959 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:09.016431 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-b97af4ce-093c-4667-a2bb-1bd5e0ca0959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:09.020078 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b59532-a074-4fbd-ab49-09cd7d6a6a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:09.020727 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b59532-a074-4fbd-ab49-09cd7d6a6a86 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:09.021061 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b59532-a074-4fbd-ab49-09cd7d6a6a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:09.021337 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b59532-a074-4fbd-ab49-09cd7d6a6a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:09.022044 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b59532-a074-4fbd-ab49-09cd7d6a6a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:09.024454 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b59532-a074-4fbd-ab49-09cd7d6a6a86 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:09.032122 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97af4ce-093c-4667-a2bb-1bd5e0ca0959 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:09.036790 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 883/1769] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:09.036790 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b59532-a074-4fbd-ab49-09cd7d6a6a86 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:09.037009 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7655327-c707-4bb2-978c-046aeef624ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:09.037580 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7655327-c707-4bb2-978c-046aeef624ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:09.038291 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7655327-c707-4bb2-978c-046aeef624ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:09.038291 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7655327-c707-4bb2-978c-046aeef624ad admin admin] PATH_INFO: `/v3/users/399178d1002e4dfead7bdb2cd6156953` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:09.039466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-10b59532-a074-4fbd-ab49-09cd7d6a6a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:09.041262 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7655327-c707-4bb2-978c-046aeef624ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=399178d1002e4dfead7bdb2cd6156953)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:09.043384 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7655327-c707-4bb2-978c-046aeef624ad admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:09.052907 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b59532-a074-4fbd-ab49-09cd7d6a6a86 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:09.058049 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b642fee-60f1-4047-b53a-d6a35fb9eca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:09.058679 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b642fee-60f1-4047-b53a-d6a35fb9eca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:09.059000 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b642fee-60f1-4047-b53a-d6a35fb9eca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:09.059278 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b642fee-60f1-4047-b53a-d6a35fb9eca9 admin admin] PATH_INFO: `/v3/users/c4773b9f4e1f42b09a748b317d27207e` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:09.060714 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b642fee-60f1-4047-b53a-d6a35fb9eca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4773b9f4e1f42b09a748b317d27207e)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:09.062674 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b642fee-60f1-4047-b53a-d6a35fb9eca9 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:09.285160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:09.350633 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-9b642fee-60f1-4047-b53a-d6a35fb9eca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4773b9f4e1f42b09a748b317d27207e'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:09.350893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a7655327-c707-4bb2-978c-046aeef624ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '399178d1002e4dfead7bdb2cd6156953'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:09.351384 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-9b642fee-60f1-4047-b53a-d6a35fb9eca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4773b9f4e1f42b09a748b317d27207e'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:09.351898 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a7655327-c707-4bb2-978c-046aeef624ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '399178d1002e4dfead7bdb2cd6156953'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:09.473430 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-9b642fee-60f1-4047-b53a-d6a35fb9eca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4773b9f4e1f42b09a748b317d27207e'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:09.485990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-9b642fee-60f1-4047-b53a-d6a35fb9eca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4773b9f4e1f42b09a748b317d27207e'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:09.486621 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-9b642fee-60f1-4047-b53a-d6a35fb9eca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4773b9f4e1f42b09a748b317d27207e'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:09.498682 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 884/1770] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:34:09 2022] DELETE /identity/v3/users/c4773b9f4e1f42b09a748b317d27207e => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:09.499909 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b306a-de32-4c13-8007-2fdbce4f1373 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:09.500189 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b306a-de32-4c13-8007-2fdbce4f1373 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:09.500461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b306a-de32-4c13-8007-2fdbce4f1373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:09.520295 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-eb4b306a-de32-4c13-8007-2fdbce4f1373 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:09.521483 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-eb4b306a-de32-4c13-8007-2fdbce4f1373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:09.547877 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a7655327-c707-4bb2-978c-046aeef624ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '399178d1002e4dfead7bdb2cd6156953'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:09.556077 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a7655327-c707-4bb2-978c-046aeef624ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '399178d1002e4dfead7bdb2cd6156953'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:09.556833 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a7655327-c707-4bb2-978c-046aeef624ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '399178d1002e4dfead7bdb2cd6156953'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:09.576235 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 887/1771] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:34:09 2022] DELETE /identity/v3/users/399178d1002e4dfead7bdb2cd6156953 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:09.577051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7655327-c707-4bb2-978c-046aeef624ad admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:09.578340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-a7655327-c707-4bb2-978c-046aeef624ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:09.589123 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 885/1772] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:09.591129 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623118d-94d8-4072-991e-53bc2b487629 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:09.591561 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623118d-94d8-4072-991e-53bc2b487629 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:09.592028 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623118d-94d8-4072-991e-53bc2b487629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:09.613952 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-1623118d-94d8-4072-991e-53bc2b487629 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:09.615579 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-1623118d-94d8-4072-991e-53bc2b487629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:09.659062 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7655327-c707-4bb2-978c-046aeef624ad admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:09.664568 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cc92f-d622-4797-a9a7-894473e656d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:09.665220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cc92f-d622-4797-a9a7-894473e656d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:09.665540 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cc92f-d622-4797-a9a7-894473e656d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:09.665792 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cc92f-d622-4797-a9a7-894473e656d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:09.666511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152cc92f-d622-4797-a9a7-894473e656d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:09.668152 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152cc92f-d622-4797-a9a7-894473e656d0 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:09.678247 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 888/1773] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:09.680047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f0423-21fb-4ffe-ad04-914f0b794a6e None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:09.680328 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f0423-21fb-4ffe-ad04-914f0b794a6e None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:09.680599 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f0423-21fb-4ffe-ad04-914f0b794a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:09.685510 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 886/1774] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:09.694138 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623118d-94d8-4072-991e-53bc2b487629 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:09.699155 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623118d-94d8-4072-991e-53bc2b487629 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:09.700817 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-552f0423-21fb-4ffe-ad04-914f0b794a6e None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:09.702151 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-552f0423-21fb-4ffe-ad04-914f0b794a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:09.704608 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf79d3-2215-42db-9649-34bb37526fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:09.705263 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf79d3-2215-42db-9649-34bb37526fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:09.705541 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf79d3-2215-42db-9649-34bb37526fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:09.705815 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf79d3-2215-42db-9649-34bb37526fb6 admin admin] PATH_INFO: `/v3/projects/af662b92aef64381b0abb4f375f8ff4a/users/f1f2a8909d4347699ca7ed300333a26d/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:09.710108 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 889/1775] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:09.710996 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f0423-21fb-4ffe-ad04-914f0b794a6e None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:09.714740 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-552f0423-21fb-4ffe-ad04-914f0b794a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:09.723385 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf79d3-2215-42db-9649-34bb37526fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af662b92aef64381b0abb4f375f8ff4a, user_id=f1f2a8909d4347699ca7ed300333a26d, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:09.728372 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf79d3-2215-42db-9649-34bb37526fb6 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:09.771434 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f0423-21fb-4ffe-ad04-914f0b794a6e None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:09.775364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ff76d-c95c-4092-8753-bddb3b55ed86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:09.775962 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ff76d-c95c-4092-8753-bddb3b55ed86 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:09.776233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ff76d-c95c-4092-8753-bddb3b55ed86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:09.776523 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ff76d-c95c-4092-8753-bddb3b55ed86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:09.785389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ff76d-c95c-4092-8753-bddb3b55ed86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:09.786809 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ff76d-c95c-4092-8753-bddb3b55ed86 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:09.796247 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 890/1776] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:34:09.797018 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ff76d-c95c-4092-8753-bddb3b55ed86 service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:09.806929 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ff76d-c95c-4092-8753-bddb3b55ed86 service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:09.812298 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207d7b9-1286-41f5-8395-dd72747b5612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:09.812890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207d7b9-1286-41f5-8395-dd72747b5612 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:09.813163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207d7b9-1286-41f5-8395-dd72747b5612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:09.813430 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207d7b9-1286-41f5-8395-dd72747b5612 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:09.814069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207d7b9-1286-41f5-8395-dd72747b5612 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:34:09.814366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207d7b9-1286-41f5-8395-dd72747b5612 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:09.815973 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207d7b9-1286-41f5-8395-dd72747b5612 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:09.828380 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 891/1777] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:34:09.832678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207d7b9-1286-41f5-8395-dd72747b5612 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:09.842564 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207d7b9-1286-41f5-8395-dd72747b5612 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:09.847336 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99529b-cbda-449d-8a80-138e9ec245a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:09.847919 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99529b-cbda-449d-8a80-138e9ec245a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:09.848194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99529b-cbda-449d-8a80-138e9ec245a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:09.848470 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99529b-cbda-449d-8a80-138e9ec245a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:09.849083 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99529b-cbda-449d-8a80-138e9ec245a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:09.851178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99529b-cbda-449d-8a80-138e9ec245a5 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:09.879956 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 887/1778] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:09 2022] PUT /identity/v3/projects/af662b92aef64381b0abb4f375f8ff4a/users/f1f2a8909d4347699ca7ed300333a26d/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:09.891533 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a7131-7e25-4f61-9e20-634989ea9e91 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:09.891812 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a7131-7e25-4f61-9e20-634989ea9e91 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:09.892085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a7131-7e25-4f61-9e20-634989ea9e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:09.919826 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-bf6a7131-7e25-4f61-9e20-634989ea9e91 None None] MFA Rules not processed for user `f1f2a8909d4347699ca7ed300333a26d`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:09.921038 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-bf6a7131-7e25-4f61-9e20-634989ea9e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:09.982941 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 892/1779] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:34:09 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:34:09.983904 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99529b-cbda-449d-8a80-138e9ec245a5 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:09.996191 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 888/1780] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:34:10.000305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a7131-7e25-4f61-9e20-634989ea9e91 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:10.063073 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99529b-cbda-449d-8a80-138e9ec245a5 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:10.074484 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d131a-633f-469d-ab5c-c4fab06bf118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:10.075155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d131a-633f-469d-ab5c-c4fab06bf118 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:10.075436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d131a-633f-469d-ab5c-c4fab06bf118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:10.075709 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d131a-633f-469d-ab5c-c4fab06bf118 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:10.076348 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d131a-633f-469d-ab5c-c4fab06bf118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:10.078707 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d131a-633f-469d-ab5c-c4fab06bf118 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:10.090945 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:10.137145 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a7131-7e25-4f61-9e20-634989ea9e91 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:10.142574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01417676-51a1-4811-b65d-1e23f35ed16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:10.143226 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01417676-51a1-4811-b65d-1e23f35ed16e admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:10.143509 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01417676-51a1-4811-b65d-1e23f35ed16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:10.143786 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01417676-51a1-4811-b65d-1e23f35ed16e admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:10.144446 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01417676-51a1-4811-b65d-1e23f35ed16e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:10.146896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01417676-51a1-4811-b65d-1e23f35ed16e admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:10.187886 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 893/1781] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:34:09 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:10.188889 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d131a-633f-469d-ab5c-c4fab06bf118 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:10.192104 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-695d131a-633f-469d-ab5c-c4fab06bf118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:10.204888 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d131a-633f-469d-ab5c-c4fab06bf118 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:10.210171 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c7d75-abec-49f3-85b5-7c869239bff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:10.210811 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c7d75-abec-49f3-85b5-7c869239bff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:10.211154 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c7d75-abec-49f3-85b5-7c869239bff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:10.211424 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c7d75-abec-49f3-85b5-7c869239bff9 admin admin] PATH_INFO: `/v3/projects/33ed0f6271bf4fd5955121b76ba14c66` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:10.212579 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c7d75-abec-49f3-85b5-7c869239bff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33ed0f6271bf4fd5955121b76ba14c66)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:10.214503 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c7d75-abec-49f3-85b5-7c869239bff9 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:10.294547 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 889/1782] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:34:09 2022] POST /identity/v3/projects => generated 381 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:34:10.295688 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01417676-51a1-4811-b65d-1e23f35ed16e admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:10.368702 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01417676-51a1-4811-b65d-1e23f35ed16e admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:10.371163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-c15c7d75-abec-49f3-85b5-7c869239bff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33ed0f6271bf4fd5955121b76ba14c66', 'request_id': 'req-c15c7d75-abec-49f3-85b5-7c869239bff9'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:10.379537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-c15c7d75-abec-49f3-85b5-7c869239bff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33ed0f6271bf4fd5955121b76ba14c66', 'request_id': 'req-c15c7d75-abec-49f3-85b5-7c869239bff9'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:10.391287 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-c15c7d75-abec-49f3-85b5-7c869239bff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33ed0f6271bf4fd5955121b76ba14c66', 'request_id': 'req-c15c7d75-abec-49f3-85b5-7c869239bff9'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:10.436661 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932229be-8a79-4f05-bfd9-8a7601ef890a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:10.437366 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932229be-8a79-4f05-bfd9-8a7601ef890a admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:10.437642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932229be-8a79-4f05-bfd9-8a7601ef890a admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:10.437922 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932229be-8a79-4f05-bfd9-8a7601ef890a admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:10.438570 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932229be-8a79-4f05-bfd9-8a7601ef890a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:10.440203 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932229be-8a79-4f05-bfd9-8a7601ef890a admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:10.450517 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 890/1783] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:10.451390 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932229be-8a79-4f05-bfd9-8a7601ef890a admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:10.453196 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-932229be-8a79-4f05-bfd9-8a7601ef890a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:10.469200 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932229be-8a79-4f05-bfd9-8a7601ef890a admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:10.471360 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f726035-7f27-429d-b911-11deb87724b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:10.471997 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f726035-7f27-429d-b911-11deb87724b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:10.472346 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f726035-7f27-429d-b911-11deb87724b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:10.472625 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f726035-7f27-429d-b911-11deb87724b3 admin admin] PATH_INFO: `/v3/projects/6a0b18f4410b4b4ab0d15f024a4a1084` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:10.473892 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f726035-7f27-429d-b911-11deb87724b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a0b18f4410b4b4ab0d15f024a4a1084)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:10.477088 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f726035-7f27-429d-b911-11deb87724b3 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:10.490422 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-c15c7d75-abec-49f3-85b5-7c869239bff9 admin admin] The token cache is being invalidate because project 33ed0f6271bf4fd5955121b76ba14c66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:34:10.492964 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-c15c7d75-abec-49f3-85b5-7c869239bff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:10.492964 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-c15c7d75-abec-49f3-85b5-7c869239bff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:10.493590 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 894/1784] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:34:10 2022] DELETE /identity/v3/projects/33ed0f6271bf4fd5955121b76ba14c66 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:10.497173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c7d75-abec-49f3-85b5-7c869239bff9 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:10.497173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c15c7d75-abec-49f3-85b5-7c869239bff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:10.520058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c7d75-abec-49f3-85b5-7c869239bff9 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:10.526428 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9a8cb-da9d-400a-a991-40dd2e672271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:10.527070 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9a8cb-da9d-400a-a991-40dd2e672271 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:10.527886 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9a8cb-da9d-400a-a991-40dd2e672271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:10.527886 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9a8cb-da9d-400a-a991-40dd2e672271 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:10.528574 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9a8cb-da9d-400a-a991-40dd2e672271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:10.530540 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9a8cb-da9d-400a-a991-40dd2e672271 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:10.546618 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:10.594850 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0f726035-7f27-429d-b911-11deb87724b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a0b18f4410b4b4ab0d15f024a4a1084', 'request_id': 'req-0f726035-7f27-429d-b911-11deb87724b3'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:10.600572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0f726035-7f27-429d-b911-11deb87724b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a0b18f4410b4b4ab0d15f024a4a1084', 'request_id': 'req-0f726035-7f27-429d-b911-11deb87724b3'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:10.680541 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 895/1785] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:34:10 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:10.680541 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9a8cb-da9d-400a-a991-40dd2e672271 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:10.681919 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c2a9a8cb-da9d-400a-a991-40dd2e672271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:10.693977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9a8cb-da9d-400a-a991-40dd2e672271 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:10.730269 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0f726035-7f27-429d-b911-11deb87724b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a0b18f4410b4b4ab0d15f024a4a1084', 'request_id': 'req-0f726035-7f27-429d-b911-11deb87724b3'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:10.743082 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0f726035-7f27-429d-b911-11deb87724b3 admin admin] The token cache is being invalidate because project 6a0b18f4410b4b4ab0d15f024a4a1084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:34:10.743380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0f726035-7f27-429d-b911-11deb87724b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:10.744027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0f726035-7f27-429d-b911-11deb87724b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:10.745547 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 891/1786] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:34:10 2022] DELETE /identity/v3/projects/6a0b18f4410b4b4ab0d15f024a4a1084 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:10.746740 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f7ee2-69a7-4ec7-8bfc-ed75f0b51f6d None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:10.747067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f7ee2-69a7-4ec7-8bfc-ed75f0b51f6d None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:10.747335 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f7ee2-69a7-4ec7-8bfc-ed75f0b51f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:10.750598 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95f993-bf58-45a4-b096-ec405a227a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:10.751251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95f993-bf58-45a4-b096-ec405a227a37 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:10.751532 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95f993-bf58-45a4-b096-ec405a227a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:10.751804 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95f993-bf58-45a4-b096-ec405a227a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:10.752477 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95f993-bf58-45a4-b096-ec405a227a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:10.754075 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95f993-bf58-45a4-b096-ec405a227a37 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:10.766548 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 896/1787] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:10.766548 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95f993-bf58-45a4-b096-ec405a227a37 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:10.767908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-8d8f7ee2-69a7-4ec7-8bfc-ed75f0b51f6d None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:10.768025 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ec95f993-bf58-45a4-b096-ec405a227a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:10.769360 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-8d8f7ee2-69a7-4ec7-8bfc-ed75f0b51f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:10.778485 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 892/1788] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:10.779703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52390e7b-fbf5-454f-941f-e178d63a8724 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:10.779981 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52390e7b-fbf5-454f-941f-e178d63a8724 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:10.780256 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52390e7b-fbf5-454f-941f-e178d63a8724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:10.786555 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95f993-bf58-45a4-b096-ec405a227a37 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:10.792640 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8354d8-426f-4cb0-b1ee-ce016c7135d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:10.793260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8354d8-426f-4cb0-b1ee-ce016c7135d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:10.793537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8354d8-426f-4cb0-b1ee-ce016c7135d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:10.793804 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8354d8-426f-4cb0-b1ee-ce016c7135d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:10.794442 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8354d8-426f-4cb0-b1ee-ce016c7135d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:10.796081 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8354d8-426f-4cb0-b1ee-ce016c7135d7 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:10.799724 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-52390e7b-fbf5-454f-941f-e178d63a8724 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:10.801090 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-52390e7b-fbf5-454f-941f-e178d63a8724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:10.807862 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 897/1789] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:10.808643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8354d8-426f-4cb0-b1ee-ce016c7135d7 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:10.810530 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ab8354d8-426f-4cb0-b1ee-ce016c7135d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:10.811082 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 893/1790] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:10.812175 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8da09-715c-4022-9351-4337946ddb6b None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:10.812460 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8da09-715c-4022-9351-4337946ddb6b None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:10.812735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8da09-715c-4022-9351-4337946ddb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:10.824392 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8354d8-426f-4cb0-b1ee-ce016c7135d7 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:10.829711 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1114dd-4cde-4eaf-9911-8b0e0732b196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:10.830361 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1114dd-4cde-4eaf-9911-8b0e0732b196 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:10.830661 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1114dd-4cde-4eaf-9911-8b0e0732b196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:10.830967 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1114dd-4cde-4eaf-9911-8b0e0732b196 admin admin] PATH_INFO: `/v3/projects/0f7deffe164e47bc81b4407fd31a76df/users/e30938a4ce8a4e41b7d76fc6a069b0a7/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:10.833130 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-70d8da09-715c-4022-9351-4337946ddb6b None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:10.834333 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-70d8da09-715c-4022-9351-4337946ddb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:10.834780 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:10.843217 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 894/1791] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:10.844070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8da09-715c-4022-9351-4337946ddb6b None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:10.849235 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1114dd-4cde-4eaf-9911-8b0e0732b196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f7deffe164e47bc81b4407fd31a76df, user_id=e30938a4ce8a4e41b7d76fc6a069b0a7, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:10.852483 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1114dd-4cde-4eaf-9911-8b0e0732b196 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:10.855392 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8da09-715c-4022-9351-4337946ddb6b None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:10.860279 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a27932-3829-4cdb-b60c-543bc8dabb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:10.860957 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a27932-3829-4cdb-b60c-543bc8dabb10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:10.869138 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a27932-3829-4cdb-b60c-543bc8dabb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:10.869138 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a27932-3829-4cdb-b60c-543bc8dabb10 admin admin] PATH_INFO: `/v3/projects/39ebd599835f43b4b2670a4597e2c5c4/users/5ecfd0a00a2747469396c132de0fd47f/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:10.877969 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a27932-3829-4cdb-b60c-543bc8dabb10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ebd599835f43b4b2670a4597e2c5c4, user_id=5ecfd0a00a2747469396c132de0fd47f, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:10.880696 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a27932-3829-4cdb-b60c-543bc8dabb10 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:10.925427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 898/1792] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:10 2022] PUT /identity/v3/projects/0f7deffe164e47bc81b4407fd31a76df/users/e30938a4ce8a4e41b7d76fc6a069b0a7/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:10.926702 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c69dbd-49da-496e-9124-42ecdd47e109 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:10.927038 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c69dbd-49da-496e-9124-42ecdd47e109 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:10.927312 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c69dbd-49da-496e-9124-42ecdd47e109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:10.947593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-85c69dbd-49da-496e-9124-42ecdd47e109 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:10.948827 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-85c69dbd-49da-496e-9124-42ecdd47e109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:10.988233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 895/1793] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:10 2022] PUT /identity/v3/projects/39ebd599835f43b4b2670a4597e2c5c4/users/5ecfd0a00a2747469396c132de0fd47f/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:10.989073 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a27932-3829-4cdb-b60c-543bc8dabb10 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:11.013168 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 899/1794] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:11.017686 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea2903-a5c5-48ce-8fc4-c8f190465bf5 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:11.017924 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea2903-a5c5-48ce-8fc4-c8f190465bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:11.018203 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea2903-a5c5-48ce-8fc4-c8f190465bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:11.047898 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-83ea2903-a5c5-48ce-8fc4-c8f190465bf5 None None] MFA Rules not processed for user `e30938a4ce8a4e41b7d76fc6a069b0a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:11.049090 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-83ea2903-a5c5-48ce-8fc4-c8f190465bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:11.052401 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a27932-3829-4cdb-b60c-543bc8dabb10 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:11.057718 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06a29d-9cab-4aef-b35b-8169e94092be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:11.058314 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06a29d-9cab-4aef-b35b-8169e94092be admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:11.058594 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06a29d-9cab-4aef-b35b-8169e94092be admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:11.058889 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06a29d-9cab-4aef-b35b-8169e94092be admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:11.059538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06a29d-9cab-4aef-b35b-8169e94092be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:34:11.060091 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06a29d-9cab-4aef-b35b-8169e94092be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:11.061718 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06a29d-9cab-4aef-b35b-8169e94092be admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:11.074197 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 896/1795] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:34:11.075260 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06a29d-9cab-4aef-b35b-8169e94092be admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:11.087459 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06a29d-9cab-4aef-b35b-8169e94092be admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:11.092529 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf99eb4-40bf-49c3-855a-b5fefac918f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:11.093127 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf99eb4-40bf-49c3-855a-b5fefac918f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:11.093408 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf99eb4-40bf-49c3-855a-b5fefac918f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:11.093685 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf99eb4-40bf-49c3-855a-b5fefac918f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:11.094329 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf99eb4-40bf-49c3-855a-b5fefac918f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:11.095998 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf99eb4-40bf-49c3-855a-b5fefac918f6 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:11.107360 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 897/1796] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:11.108169 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf99eb4-40bf-49c3-855a-b5fefac918f6 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:11.119822 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf99eb4-40bf-49c3-855a-b5fefac918f6 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:11.123524 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 900/1797] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:11.124340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea2903-a5c5-48ce-8fc4-c8f190465bf5 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:11.127748 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74fe92-6bae-48c7-946f-630ec2a83e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:11.128381 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74fe92-6bae-48c7-946f-630ec2a83e4d admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:11.129022 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74fe92-6bae-48c7-946f-630ec2a83e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:11.129022 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74fe92-6bae-48c7-946f-630ec2a83e4d admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:11.129694 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74fe92-6bae-48c7-946f-630ec2a83e4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:34:11.130034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74fe92-6bae-48c7-946f-630ec2a83e4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:11.131693 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74fe92-6bae-48c7-946f-630ec2a83e4d admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:11.138354 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea2903-a5c5-48ce-8fc4-c8f190465bf5 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:11.143315 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507b64e-787e-4c9d-bead-f9840354a56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:11.144144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507b64e-787e-4c9d-bead-f9840354a56f admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:11.144427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507b64e-787e-4c9d-bead-f9840354a56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:11.144699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507b64e-787e-4c9d-bead-f9840354a56f admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:11.149858 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 898/1798] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:34:11.150499 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507b64e-787e-4c9d-bead-f9840354a56f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:11.150583 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74fe92-6bae-48c7-946f-630ec2a83e4d admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:11.150656 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507b64e-787e-4c9d-bead-f9840354a56f admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:11.159058 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74fe92-6bae-48c7-946f-630ec2a83e4d admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:11.161504 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:11.166238 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2182b2-4c89-45f0-bc18-4357556dc6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:11.166949 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2182b2-4c89-45f0-bc18-4357556dc6d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:11.167232 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2182b2-4c89-45f0-bc18-4357556dc6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:11.167508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2182b2-4c89-45f0-bc18-4357556dc6d0 admin admin] PATH_INFO: `/v3/projects/39ebd599835f43b4b2670a4597e2c5c4/users/5ecfd0a00a2747469396c132de0fd47f/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:11.169468 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2182b2-4c89-45f0-bc18-4357556dc6d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ebd599835f43b4b2670a4597e2c5c4, user_id=5ecfd0a00a2747469396c132de0fd47f, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:11.172197 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2182b2-4c89-45f0-bc18-4357556dc6d0 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:11.183803 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 899/1799] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:11 2022] PUT /identity/v3/projects/39ebd599835f43b4b2670a4597e2c5c4/users/5ecfd0a00a2747469396c132de0fd47f/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:11.184591 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2182b2-4c89-45f0-bc18-4357556dc6d0 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:11.186430 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-cc2182b2-4c89-45f0-bc18-4357556dc6d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:11.225111 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:11.235263 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 901/1800] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:34:11 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:11.235263 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507b64e-787e-4c9d-bead-f9840354a56f admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:11.250617 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2182b2-4c89-45f0-bc18-4357556dc6d0 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:11.298739 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039e922-314d-4ba7-a5f3-07d08f7299bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:11.299285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039e922-314d-4ba7-a5f3-07d08f7299bd service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:11.299556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039e922-314d-4ba7-a5f3-07d08f7299bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:11.299825 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039e922-314d-4ba7-a5f3-07d08f7299bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:11.299975 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507b64e-787e-4c9d-bead-f9840354a56f admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:11.306884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62435b-1408-46ac-abea-69b5f255a6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:11.307525 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62435b-1408-46ac-abea-69b5f255a6c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:11.307862 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62435b-1408-46ac-abea-69b5f255a6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:11.308124 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62435b-1408-46ac-abea-69b5f255a6c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:11.308755 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62435b-1408-46ac-abea-69b5f255a6c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:11.310965 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62435b-1408-46ac-abea-69b5f255a6c3 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:11.357839 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039e922-314d-4ba7-a5f3-07d08f7299bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:11.359309 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039e922-314d-4ba7-a5f3-07d08f7299bd service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:11.368874 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 900/1801] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:34:11.370122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d27cf5-473d-4113-8e11-e0a8b19bad57 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:11.370431 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d27cf5-473d-4113-8e11-e0a8b19bad57 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:11.370976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d27cf5-473d-4113-8e11-e0a8b19bad57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:11.400115 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-14d27cf5-473d-4113-8e11-e0a8b19bad57 None None] MFA Rules not processed for user `5ecfd0a00a2747469396c132de0fd47f`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:11.401381 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-14d27cf5-473d-4113-8e11-e0a8b19bad57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:11.410273 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 902/1802] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:34:11 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:11.410273 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62435b-1408-46ac-abea-69b5f255a6c3 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:11.485696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62435b-1408-46ac-abea-69b5f255a6c3 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:11.486945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 901/1803] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:11.486945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d27cf5-473d-4113-8e11-e0a8b19bad57 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:11.498918 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a372940-e185-4a9f-8eb0-603e3f5d869d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:11.505003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d27cf5-473d-4113-8e11-e0a8b19bad57 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:11.505141 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a372940-e185-4a9f-8eb0-603e3f5d869d admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:11.505141 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a372940-e185-4a9f-8eb0-603e3f5d869d admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:11.505141 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a372940-e185-4a9f-8eb0-603e3f5d869d admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:11.505141 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a372940-e185-4a9f-8eb0-603e3f5d869d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:11.505141 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a372940-e185-4a9f-8eb0-603e3f5d869d admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:11.505530 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a791c0-759d-4796-a772-4ed91c0ffeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:11.505728 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a791c0-759d-4796-a772-4ed91c0ffeb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:11.506165 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a791c0-759d-4796-a772-4ed91c0ffeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:11.506371 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a791c0-759d-4796-a772-4ed91c0ffeb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:11.507677 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a791c0-759d-4796-a772-4ed91c0ffeb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:11.509611 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a791c0-759d-4796-a772-4ed91c0ffeb1 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:11.637247 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 903/1804] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:34:11 2022] POST /identity/v3/users => generated 285 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:11.637247 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a372940-e185-4a9f-8eb0-603e3f5d869d admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:11.637247 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-3a372940-e185-4a9f-8eb0-603e3f5d869d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:11.666282 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 902/1805] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:34:11 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:11.668454 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a791c0-759d-4796-a772-4ed91c0ffeb1 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:11.680048 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a791c0-759d-4796-a772-4ed91c0ffeb1 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:11.685335 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79674ed7-64a0-4b13-b5d7-b7a78a719f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:11.685945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79674ed7-64a0-4b13-b5d7-b7a78a719f4b admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:11.686219 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79674ed7-64a0-4b13-b5d7-b7a78a719f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:11.686491 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79674ed7-64a0-4b13-b5d7-b7a78a719f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:11.687169 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79674ed7-64a0-4b13-b5d7-b7a78a719f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:11.688806 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79674ed7-64a0-4b13-b5d7-b7a78a719f4b admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:11.699819 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 903/1806] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:11.700777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79674ed7-64a0-4b13-b5d7-b7a78a719f4b admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:11.707728 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a372940-e185-4a9f-8eb0-603e3f5d869d admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:11.710719 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79674ed7-64a0-4b13-b5d7-b7a78a719f4b admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:11.712019 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6f5f9-97da-4474-8e90-575a4ca84206 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:11.712624 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6f5f9-97da-4474-8e90-575a4ca84206 service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:11.712901 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6f5f9-97da-4474-8e90-575a4ca84206 service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:11.713168 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6f5f9-97da-4474-8e90-575a4ca84206 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:11.714903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-deb6f5f9-97da-4474-8e90-575a4ca84206 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:11.715780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d717552-d823-4051-a6c3-dceb407efea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:11.716363 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d717552-d823-4051-a6c3-dceb407efea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:11.716642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d717552-d823-4051-a6c3-dceb407efea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:11.716917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d717552-d823-4051-a6c3-dceb407efea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:11.717552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d717552-d823-4051-a6c3-dceb407efea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:11.719302 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d717552-d823-4051-a6c3-dceb407efea7 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:11.730259 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 904/1807] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:11.731198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d717552-d823-4051-a6c3-dceb407efea7 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:11.741237 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d717552-d823-4051-a6c3-dceb407efea7 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:11.747443 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6c9db-417b-4020-b912-f93429b31f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:11.748026 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6c9db-417b-4020-b912-f93429b31f01 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:11.748330 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6c9db-417b-4020-b912-f93429b31f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:11.748601 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6c9db-417b-4020-b912-f93429b31f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:11.749287 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6c9db-417b-4020-b912-f93429b31f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:11.750904 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6c9db-417b-4020-b912-f93429b31f01 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:11.764460 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 905/1808] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:11.764460 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6c9db-417b-4020-b912-f93429b31f01 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:11.774177 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6c9db-417b-4020-b912-f93429b31f01 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:11.775483 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:11.779119 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6f5f9-97da-4474-8e90-575a4ca84206 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:11.779567 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622cc8f-8a67-406c-9f64-70fd5a1e4f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:11.780147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622cc8f-8a67-406c-9f64-70fd5a1e4f14 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:11.780573 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622cc8f-8a67-406c-9f64-70fd5a1e4f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:11.780684 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6f5f9-97da-4474-8e90-575a4ca84206 service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:11.780848 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622cc8f-8a67-406c-9f64-70fd5a1e4f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:11.781477 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622cc8f-8a67-406c-9f64-70fd5a1e4f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:11.783079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622cc8f-8a67-406c-9f64-70fd5a1e4f14 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:11.790405 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 904/1809] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:34:11.791230 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6f5f9-97da-4474-8e90-575a4ca84206 service cinder] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:11.795400 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 906/1810] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:11.799178 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622cc8f-8a67-406c-9f64-70fd5a1e4f14 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:11.805472 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6f5f9-97da-4474-8e90-575a4ca84206 service cinder] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:11.811488 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622cc8f-8a67-406c-9f64-70fd5a1e4f14 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:11.811621 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5d3ad-0cdc-493a-a54e-4811002c02d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:11.812200 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5d3ad-0cdc-493a-a54e-4811002c02d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:11.812482 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5d3ad-0cdc-493a-a54e-4811002c02d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:11.812752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5d3ad-0cdc-493a-a54e-4811002c02d4 admin admin] PATH_INFO: `/v3/projects/66740e8f9ee24f0daaf5531a41d281e7/users/90fef6e8769b4f0bb7558791133464a9/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:11.817021 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d07746-1ab3-4763-903e-31764b6bd6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:11.817667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d07746-1ab3-4763-903e-31764b6bd6e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:11.817948 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d07746-1ab3-4763-903e-31764b6bd6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:11.818222 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d07746-1ab3-4763-903e-31764b6bd6e4 admin admin] PATH_INFO: `/v3/projects/0ad9dc77d6ea4e7790a8093539b51cd7/users/39a3f523d6b244e6a241b891599cfbb9/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:11.828065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5d3ad-0cdc-493a-a54e-4811002c02d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66740e8f9ee24f0daaf5531a41d281e7, user_id=90fef6e8769b4f0bb7558791133464a9, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:11.830768 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5d3ad-0cdc-493a-a54e-4811002c02d4 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:11.848077 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d07746-1ab3-4763-903e-31764b6bd6e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ad9dc77d6ea4e7790a8093539b51cd7, user_id=39a3f523d6b244e6a241b891599cfbb9, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:11.850332 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d07746-1ab3-4763-903e-31764b6bd6e4 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:11.874062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:11.948107 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 905/1811] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:11 2022] PUT /identity/v3/projects/66740e8f9ee24f0daaf5531a41d281e7/users/90fef6e8769b4f0bb7558791133464a9/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:11.959151 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e89b3-4e50-4c22-8095-70f328bf394d None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:11.959439 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e89b3-4e50-4c22-8095-70f328bf394d None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:11.959716 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e89b3-4e50-4c22-8095-70f328bf394d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:11.961314 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 907/1812] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:11 2022] PUT /identity/v3/projects/0ad9dc77d6ea4e7790a8093539b51cd7/users/39a3f523d6b244e6a241b891599cfbb9/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:34:11.966141 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6f369-cf07-4164-a5b1-907f30fe959c None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:11.966488 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6f369-cf07-4164-a5b1-907f30fe959c None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:11.966705 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6f369-cf07-4164-a5b1-907f30fe959c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:11.987264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-b8f6f369-cf07-4164-a5b1-907f30fe959c None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:11.988505 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-b8f6f369-cf07-4164-a5b1-907f30fe959c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:11.992937 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-fc9e89b3-4e50-4c22-8095-70f328bf394d None None] MFA Rules not processed for user `90fef6e8769b4f0bb7558791133464a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:11.994107 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-fc9e89b3-4e50-4c22-8095-70f328bf394d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:12.047381 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 908/1813] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:12.057520 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6f369-cf07-4164-a5b1-907f30fe959c None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:12.059150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-b8f6f369-cf07-4164-a5b1-907f30fe959c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:12.059964 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 906/1814] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:12.064353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e89b3-4e50-4c22-8095-70f328bf394d None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:12.074943 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e89b3-4e50-4c22-8095-70f328bf394d None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:12.080058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cee7f5-e5b5-4587-b4de-68dfb8caa9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:12.080673 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cee7f5-e5b5-4587-b4de-68dfb8caa9fc admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:12.082468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cee7f5-e5b5-4587-b4de-68dfb8caa9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:12.082468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cee7f5-e5b5-4587-b4de-68dfb8caa9fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:12.082468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cee7f5-e5b5-4587-b4de-68dfb8caa9fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:12.083941 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cee7f5-e5b5-4587-b4de-68dfb8caa9fc admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:12.120992 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6f369-cf07-4164-a5b1-907f30fe959c None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:12.125125 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeecf16-32ce-450e-bcc3-b027546629d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:12.125800 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeecf16-32ce-450e-bcc3-b027546629d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:12.131095 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeecf16-32ce-450e-bcc3-b027546629d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:12.131095 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeecf16-32ce-450e-bcc3-b027546629d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:12.136519 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeecf16-32ce-450e-bcc3-b027546629d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:12.137988 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeecf16-32ce-450e-bcc3-b027546629d1 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:12.148182 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 909/1815] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:34:12.206382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 907/1816] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:34:12 2022] POST /identity/v3/projects => generated 369 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:34:12.211045 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeecf16-32ce-450e-bcc3-b027546629d1 service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:12.221291 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeecf16-32ce-450e-bcc3-b027546629d1 service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:12.298023 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:12.309489 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032fd90-abff-4e55-a19a-620ae006cc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:12.310396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032fd90-abff-4e55-a19a-620ae006cc9d admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:12.310707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032fd90-abff-4e55-a19a-620ae006cc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:12.311021 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032fd90-abff-4e55-a19a-620ae006cc9d admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:12.311667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032fd90-abff-4e55-a19a-620ae006cc9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:12.313638 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032fd90-abff-4e55-a19a-620ae006cc9d admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:12.418449 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 910/1817] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:34:12 2022] POST /identity/v3/users => generated 291 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:12.422177 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cee7f5-e5b5-4587-b4de-68dfb8caa9fc admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:12.436345 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cee7f5-e5b5-4587-b4de-68dfb8caa9fc admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:12.442256 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced3eb5-7e18-4637-94bc-a1c5c926e8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:12.443624 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced3eb5-7e18-4637-94bc-a1c5c926e8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:12.443931 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced3eb5-7e18-4637-94bc-a1c5c926e8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:12.444206 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced3eb5-7e18-4637-94bc-a1c5c926e8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:12.445504 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced3eb5-7e18-4637-94bc-a1c5c926e8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:12.447420 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced3eb5-7e18-4637-94bc-a1c5c926e8e8 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:12.461253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 908/1818] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:12.464994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032fd90-abff-4e55-a19a-620ae006cc9d admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:12.479667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032fd90-abff-4e55-a19a-620ae006cc9d admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:12.495553 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da01269-7d2e-4d8d-9991-fb8a31199b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:12.496448 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da01269-7d2e-4d8d-9991-fb8a31199b1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:12.497017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da01269-7d2e-4d8d-9991-fb8a31199b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:12.497858 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da01269-7d2e-4d8d-9991-fb8a31199b1b admin admin] PATH_INFO: `/v3/projects/92d144f0d26f41cbb43aaa35e67c4c14/users/2b2158db08ce4ad3a0f3b3200602d94f/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:12.515005 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da01269-7d2e-4d8d-9991-fb8a31199b1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d144f0d26f41cbb43aaa35e67c4c14, user_id=2b2158db08ce4ad3a0f3b3200602d94f, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:12.517584 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da01269-7d2e-4d8d-9991-fb8a31199b1b admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:12.572113 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:12.607177 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 911/1819] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:12 2022] PUT /identity/v3/projects/92d144f0d26f41cbb43aaa35e67c4c14/users/2b2158db08ce4ad3a0f3b3200602d94f/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:12.613499 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced3eb5-7e18-4637-94bc-a1c5c926e8e8 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:12.624747 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced3eb5-7e18-4637-94bc-a1c5c926e8e8 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:12.683690 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755beb4-37ef-49d1-ae6f-ea04e46d48ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:12.684304 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755beb4-37ef-49d1-ae6f-ea04e46d48ac admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:12.684577 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755beb4-37ef-49d1-ae6f-ea04e46d48ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:12.685124 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755beb4-37ef-49d1-ae6f-ea04e46d48ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:12.685812 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755beb4-37ef-49d1-ae6f-ea04e46d48ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:12.687515 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755beb4-37ef-49d1-ae6f-ea04e46d48ac admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:12.698797 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 909/1820] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:12.703015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da01269-7d2e-4d8d-9991-fb8a31199b1b admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:12.725742 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da01269-7d2e-4d8d-9991-fb8a31199b1b admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:12.725742 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875ca6e-23d9-417f-9ae0-a478a2947691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:12.725742 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875ca6e-23d9-417f-9ae0-a478a2947691 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:12.725742 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875ca6e-23d9-417f-9ae0-a478a2947691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:12.726080 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875ca6e-23d9-417f-9ae0-a478a2947691 admin admin] PATH_INFO: `/v3/projects/92d144f0d26f41cbb43aaa35e67c4c14/users/2b2158db08ce4ad3a0f3b3200602d94f/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:12.726654 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875ca6e-23d9-417f-9ae0-a478a2947691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d144f0d26f41cbb43aaa35e67c4c14, user_id=2b2158db08ce4ad3a0f3b3200602d94f, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:12.730054 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875ca6e-23d9-417f-9ae0-a478a2947691 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:12.744525 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 912/1821] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:12 2022] PUT /identity/v3/projects/92d144f0d26f41cbb43aaa35e67c4c14/users/2b2158db08ce4ad3a0f3b3200602d94f/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:12.756190 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ff4fc-c7dc-42a9-b0e0-b097256e69dd None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:12.756649 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ff4fc-c7dc-42a9-b0e0-b097256e69dd None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:12.756726 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ff4fc-c7dc-42a9-b0e0-b097256e69dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:12.802856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-f55ff4fc-c7dc-42a9-b0e0-b097256e69dd None None] MFA Rules not processed for user `2b2158db08ce4ad3a0f3b3200602d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:12.804479 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-f55ff4fc-c7dc-42a9-b0e0-b097256e69dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:12.900076 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 910/1822] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:34:12.912860 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875ca6e-23d9-417f-9ae0-a478a2947691 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:12.970419 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875ca6e-23d9-417f-9ae0-a478a2947691 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:12.974224 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d52b8-4d88-4c33-878b-533107dfc7da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:12.974959 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d52b8-4d88-4c33-878b-533107dfc7da service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:12.975360 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d52b8-4d88-4c33-878b-533107dfc7da service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:12.975642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d52b8-4d88-4c33-878b-533107dfc7da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:12.984945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d52b8-4d88-4c33-878b-533107dfc7da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:12.986412 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d52b8-4d88-4c33-878b-533107dfc7da service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:12.996628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 913/1823] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:34:13.198247 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ff4fc-c7dc-42a9-b0e0-b097256e69dd None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:13.207897 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ff4fc-c7dc-42a9-b0e0-b097256e69dd None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:13.217558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a9e1e-2ad0-412c-8bbc-b36e3f9224d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:13.220958 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a9e1e-2ad0-412c-8bbc-b36e3f9224d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:13.220958 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a9e1e-2ad0-412c-8bbc-b36e3f9224d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:13.220958 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a9e1e-2ad0-412c-8bbc-b36e3f9224d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:13.263837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:13.285948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a9e1e-2ad0-412c-8bbc-b36e3f9224d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:13.287527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a9e1e-2ad0-412c-8bbc-b36e3f9224d3 service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:13.314023 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 911/1824] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:34:13.887025 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09771b5f-d8bb-4267-b173-7164a6deda58 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:13.887867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09771b5f-d8bb-4267-b173-7164a6deda58 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:13.888326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09771b5f-d8bb-4267-b173-7164a6deda58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:13.927613 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-09771b5f-d8bb-4267-b173-7164a6deda58 None None] MFA Rules not processed for user `39a3f523d6b244e6a241b891599cfbb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:13.928932 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-09771b5f-d8bb-4267-b173-7164a6deda58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:13.995712 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 914/1825] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:14.006892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a9e1e-2ad0-412c-8bbc-b36e3f9224d3 service cinder] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:14.016132 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a9e1e-2ad0-412c-8bbc-b36e3f9224d3 service cinder] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:14.019988 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff81aba-66e5-49de-a045-872c49e1c5b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:14.023435 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff81aba-66e5-49de-a045-872c49e1c5b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:14.023435 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff81aba-66e5-49de-a045-872c49e1c5b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:14.023435 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff81aba-66e5-49de-a045-872c49e1c5b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:14.030693 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff81aba-66e5-49de-a045-872c49e1c5b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:14.032241 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff81aba-66e5-49de-a045-872c49e1c5b7 service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:14.041836 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 912/1826] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:34:14.184729 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:15.079886 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=81,keystone:INSERT=2,keystone:DELETE=17 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:15.100576 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09771b5f-d8bb-4267-b173-7164a6deda58 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:15.110120 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09771b5f-d8bb-4267-b173-7164a6deda58 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:15.113789 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90762d-a1f5-4abc-abc9-52bdbbd71e2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:15.114391 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90762d-a1f5-4abc-abc9-52bdbbd71e2b service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:15.119133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90762d-a1f5-4abc-abc9-52bdbbd71e2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:15.119133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90762d-a1f5-4abc-abc9-52bdbbd71e2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:15.119133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-6f90762d-a1f5-4abc-abc9-52bdbbd71e2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:15.187392 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90762d-a1f5-4abc-abc9-52bdbbd71e2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:15.188956 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90762d-a1f5-4abc-abc9-52bdbbd71e2b service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:15.202789 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 915/1827] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:34:16.171549 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:17.126523 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:17.523444 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff81aba-66e5-49de-a045-872c49e1c5b7 service cinder] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:17.591968 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747392e-fc8f-4f04-805f-d4bdddcf4358 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:17.592853 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747392e-fc8f-4f04-805f-d4bdddcf4358 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:17.593934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747392e-fc8f-4f04-805f-d4bdddcf4358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:17.627671 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-b747392e-fc8f-4f04-805f-d4bdddcf4358 None None] MFA Rules not processed for user `39a3f523d6b244e6a241b891599cfbb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:17.628906 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-b747392e-fc8f-4f04-805f-d4bdddcf4358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:17.635543 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff81aba-66e5-49de-a045-872c49e1c5b7 service cinder] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:17.642606 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 916/1828] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:34:17.646598 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781ab84-3ae9-4863-84de-eeccd8d29e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:17.646598 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781ab84-3ae9-4863-84de-eeccd8d29e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:17.646598 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781ab84-3ae9-4863-84de-eeccd8d29e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:17.646598 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781ab84-3ae9-4863-84de-eeccd8d29e5e admin admin] PATH_INFO: `/v3/users/e30938a4ce8a4e41b7d76fc6a069b0a7` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:17.647161 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781ab84-3ae9-4863-84de-eeccd8d29e5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e30938a4ce8a4e41b7d76fc6a069b0a7)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:17.649232 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781ab84-3ae9-4863-84de-eeccd8d29e5e admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:17.817271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:17.910301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747392e-fc8f-4f04-805f-d4bdddcf4358 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:17.913063 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747392e-fc8f-4f04-805f-d4bdddcf4358 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:17.920479 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a95a68-a560-4bda-b03a-41cba488065e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:17.920479 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a95a68-a560-4bda-b03a-41cba488065e service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:17.920479 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a95a68-a560-4bda-b03a-41cba488065e service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:17.920479 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a95a68-a560-4bda-b03a-41cba488065e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:17.960415 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b781ab84-3ae9-4863-84de-eeccd8d29e5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e30938a4ce8a4e41b7d76fc6a069b0a7'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:17.960415 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b781ab84-3ae9-4863-84de-eeccd8d29e5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e30938a4ce8a4e41b7d76fc6a069b0a7'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:18.003716 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a95a68-a560-4bda-b03a-41cba488065e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:18.005440 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a95a68-a560-4bda-b03a-41cba488065e service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:18.016655 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 917/1829] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:34:18.085567 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b781ab84-3ae9-4863-84de-eeccd8d29e5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e30938a4ce8a4e41b7d76fc6a069b0a7'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:18.095222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b781ab84-3ae9-4863-84de-eeccd8d29e5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e30938a4ce8a4e41b7d76fc6a069b0a7'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:18.096991 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b781ab84-3ae9-4863-84de-eeccd8d29e5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e30938a4ce8a4e41b7d76fc6a069b0a7'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:18.119902 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 913/1830] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:34:17 2022] DELETE /identity/v3/users/e30938a4ce8a4e41b7d76fc6a069b0a7 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:18.128525 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbdb5c-1b84-4a08-a1a9-758ec689c86d None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:18.128525 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbdb5c-1b84-4a08-a1a9-758ec689c86d None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:18.128525 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbdb5c-1b84-4a08-a1a9-758ec689c86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:18.150052 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-52bbdb5c-1b84-4a08-a1a9-758ec689c86d None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:18.151414 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-52bbdb5c-1b84-4a08-a1a9-758ec689c86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:18.214992 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 918/1831] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:18.225039 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781ab84-3ae9-4863-84de-eeccd8d29e5e admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:18.227209 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-b781ab84-3ae9-4863-84de-eeccd8d29e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:18.285845 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781ab84-3ae9-4863-84de-eeccd8d29e5e admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:18.290200 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d162b6-eca2-45fb-9d6a-99227956b56e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:18.290801 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d162b6-eca2-45fb-9d6a-99227956b56e service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:18.291104 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d162b6-eca2-45fb-9d6a-99227956b56e service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:18.291372 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d162b6-eca2-45fb-9d6a-99227956b56e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:18.301538 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d162b6-eca2-45fb-9d6a-99227956b56e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:18.303007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d162b6-eca2-45fb-9d6a-99227956b56e service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:18.323926 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 914/1832] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:34:18.519677 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:18.940959 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbdb5c-1b84-4a08-a1a9-758ec689c86d None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:18.942531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-52bbdb5c-1b84-4a08-a1a9-758ec689c86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:18.957878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbdb5c-1b84-4a08-a1a9-758ec689c86d None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:18.963709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf53bb7-32fe-4b14-9df4-5b86c9117dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:18.964631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf53bb7-32fe-4b14-9df4-5b86c9117dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:18.964998 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf53bb7-32fe-4b14-9df4-5b86c9117dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:18.965488 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf53bb7-32fe-4b14-9df4-5b86c9117dec admin admin] PATH_INFO: `/v3/projects/0f7deffe164e47bc81b4407fd31a76df` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:18.971036 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf53bb7-32fe-4b14-9df4-5b86c9117dec admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f7deffe164e47bc81b4407fd31a76df)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:18.973671 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf53bb7-32fe-4b14-9df4-5b86c9117dec admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:19.118610 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2cf53bb7-32fe-4b14-9df4-5b86c9117dec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f7deffe164e47bc81b4407fd31a76df', 'request_id': 'req-2cf53bb7-32fe-4b14-9df4-5b86c9117dec'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:19.127607 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2cf53bb7-32fe-4b14-9df4-5b86c9117dec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f7deffe164e47bc81b4407fd31a76df', 'request_id': 'req-2cf53bb7-32fe-4b14-9df4-5b86c9117dec'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:19.234013 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2cf53bb7-32fe-4b14-9df4-5b86c9117dec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f7deffe164e47bc81b4407fd31a76df', 'request_id': 'req-2cf53bb7-32fe-4b14-9df4-5b86c9117dec'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:19.248193 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2cf53bb7-32fe-4b14-9df4-5b86c9117dec admin admin] The token cache is being invalidate because project 0f7deffe164e47bc81b4407fd31a76df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:34:19.248193 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2cf53bb7-32fe-4b14-9df4-5b86c9117dec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:19.248917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2cf53bb7-32fe-4b14-9df4-5b86c9117dec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:19.250415 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 919/1833] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:34:18 2022] DELETE /identity/v3/projects/0f7deffe164e47bc81b4407fd31a76df => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:19.255373 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a5e76-0ee0-4f46-b633-c39e6a103f44 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:19.255890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a5e76-0ee0-4f46-b633-c39e6a103f44 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:19.255890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a5e76-0ee0-4f46-b633-c39e6a103f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:19.276008 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-763a5e76-0ee0-4f46-b633-c39e6a103f44 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:19.277229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-763a5e76-0ee0-4f46-b633-c39e6a103f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:19.336034 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 915/1834] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:19.344059 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed1cb3-665c-4150-b4be-c0d937a8b9ed None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:19.346405 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed1cb3-665c-4150-b4be-c0d937a8b9ed None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:19.346405 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed1cb3-665c-4150-b4be-c0d937a8b9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:19.364861 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-07ed1cb3-665c-4150-b4be-c0d937a8b9ed None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:19.366053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-07ed1cb3-665c-4150-b4be-c0d937a8b9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:19.375454 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 920/1835] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:19.379669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a5e76-0ee0-4f46-b633-c39e6a103f44 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:19.390019 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a5e76-0ee0-4f46-b633-c39e6a103f44 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:19.399908 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0259e-17b2-4285-8ff9-8b165c7b0306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:19.399908 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0259e-17b2-4285-8ff9-8b165c7b0306 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:19.399908 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0259e-17b2-4285-8ff9-8b165c7b0306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:19.399908 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0259e-17b2-4285-8ff9-8b165c7b0306 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:19.400697 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0259e-17b2-4285-8ff9-8b165c7b0306 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:34:19.400697 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0259e-17b2-4285-8ff9-8b165c7b0306 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:19.400697 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0259e-17b2-4285-8ff9-8b165c7b0306 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:19.415001 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 916/1836] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:34:19.419456 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed1cb3-665c-4150-b4be-c0d937a8b9ed None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:19.431455 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed1cb3-665c-4150-b4be-c0d937a8b9ed None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:19.436565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41ac33-11de-44e6-b920-454ae476299c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:19.437312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41ac33-11de-44e6-b920-454ae476299c admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:19.437598 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41ac33-11de-44e6-b920-454ae476299c admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:19.437873 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41ac33-11de-44e6-b920-454ae476299c admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:19.438519 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41ac33-11de-44e6-b920-454ae476299c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:19.440576 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41ac33-11de-44e6-b920-454ae476299c admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:19.584236 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 921/1837] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:34:19 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:19.589735 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0259e-17b2-4285-8ff9-8b165c7b0306 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:19.599922 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0259e-17b2-4285-8ff9-8b165c7b0306 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:19.658751 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65cebdc-a896-4189-859e-0157da2766a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:19.659398 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cebdc-a896-4189-859e-0157da2766a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:19.659677 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cebdc-a896-4189-859e-0157da2766a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:19.659956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cebdc-a896-4189-859e-0157da2766a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:19.660597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65cebdc-a896-4189-859e-0157da2766a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:19.662558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65cebdc-a896-4189-859e-0157da2766a8 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:19.857664 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:19.863633 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 917/1838] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:34:19 2022] POST /identity/v3/users => generated 286 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:19.871677 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41ac33-11de-44e6-b920-454ae476299c admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:19.882635 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41ac33-11de-44e6-b920-454ae476299c admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:19.887851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa61983-350b-4432-930d-51043b7946bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:19.891412 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa61983-350b-4432-930d-51043b7946bf admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:19.891412 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa61983-350b-4432-930d-51043b7946bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:19.891412 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa61983-350b-4432-930d-51043b7946bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:19.891412 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa61983-350b-4432-930d-51043b7946bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:19.891412 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa61983-350b-4432-930d-51043b7946bf admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:19.907048 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 922/1839] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:19.909328 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65cebdc-a896-4189-859e-0157da2766a8 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:19.922925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65cebdc-a896-4189-859e-0157da2766a8 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:19.927126 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4688c3-a813-45cd-9ee5-98c5b6880616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:19.927897 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4688c3-a813-45cd-9ee5-98c5b6880616 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:19.928271 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4688c3-a813-45cd-9ee5-98c5b6880616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:19.928611 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4688c3-a813-45cd-9ee5-98c5b6880616 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:19.929387 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4688c3-a813-45cd-9ee5-98c5b6880616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:19.931129 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4688c3-a813-45cd-9ee5-98c5b6880616 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:19.941890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 918/1840] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:19.946773 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa61983-350b-4432-930d-51043b7946bf admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:19.957083 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa61983-350b-4432-930d-51043b7946bf admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:19.962629 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778e6a1-8492-4af0-9789-2f1a1dfa507d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:19.963322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778e6a1-8492-4af0-9789-2f1a1dfa507d admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:19.963603 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778e6a1-8492-4af0-9789-2f1a1dfa507d admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:19.964073 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778e6a1-8492-4af0-9789-2f1a1dfa507d admin admin] PATH_INFO: `/v3/projects/ff1e447b7be2499b8d392832aae8f81f/users/9adda55e1a6a4e1d8ea39ccbe0f10b36/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:19.965904 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:19.979572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778e6a1-8492-4af0-9789-2f1a1dfa507d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1e447b7be2499b8d392832aae8f81f, user_id=9adda55e1a6a4e1d8ea39ccbe0f10b36, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:19.982267 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778e6a1-8492-4af0-9789-2f1a1dfa507d admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:20.103083 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 923/1841] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:19 2022] PUT /identity/v3/projects/ff1e447b7be2499b8d392832aae8f81f/users/9adda55e1a6a4e1d8ea39ccbe0f10b36/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:20.113590 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f59589-4f4e-4181-a286-4615dadc7d02 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:20.113889 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f59589-4f4e-4181-a286-4615dadc7d02 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:20.114186 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f59589-4f4e-4181-a286-4615dadc7d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:20.142583 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-b3f59589-4f4e-4181-a286-4615dadc7d02 None None] MFA Rules not processed for user `9adda55e1a6a4e1d8ea39ccbe0f10b36`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:20.143828 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-b3f59589-4f4e-4181-a286-4615dadc7d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:20.235028 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 919/1842] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:20.248454 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778e6a1-8492-4af0-9789-2f1a1dfa507d admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:20.250394 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-6778e6a1-8492-4af0-9789-2f1a1dfa507d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:20.323516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778e6a1-8492-4af0-9789-2f1a1dfa507d admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:20.327590 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fc5ae-2540-4802-847d-43022f6a9b2f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9e8a7a5b8944272a2d1bd2140819ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:20.328288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fc5ae-2540-4802-847d-43022f6a9b2f service glance] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:20.328626 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fc5ae-2540-4802-847d-43022f6a9b2f service glance] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:20.332248 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fc5ae-2540-4802-847d-43022f6a9b2f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:20.337777 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5fc5ae-2540-4802-847d-43022f6a9b2f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:20.339272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5fc5ae-2540-4802-847d-43022f6a9b2f service glance] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:20.348293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 924/1843] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:34:20.601875 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f59589-4f4e-4181-a286-4615dadc7d02 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:20.603426 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-b3f59589-4f4e-4181-a286-4615dadc7d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:20.690075 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f59589-4f4e-4181-a286-4615dadc7d02 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:20.694789 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650b7f3-9ddd-48d1-9f80-4136130ef3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:20.695529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650b7f3-9ddd-48d1-9f80-4136130ef3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:20.696297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650b7f3-9ddd-48d1-9f80-4136130ef3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:20.696297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650b7f3-9ddd-48d1-9f80-4136130ef3de admin admin] PATH_INFO: `/v3/users/90fef6e8769b4f0bb7558791133464a9` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:20.697195 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650b7f3-9ddd-48d1-9f80-4136130ef3de admin admin] RBAC: Authorizing `identity:delete_user(user_id=90fef6e8769b4f0bb7558791133464a9)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:20.699163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650b7f3-9ddd-48d1-9f80-4136130ef3de admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:20.962454 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-0650b7f3-9ddd-48d1-9f80-4136130ef3de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90fef6e8769b4f0bb7558791133464a9'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:20.963204 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-0650b7f3-9ddd-48d1-9f80-4136130ef3de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90fef6e8769b4f0bb7558791133464a9'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:21.050126 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-0650b7f3-9ddd-48d1-9f80-4136130ef3de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90fef6e8769b4f0bb7558791133464a9'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:21.058754 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-0650b7f3-9ddd-48d1-9f80-4136130ef3de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90fef6e8769b4f0bb7558791133464a9'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:21.059443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-0650b7f3-9ddd-48d1-9f80-4136130ef3de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90fef6e8769b4f0bb7558791133464a9'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:21.082270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 920/1844] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:34:20 2022] DELETE /identity/v3/users/90fef6e8769b4f0bb7558791133464a9 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:21.084435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218afdb2-a9b2-4ce3-8f9d-4a8b486b3589 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:21.084989 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218afdb2-a9b2-4ce3-8f9d-4a8b486b3589 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:21.085097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218afdb2-a9b2-4ce3-8f9d-4a8b486b3589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:21.106309 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-218afdb2-a9b2-4ce3-8f9d-4a8b486b3589 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:21.107509 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-218afdb2-a9b2-4ce3-8f9d-4a8b486b3589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:21.170099 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 925/1845] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:21.180476 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650b7f3-9ddd-48d1-9f80-4136130ef3de admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:21.182063 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-0650b7f3-9ddd-48d1-9f80-4136130ef3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:21.270908 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650b7f3-9ddd-48d1-9f80-4136130ef3de admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:21.275558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a010c0f-9648-4e6a-a0c8-a183d833385b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:21.276271 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a010c0f-9648-4e6a-a0c8-a183d833385b service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:21.276786 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a010c0f-9648-4e6a-a0c8-a183d833385b service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:21.277131 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a010c0f-9648-4e6a-a0c8-a183d833385b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:21.288274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a010c0f-9648-4e6a-a0c8-a183d833385b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:21.289830 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a010c0f-9648-4e6a-a0c8-a183d833385b service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:21.300941 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 921/1846] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:34:21.423158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:21.549414 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:21.900420 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218afdb2-a9b2-4ce3-8f9d-4a8b486b3589 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:21.903341 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-218afdb2-a9b2-4ce3-8f9d-4a8b486b3589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:21.920336 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218afdb2-a9b2-4ce3-8f9d-4a8b486b3589 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:21.926373 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46680dbe-e9bd-40c7-91ac-19ad78b4c4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:21.927075 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46680dbe-e9bd-40c7-91ac-19ad78b4c4eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:21.927358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46680dbe-e9bd-40c7-91ac-19ad78b4c4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:21.927713 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46680dbe-e9bd-40c7-91ac-19ad78b4c4eb admin admin] PATH_INFO: `/v3/projects/66740e8f9ee24f0daaf5531a41d281e7` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:21.928838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46680dbe-e9bd-40c7-91ac-19ad78b4c4eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=66740e8f9ee24f0daaf5531a41d281e7)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:21.931743 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46680dbe-e9bd-40c7-91ac-19ad78b4c4eb admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:22.081520 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-46680dbe-e9bd-40c7-91ac-19ad78b4c4eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66740e8f9ee24f0daaf5531a41d281e7', 'request_id': 'req-46680dbe-e9bd-40c7-91ac-19ad78b4c4eb'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:22.087583 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-46680dbe-e9bd-40c7-91ac-19ad78b4c4eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66740e8f9ee24f0daaf5531a41d281e7', 'request_id': 'req-46680dbe-e9bd-40c7-91ac-19ad78b4c4eb'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:22.183354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-46680dbe-e9bd-40c7-91ac-19ad78b4c4eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66740e8f9ee24f0daaf5531a41d281e7', 'request_id': 'req-46680dbe-e9bd-40c7-91ac-19ad78b4c4eb'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:22.207714 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-46680dbe-e9bd-40c7-91ac-19ad78b4c4eb admin admin] The token cache is being invalidate because project 66740e8f9ee24f0daaf5531a41d281e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:34:22.208365 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-46680dbe-e9bd-40c7-91ac-19ad78b4c4eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:22.209298 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-46680dbe-e9bd-40c7-91ac-19ad78b4c4eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:22.212474 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 926/1847] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:34:21 2022] DELETE /identity/v3/projects/66740e8f9ee24f0daaf5531a41d281e7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:22.216570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a010c0f-9648-4e6a-a0c8-a183d833385b service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:22.237404 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a010c0f-9648-4e6a-a0c8-a183d833385b service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:22.346741 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457b95b-2ae0-4740-8e0f-b29c1346f085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:22.346741 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457b95b-2ae0-4740-8e0f-b29c1346f085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:22.347217 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457b95b-2ae0-4740-8e0f-b29c1346f085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:22.347518 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457b95b-2ae0-4740-8e0f-b29c1346f085 admin admin] PATH_INFO: `/v3/users/2b2158db08ce4ad3a0f3b3200602d94f` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:22.348651 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457b95b-2ae0-4740-8e0f-b29c1346f085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b2158db08ce4ad3a0f3b3200602d94f)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:22.350589 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457b95b-2ae0-4740-8e0f-b29c1346f085 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:22.372292 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:22.514756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:22.597948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-5457b95b-2ae0-4740-8e0f-b29c1346f085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b2158db08ce4ad3a0f3b3200602d94f'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:22.598681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-5457b95b-2ae0-4740-8e0f-b29c1346f085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b2158db08ce4ad3a0f3b3200602d94f'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:22.627563 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:22.725890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-5457b95b-2ae0-4740-8e0f-b29c1346f085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b2158db08ce4ad3a0f3b3200602d94f'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:22.741833 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-5457b95b-2ae0-4740-8e0f-b29c1346f085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b2158db08ce4ad3a0f3b3200602d94f'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:22.742671 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-5457b95b-2ae0-4740-8e0f-b29c1346f085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b2158db08ce4ad3a0f3b3200602d94f'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:22.773356 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 922/1848] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:34:22 2022] DELETE /identity/v3/users/2b2158db08ce4ad3a0f3b3200602d94f => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:23.344107 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46680dbe-e9bd-40c7-91ac-19ad78b4c4eb admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:23.348908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-46680dbe-e9bd-40c7-91ac-19ad78b4c4eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:23.376937 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46680dbe-e9bd-40c7-91ac-19ad78b4c4eb admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:23.440906 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af13118-30b0-4959-a09a-22086e4f28d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:23.441499 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af13118-30b0-4959-a09a-22086e4f28d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:23.441778 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af13118-30b0-4959-a09a-22086e4f28d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:23.442049 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af13118-30b0-4959-a09a-22086e4f28d2 admin admin] PATH_INFO: `/v3/projects/92d144f0d26f41cbb43aaa35e67c4c14` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:23.443241 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af13118-30b0-4959-a09a-22086e4f28d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92d144f0d26f41cbb43aaa35e67c4c14)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:23.445327 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af13118-30b0-4959-a09a-22086e4f28d2 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:23.518919 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:23.700788 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-3af13118-30b0-4959-a09a-22086e4f28d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92d144f0d26f41cbb43aaa35e67c4c14', 'request_id': 'req-3af13118-30b0-4959-a09a-22086e4f28d2'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:23.706312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-3af13118-30b0-4959-a09a-22086e4f28d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92d144f0d26f41cbb43aaa35e67c4c14', 'request_id': 'req-3af13118-30b0-4959-a09a-22086e4f28d2'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:23.840557 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-3af13118-30b0-4959-a09a-22086e4f28d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92d144f0d26f41cbb43aaa35e67c4c14', 'request_id': 'req-3af13118-30b0-4959-a09a-22086e4f28d2'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:23.853632 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-3af13118-30b0-4959-a09a-22086e4f28d2 admin admin] The token cache is being invalidate because project 92d144f0d26f41cbb43aaa35e67c4c14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:34:23.855984 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-3af13118-30b0-4959-a09a-22086e4f28d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:23.855984 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-3af13118-30b0-4959-a09a-22086e4f28d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:23.860577 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 927/1849] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:34:23 2022] DELETE /identity/v3/projects/92d144f0d26f41cbb43aaa35e67c4c14 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:34:23.862242 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a37b95-82ba-4d17-8f95-74e532bbb80f None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:23.862969 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a37b95-82ba-4d17-8f95-74e532bbb80f None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:23.862969 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a37b95-82ba-4d17-8f95-74e532bbb80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:23.891149 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-73a37b95-82ba-4d17-8f95-74e532bbb80f None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:23.892800 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-73a37b95-82ba-4d17-8f95-74e532bbb80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:23.970843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 923/1850] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:34:23.982497 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb17d0-c719-423b-a155-f7ffad9a87ff None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:23.982798 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb17d0-c719-423b-a155-f7ffad9a87ff None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:23.983490 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb17d0-c719-423b-a155-f7ffad9a87ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:24.010686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-6cbb17d0-c719-423b-a155-f7ffad9a87ff None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:24.012278 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-6cbb17d0-c719-423b-a155-f7ffad9a87ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:24.026406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 928/1851] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:24.030681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a37b95-82ba-4d17-8f95-74e532bbb80f None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:24.042672 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a37b95-82ba-4d17-8f95-74e532bbb80f None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:24.047903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa55aa-30cf-4db6-bf1e-c4f1ed4bd1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:24.048659 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa55aa-30cf-4db6-bf1e-c4f1ed4bd1bf admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:24.048813 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa55aa-30cf-4db6-bf1e-c4f1ed4bd1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:24.049484 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa55aa-30cf-4db6-bf1e-c4f1ed4bd1bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:24.050212 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa55aa-30cf-4db6-bf1e-c4f1ed4bd1bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:34:24.050421 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa55aa-30cf-4db6-bf1e-c4f1ed4bd1bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:24.052071 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa55aa-30cf-4db6-bf1e-c4f1ed4bd1bf admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:24.067311 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 924/1852] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:34:24.073317 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb17d0-c719-423b-a155-f7ffad9a87ff None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:24.085301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb17d0-c719-423b-a155-f7ffad9a87ff None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:24.090915 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c74d9-1a6c-4788-a586-ab79901166b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:24.091532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c74d9-1a6c-4788-a586-ab79901166b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:24.091840 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c74d9-1a6c-4788-a586-ab79901166b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:24.092119 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c74d9-1a6c-4788-a586-ab79901166b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:24.092760 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c74d9-1a6c-4788-a586-ab79901166b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:24.095268 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c74d9-1a6c-4788-a586-ab79901166b2 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:24.270856 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 929/1853] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:34:24 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:24.273313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa55aa-30cf-4db6-bf1e-c4f1ed4bd1bf admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:24.316920 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa55aa-30cf-4db6-bf1e-c4f1ed4bd1bf admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:24.346325 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c74d9-1a6c-4788-a586-ab79901166b2 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:24.349229 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-133c74d9-1a6c-4788-a586-ab79901166b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:24.399136 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bfd36-4d7d-4d8c-b826-2e57c2d8f559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:24.400101 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bfd36-4d7d-4d8c-b826-2e57c2d8f559 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:24.401353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bfd36-4d7d-4d8c-b826-2e57c2d8f559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:24.401961 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bfd36-4d7d-4d8c-b826-2e57c2d8f559 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:24.402936 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bfd36-4d7d-4d8c-b826-2e57c2d8f559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:24.405297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bfd36-4d7d-4d8c-b826-2e57c2d8f559 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:24.440703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c74d9-1a6c-4788-a586-ab79901166b2 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:24.445813 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4001ca9-4038-438d-adce-ed1a5e7c920f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:24.446478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4001ca9-4038-438d-adce-ed1a5e7c920f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:24.453584 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4001ca9-4038-438d-adce-ed1a5e7c920f admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:24.453584 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4001ca9-4038-438d-adce-ed1a5e7c920f admin admin] PATH_INFO: `/v3/users/872db8bebb214d82a9731ab0a848b155` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:24.453584 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4001ca9-4038-438d-adce-ed1a5e7c920f admin admin] RBAC: Authorizing `identity:delete_user(user_id=872db8bebb214d82a9731ab0a848b155)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:24.453584 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4001ca9-4038-438d-adce-ed1a5e7c920f admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:24.532518 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 925/1854] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:34:24 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:24.536606 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bfd36-4d7d-4d8c-b826-2e57c2d8f559 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:24.546862 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:24.562477 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bfd36-4d7d-4d8c-b826-2e57c2d8f559 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:24.564960 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759983b-36eb-4445-addf-286bb5682c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:24.565744 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759983b-36eb-4445-addf-286bb5682c6e admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:24.566255 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759983b-36eb-4445-addf-286bb5682c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:24.566760 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759983b-36eb-4445-addf-286bb5682c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:24.567464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759983b-36eb-4445-addf-286bb5682c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:24.575012 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759983b-36eb-4445-addf-286bb5682c6e admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:24.598509 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 926/1855] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:24.608107 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759983b-36eb-4445-addf-286bb5682c6e admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:24.621386 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759983b-36eb-4445-addf-286bb5682c6e admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:24.628436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6eac5-3534-429d-83a9-b0aa48be9529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:24.629173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6eac5-3534-429d-83a9-b0aa48be9529 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:24.629658 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6eac5-3534-429d-83a9-b0aa48be9529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:24.629939 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6eac5-3534-429d-83a9-b0aa48be9529 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:24.630781 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6eac5-3534-429d-83a9-b0aa48be9529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:24.632890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6eac5-3534-429d-83a9-b0aa48be9529 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:24.648394 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 927/1856] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:24.655715 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6eac5-3534-429d-83a9-b0aa48be9529 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:24.683866 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6eac5-3534-429d-83a9-b0aa48be9529 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:24.689023 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0760267-2b78-4f2e-aa36-9f7a167f62c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:24.689775 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0760267-2b78-4f2e-aa36-9f7a167f62c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:24.690055 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0760267-2b78-4f2e-aa36-9f7a167f62c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:24.690327 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0760267-2b78-4f2e-aa36-9f7a167f62c0 admin admin] PATH_INFO: `/v3/projects/1821c94d0cf241b3b727e2333986375a/users/0cf8195d9e674e4f856a984306c7a36f/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:24.723079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0760267-2b78-4f2e-aa36-9f7a167f62c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1821c94d0cf241b3b727e2333986375a, user_id=0cf8195d9e674e4f856a984306c7a36f, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:24.726484 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0760267-2b78-4f2e-aa36-9f7a167f62c0 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:24.761898 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c4001ca9-4038-438d-adce-ed1a5e7c920f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872db8bebb214d82a9731ab0a848b155'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:24.762888 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c4001ca9-4038-438d-adce-ed1a5e7c920f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872db8bebb214d82a9731ab0a848b155'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:24.926576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 928/1857] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:24 2022] PUT /identity/v3/projects/1821c94d0cf241b3b727e2333986375a/users/0cf8195d9e674e4f856a984306c7a36f/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:34:24.939133 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7720a-4b50-42a8-9d6e-d7d35b255ce6 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:24.939419 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7720a-4b50-42a8-9d6e-d7d35b255ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:24.939695 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7720a-4b50-42a8-9d6e-d7d35b255ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:24.974401 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-dbf7720a-4b50-42a8-9d6e-d7d35b255ce6 None None] MFA Rules not processed for user `0cf8195d9e674e4f856a984306c7a36f`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:24.980382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-dbf7720a-4b50-42a8-9d6e-d7d35b255ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:25.017152 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c4001ca9-4038-438d-adce-ed1a5e7c920f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872db8bebb214d82a9731ab0a848b155'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:25.045583 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c4001ca9-4038-438d-adce-ed1a5e7c920f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872db8bebb214d82a9731ab0a848b155'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:25.047297 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c4001ca9-4038-438d-adce-ed1a5e7c920f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872db8bebb214d82a9731ab0a848b155'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:25.065713 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 930/1858] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:34:24 2022] DELETE /identity/v3/users/872db8bebb214d82a9731ab0a848b155 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:34:25.070170 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47625e6f-4785-4d62-b2db-9e9b2c32d471 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:25.070791 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47625e6f-4785-4d62-b2db-9e9b2c32d471 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:25.071238 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47625e6f-4785-4d62-b2db-9e9b2c32d471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:25.071549 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 929/1859] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:25.076984 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7720a-4b50-42a8-9d6e-d7d35b255ce6 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:25.078441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-dbf7720a-4b50-42a8-9d6e-d7d35b255ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:25.095516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-47625e6f-4785-4d62-b2db-9e9b2c32d471 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:25.097134 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-47625e6f-4785-4d62-b2db-9e9b2c32d471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:25.168563 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7720a-4b50-42a8-9d6e-d7d35b255ce6 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:25.193282 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 931/1860] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:34:25.234352 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47625e6f-4785-4d62-b2db-9e9b2c32d471 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:25.236153 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-47625e6f-4785-4d62-b2db-9e9b2c32d471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:25.261021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa2c45-2d3e-4519-807b-bdfd37e9c805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:25.261943 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa2c45-2d3e-4519-807b-bdfd37e9c805 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:25.262388 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa2c45-2d3e-4519-807b-bdfd37e9c805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:25.263015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa2c45-2d3e-4519-807b-bdfd37e9c805 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:25.264093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa2c45-2d3e-4519-807b-bdfd37e9c805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:25.266497 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa2c45-2d3e-4519-807b-bdfd37e9c805 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:25.321964 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47625e6f-4785-4d62-b2db-9e9b2c32d471 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:25.326642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f48b7-b10b-4cfe-96f6-f95be14cd6ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:25.327591 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f48b7-b10b-4cfe-96f6-f95be14cd6ca service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:25.327964 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f48b7-b10b-4cfe-96f6-f95be14cd6ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:25.328454 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f48b7-b10b-4cfe-96f6-f95be14cd6ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:25.347929 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f48b7-b10b-4cfe-96f6-f95be14cd6ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:25.350434 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f48b7-b10b-4cfe-96f6-f95be14cd6ca service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:25.365525 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 932/1861] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:34:25.413781 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 930/1862] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:34:25 2022] POST /identity/v3/projects => generated 377 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:25.419362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f48b7-b10b-4cfe-96f6-f95be14cd6ca service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:25.430143 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f48b7-b10b-4cfe-96f6-f95be14cd6ca service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:25.509570 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf4996-b636-4a79-bac5-d93f92dbe1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:25.510361 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf4996-b636-4a79-bac5-d93f92dbe1f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:25.510648 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf4996-b636-4a79-bac5-d93f92dbe1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:25.510968 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf4996-b636-4a79-bac5-d93f92dbe1f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:25.511644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf4996-b636-4a79-bac5-d93f92dbe1f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:25.513985 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf4996-b636-4a79-bac5-d93f92dbe1f2 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:25.623807 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 933/1863] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:34:25 2022] POST /identity/v3/users => generated 295 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:34:25.627920 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa2c45-2d3e-4519-807b-bdfd37e9c805 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:25.640237 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa2c45-2d3e-4519-807b-bdfd37e9c805 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:25.645912 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc1de6-a6f7-48cd-a394-aaed29fc46cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:25.646582 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc1de6-a6f7-48cd-a394-aaed29fc46cd admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:25.646887 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc1de6-a6f7-48cd-a394-aaed29fc46cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:25.647159 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc1de6-a6f7-48cd-a394-aaed29fc46cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:25.647803 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc1de6-a6f7-48cd-a394-aaed29fc46cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:25.649402 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc1de6-a6f7-48cd-a394-aaed29fc46cd admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:25.661065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 931/1864] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:34:25.670947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf4996-b636-4a79-bac5-d93f92dbe1f2 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:25.682864 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf4996-b636-4a79-bac5-d93f92dbe1f2 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:25.689163 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b01b8f-9289-49e6-9a15-1aec29ec4848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:25.689856 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b01b8f-9289-49e6-9a15-1aec29ec4848 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:25.690137 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b01b8f-9289-49e6-9a15-1aec29ec4848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:25.690417 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b01b8f-9289-49e6-9a15-1aec29ec4848 admin admin] PATH_INFO: `/v3/projects/f96783d26b5342448e08df6495c817aa/users/ed6363346a1347009726787679028117/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:25.708109 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b01b8f-9289-49e6-9a15-1aec29ec4848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f96783d26b5342448e08df6495c817aa, user_id=ed6363346a1347009726787679028117, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:25.710993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b01b8f-9289-49e6-9a15-1aec29ec4848 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:25.841780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 934/1865] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:25 2022] PUT /identity/v3/projects/f96783d26b5342448e08df6495c817aa/users/ed6363346a1347009726787679028117/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:25.847149 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc1de6-a6f7-48cd-a394-aaed29fc46cd admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:25.870298 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc1de6-a6f7-48cd-a394-aaed29fc46cd admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:25.938390 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e788f80-4dbd-4d97-9269-e65fcf12aab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:25.939286 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e788f80-4dbd-4d97-9269-e65fcf12aab3 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:25.939638 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e788f80-4dbd-4d97-9269-e65fcf12aab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:25.939974 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e788f80-4dbd-4d97-9269-e65fcf12aab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:25.940933 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e788f80-4dbd-4d97-9269-e65fcf12aab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:25.942789 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e788f80-4dbd-4d97-9269-e65fcf12aab3 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:25.954160 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 932/1866] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:25.958416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b01b8f-9289-49e6-9a15-1aec29ec4848 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:25.969378 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b01b8f-9289-49e6-9a15-1aec29ec4848 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:25.974115 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182a88c-b7c9-4746-ba63-e80dce08f2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:25.974776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182a88c-b7c9-4746-ba63-e80dce08f2d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:25.975192 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182a88c-b7c9-4746-ba63-e80dce08f2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:25.975542 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182a88c-b7c9-4746-ba63-e80dce08f2d8 admin admin] PATH_INFO: `/v3/projects/f96783d26b5342448e08df6495c817aa/users/ed6363346a1347009726787679028117/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:25.977543 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182a88c-b7c9-4746-ba63-e80dce08f2d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f96783d26b5342448e08df6495c817aa, user_id=ed6363346a1347009726787679028117, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:25.980837 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182a88c-b7c9-4746-ba63-e80dce08f2d8 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:25.991376 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 935/1867] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:25 2022] PUT /identity/v3/projects/f96783d26b5342448e08df6495c817aa/users/ed6363346a1347009726787679028117/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:26.003322 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3eedad-93f7-40d6-ae7c-820e9d6b2669 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:26.003629 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3eedad-93f7-40d6-ae7c-820e9d6b2669 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:26.003904 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3eedad-93f7-40d6-ae7c-820e9d6b2669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:26.032181 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-7c3eedad-93f7-40d6-ae7c-820e9d6b2669 None None] MFA Rules not processed for user `ed6363346a1347009726787679028117`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:26.033485 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-7c3eedad-93f7-40d6-ae7c-820e9d6b2669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:26.059773 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182a88c-b7c9-4746-ba63-e80dce08f2d8 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:26.061769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-4182a88c-b7c9-4746-ba63-e80dce08f2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:26.113538 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 933/1868] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:26.125373 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3eedad-93f7-40d6-ae7c-820e9d6b2669 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:26.126845 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-7c3eedad-93f7-40d6-ae7c-820e9d6b2669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:26.148878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182a88c-b7c9-4746-ba63-e80dce08f2d8 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:26.154668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c611c-86c3-4278-8947-a787f61653f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:26.155329 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c611c-86c3-4278-8947-a787f61653f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:26.155604 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c611c-86c3-4278-8947-a787f61653f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:26.155876 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c611c-86c3-4278-8947-a787f61653f5 admin admin] PATH_INFO: `/v3/projects/7ed465b2fa524f1d9b5f36d7c4f35f99` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:26.157075 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c611c-86c3-4278-8947-a787f61653f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ed465b2fa524f1d9b5f36d7c4f35f99)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:26.158913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c611c-86c3-4278-8947-a787f61653f5 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:26.187368 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3eedad-93f7-40d6-ae7c-820e9d6b2669 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:26.191267 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe1d29-38cf-4aae-906a-5a1a7f492f05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:26.192187 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe1d29-38cf-4aae-906a-5a1a7f492f05 service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:26.192448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe1d29-38cf-4aae-906a-5a1a7f492f05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:26.192722 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe1d29-38cf-4aae-906a-5a1a7f492f05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:26.254382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe1d29-38cf-4aae-906a-5a1a7f492f05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:26.255860 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe1d29-38cf-4aae-906a-5a1a7f492f05 service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:26.256476 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:26.264920 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 934/1869] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:34:26.277396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-097c611c-86c3-4278-8947-a787f61653f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed465b2fa524f1d9b5f36d7c4f35f99', 'request_id': 'req-097c611c-86c3-4278-8947-a787f61653f5'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:26.284232 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-097c611c-86c3-4278-8947-a787f61653f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed465b2fa524f1d9b5f36d7c4f35f99', 'request_id': 'req-097c611c-86c3-4278-8947-a787f61653f5'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:26.329869 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-097c611c-86c3-4278-8947-a787f61653f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed465b2fa524f1d9b5f36d7c4f35f99', 'request_id': 'req-097c611c-86c3-4278-8947-a787f61653f5'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:26.342846 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-097c611c-86c3-4278-8947-a787f61653f5 admin admin] The token cache is being invalidate because project 7ed465b2fa524f1d9b5f36d7c4f35f99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:34:26.343145 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-097c611c-86c3-4278-8947-a787f61653f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:26.343799 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-097c611c-86c3-4278-8947-a787f61653f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:26.345651 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 936/1870] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:34:26 2022] DELETE /identity/v3/projects/7ed465b2fa524f1d9b5f36d7c4f35f99 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:34:26.349400 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe1d29-38cf-4aae-906a-5a1a7f492f05 service cinder] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:26.361643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe1d29-38cf-4aae-906a-5a1a7f492f05 service cinder] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:26.435252 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417303e7-d8b1-4cc3-aa3e-3d59e29063ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:26.436253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417303e7-d8b1-4cc3-aa3e-3d59e29063ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:26.436425 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417303e7-d8b1-4cc3-aa3e-3d59e29063ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:26.436734 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417303e7-d8b1-4cc3-aa3e-3d59e29063ec admin admin] PATH_INFO: `/v3/users/f1f2a8909d4347699ca7ed300333a26d` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:26.438431 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417303e7-d8b1-4cc3-aa3e-3d59e29063ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1f2a8909d4347699ca7ed300333a26d)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:26.442874 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417303e7-d8b1-4cc3-aa3e-3d59e29063ec admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:26.632018 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-417303e7-d8b1-4cc3-aa3e-3d59e29063ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1f2a8909d4347699ca7ed300333a26d'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:26.632762 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-417303e7-d8b1-4cc3-aa3e-3d59e29063ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1f2a8909d4347699ca7ed300333a26d'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:26.725729 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-417303e7-d8b1-4cc3-aa3e-3d59e29063ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1f2a8909d4347699ca7ed300333a26d'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:26.740290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-417303e7-d8b1-4cc3-aa3e-3d59e29063ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1f2a8909d4347699ca7ed300333a26d'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:26.741129 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-417303e7-d8b1-4cc3-aa3e-3d59e29063ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1f2a8909d4347699ca7ed300333a26d'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:26.774266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 935/1871] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:34:26 2022] DELETE /identity/v3/users/f1f2a8909d4347699ca7ed300333a26d => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:27.001061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=85,keystone:INSERT=8,keystone:DELETE=7 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:27.274419 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c611c-86c3-4278-8947-a787f61653f5 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:27.276183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-097c611c-86c3-4278-8947-a787f61653f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:27.297529 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c611c-86c3-4278-8947-a787f61653f5 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:27.357528 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67220b-8f6f-4e97-a2da-80351bf4fca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:27.358162 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67220b-8f6f-4e97-a2da-80351bf4fca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:27.358441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67220b-8f6f-4e97-a2da-80351bf4fca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:27.358717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67220b-8f6f-4e97-a2da-80351bf4fca5 admin admin] PATH_INFO: `/v3/projects/af662b92aef64381b0abb4f375f8ff4a` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:27.359858 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67220b-8f6f-4e97-a2da-80351bf4fca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af662b92aef64381b0abb4f375f8ff4a)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:27.361772 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67220b-8f6f-4e97-a2da-80351bf4fca5 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:27.472103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2a67220b-8f6f-4e97-a2da-80351bf4fca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af662b92aef64381b0abb4f375f8ff4a', 'request_id': 'req-2a67220b-8f6f-4e97-a2da-80351bf4fca5'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:27.477608 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2a67220b-8f6f-4e97-a2da-80351bf4fca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af662b92aef64381b0abb4f375f8ff4a', 'request_id': 'req-2a67220b-8f6f-4e97-a2da-80351bf4fca5'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:27.560227 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2a67220b-8f6f-4e97-a2da-80351bf4fca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af662b92aef64381b0abb4f375f8ff4a', 'request_id': 'req-2a67220b-8f6f-4e97-a2da-80351bf4fca5'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:27.585511 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2a67220b-8f6f-4e97-a2da-80351bf4fca5 admin admin] The token cache is being invalidate because project af662b92aef64381b0abb4f375f8ff4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:34:27.585812 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2a67220b-8f6f-4e97-a2da-80351bf4fca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:27.586492 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2a67220b-8f6f-4e97-a2da-80351bf4fca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:27.588760 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 937/1872] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:34:27 2022] DELETE /identity/v3/projects/af662b92aef64381b0abb4f375f8ff4a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:27.596704 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417303e7-d8b1-4cc3-aa3e-3d59e29063ec admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:27.598121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-417303e7-d8b1-4cc3-aa3e-3d59e29063ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:27.624319 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417303e7-d8b1-4cc3-aa3e-3d59e29063ec admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:27.684302 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d0063-1d38-49a6-afe5-9b2156dc5c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:27.684957 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d0063-1d38-49a6-afe5-9b2156dc5c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:27.685243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d0063-1d38-49a6-afe5-9b2156dc5c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:27.685824 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d0063-1d38-49a6-afe5-9b2156dc5c1c admin admin] PATH_INFO: `/v3/users/5ecfd0a00a2747469396c132de0fd47f` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:27.687058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d0063-1d38-49a6-afe5-9b2156dc5c1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ecfd0a00a2747469396c132de0fd47f)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:27.689117 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d0063-1d38-49a6-afe5-9b2156dc5c1c admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:27.992614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-1e7d0063-1d38-49a6-afe5-9b2156dc5c1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ecfd0a00a2747469396c132de0fd47f'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:27.993267 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-1e7d0063-1d38-49a6-afe5-9b2156dc5c1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ecfd0a00a2747469396c132de0fd47f'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:28.074565 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-1e7d0063-1d38-49a6-afe5-9b2156dc5c1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ecfd0a00a2747469396c132de0fd47f'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:28.083403 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-1e7d0063-1d38-49a6-afe5-9b2156dc5c1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ecfd0a00a2747469396c132de0fd47f'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:28.084247 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-1e7d0063-1d38-49a6-afe5-9b2156dc5c1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ecfd0a00a2747469396c132de0fd47f'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:28.123089 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 936/1873] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:34:27 2022] DELETE /identity/v3/users/5ecfd0a00a2747469396c132de0fd47f => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:28.183725 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:28.574090 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67220b-8f6f-4e97-a2da-80351bf4fca5 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:28.575776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-2a67220b-8f6f-4e97-a2da-80351bf4fca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:28.594605 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67220b-8f6f-4e97-a2da-80351bf4fca5 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:28.663771 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7b0aa-29eb-4883-9b12-a37f14749fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:28.667535 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7b0aa-29eb-4883-9b12-a37f14749fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:28.667535 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7b0aa-29eb-4883-9b12-a37f14749fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:28.667535 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7b0aa-29eb-4883-9b12-a37f14749fb7 admin admin] PATH_INFO: `/v3/projects/39ebd599835f43b4b2670a4597e2c5c4` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:28.667535 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7b0aa-29eb-4883-9b12-a37f14749fb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39ebd599835f43b4b2670a4597e2c5c4)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:28.670079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7b0aa-29eb-4883-9b12-a37f14749fb7 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:28.878311 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-51a7b0aa-29eb-4883-9b12-a37f14749fb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39ebd599835f43b4b2670a4597e2c5c4', 'request_id': 'req-51a7b0aa-29eb-4883-9b12-a37f14749fb7'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:28.884664 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-51a7b0aa-29eb-4883-9b12-a37f14749fb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39ebd599835f43b4b2670a4597e2c5c4', 'request_id': 'req-51a7b0aa-29eb-4883-9b12-a37f14749fb7'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:28.977283 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-51a7b0aa-29eb-4883-9b12-a37f14749fb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39ebd599835f43b4b2670a4597e2c5c4', 'request_id': 'req-51a7b0aa-29eb-4883-9b12-a37f14749fb7'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:28.990217 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-51a7b0aa-29eb-4883-9b12-a37f14749fb7 admin admin] The token cache is being invalidate because project 39ebd599835f43b4b2670a4597e2c5c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:34:28.990505 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-51a7b0aa-29eb-4883-9b12-a37f14749fb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:28.991170 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-51a7b0aa-29eb-4883-9b12-a37f14749fb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:28.992763 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 938/1874] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:34:28 2022] DELETE /identity/v3/projects/39ebd599835f43b4b2670a4597e2c5c4 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:34:28.997834 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25c815-8bd5-43b5-8e1a-4dda9a6ced0a None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:28.998138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25c815-8bd5-43b5-8e1a-4dda9a6ced0a None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:28.998404 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25c815-8bd5-43b5-8e1a-4dda9a6ced0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:29.019715 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-cb25c815-8bd5-43b5-8e1a-4dda9a6ced0a None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:29.020916 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-cb25c815-8bd5-43b5-8e1a-4dda9a6ced0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:29.081365 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 937/1875] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:29.091093 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323ea0e-886d-41e6-bec7-e01381c8f4d5 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:29.091471 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323ea0e-886d-41e6-bec7-e01381c8f4d5 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:29.091850 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323ea0e-886d-41e6-bec7-e01381c8f4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:29.112801 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-8323ea0e-886d-41e6-bec7-e01381c8f4d5 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:29.114045 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-8323ea0e-886d-41e6-bec7-e01381c8f4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:29.123635 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 939/1876] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:29.129228 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25c815-8bd5-43b5-8e1a-4dda9a6ced0a None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:29.140019 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25c815-8bd5-43b5-8e1a-4dda9a6ced0a None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:29.145501 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056354c-8972-474f-bfbc-930958e34ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:29.145950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056354c-8972-474f-bfbc-930958e34ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:29.146293 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056354c-8972-474f-bfbc-930958e34ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:29.146569 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056354c-8972-474f-bfbc-930958e34ff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:29.147443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056354c-8972-474f-bfbc-930958e34ff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:34:29.147747 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056354c-8972-474f-bfbc-930958e34ff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:29.149397 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056354c-8972-474f-bfbc-930958e34ff8 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:29.162693 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 938/1877] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:34:29.169991 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323ea0e-886d-41e6-bec7-e01381c8f4d5 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:29.177118 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:29.180199 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323ea0e-886d-41e6-bec7-e01381c8f4d5 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:29.190567 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f31fd-b479-405e-926c-ee05ca29f9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:29.191336 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f31fd-b479-405e-926c-ee05ca29f9dc admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:29.191616 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f31fd-b479-405e-926c-ee05ca29f9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:29.191891 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f31fd-b479-405e-926c-ee05ca29f9dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:29.192537 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f31fd-b479-405e-926c-ee05ca29f9dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:29.194470 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f31fd-b479-405e-926c-ee05ca29f9dc admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:29.231651 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056354c-8972-474f-bfbc-930958e34ff8 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:29.233862 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-8056354c-8972-474f-bfbc-930958e34ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:29.287839 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 940/1878] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:34:29 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:29.295392 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f31fd-b479-405e-926c-ee05ca29f9dc admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:29.313736 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056354c-8972-474f-bfbc-930958e34ff8 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:29.369729 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f31fd-b479-405e-926c-ee05ca29f9dc admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:29.377975 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db593c-16cd-4bba-b26e-541f2994a69f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:29.378592 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db593c-16cd-4bba-b26e-541f2994a69f service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:29.378903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db593c-16cd-4bba-b26e-541f2994a69f service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:29.379180 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db593c-16cd-4bba-b26e-541f2994a69f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:29.380285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb7008-561d-47b2-b654-7ea76221e314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:29.381028 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb7008-561d-47b2-b654-7ea76221e314 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:29.381134 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-f9db593c-16cd-4bba-b26e-541f2994a69f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:29.381714 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb7008-561d-47b2-b654-7ea76221e314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:29.382082 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb7008-561d-47b2-b654-7ea76221e314 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:29.382707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb7008-561d-47b2-b654-7ea76221e314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:29.384959 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb7008-561d-47b2-b654-7ea76221e314 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:29.418042 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:29.451121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db593c-16cd-4bba-b26e-541f2994a69f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:29.452548 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db593c-16cd-4bba-b26e-541f2994a69f service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:29.463164 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 941/1879] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:34:29 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:34:29.464361 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 939/1880] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:34:29.468445 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb7008-561d-47b2-b654-7ea76221e314 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:29.480122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb7008-561d-47b2-b654-7ea76221e314 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:29.485277 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06859355-e2d7-4a5c-8e73-04a80473ba1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:29.485892 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06859355-e2d7-4a5c-8e73-04a80473ba1c admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:29.486171 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06859355-e2d7-4a5c-8e73-04a80473ba1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:29.486444 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06859355-e2d7-4a5c-8e73-04a80473ba1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:29.487132 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06859355-e2d7-4a5c-8e73-04a80473ba1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:29.488831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06859355-e2d7-4a5c-8e73-04a80473ba1c admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:29.499916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 942/1881] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:29.504041 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db593c-16cd-4bba-b26e-541f2994a69f service cinder] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:29.521070 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db593c-16cd-4bba-b26e-541f2994a69f service cinder] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:29.526979 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789771a-b949-4d57-80d2-4e04ed099551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:29.527588 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789771a-b949-4d57-80d2-4e04ed099551 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:29.527855 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789771a-b949-4d57-80d2-4e04ed099551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:29.528146 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789771a-b949-4d57-80d2-4e04ed099551 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:29.528771 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789771a-b949-4d57-80d2-4e04ed099551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:29.530478 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789771a-b949-4d57-80d2-4e04ed099551 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:29.544699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 940/1882] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:34:29.548852 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06859355-e2d7-4a5c-8e73-04a80473ba1c admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:29.559033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06859355-e2d7-4a5c-8e73-04a80473ba1c admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:29.564003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078a5bb-956f-4c2b-8f0c-eb46cc1c4030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:29.564653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078a5bb-956f-4c2b-8f0c-eb46cc1c4030 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:29.564934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078a5bb-956f-4c2b-8f0c-eb46cc1c4030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:29.570959 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078a5bb-956f-4c2b-8f0c-eb46cc1c4030 admin admin] PATH_INFO: `/v3/projects/1a654d620971454d84f761df29c4be3a/users/0361e12d9a2d4becb92d5fb5512d787b/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:29.581489 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078a5bb-956f-4c2b-8f0c-eb46cc1c4030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a654d620971454d84f761df29c4be3a, user_id=0361e12d9a2d4becb92d5fb5512d787b, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:29.584362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078a5bb-956f-4c2b-8f0c-eb46cc1c4030 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:29.686116 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 943/1883] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:29 2022] PUT /identity/v3/projects/1a654d620971454d84f761df29c4be3a/users/0361e12d9a2d4becb92d5fb5512d787b/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:29.696247 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c1256-f0b2-4c78-b406-32e943353012 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:29.696532 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c1256-f0b2-4c78-b406-32e943353012 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:29.696809 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c1256-f0b2-4c78-b406-32e943353012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:29.733443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-6f3c1256-f0b2-4c78-b406-32e943353012 None None] MFA Rules not processed for user `0361e12d9a2d4becb92d5fb5512d787b`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:29.734709 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-6f3c1256-f0b2-4c78-b406-32e943353012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:29.808002 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 941/1884] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:29.819531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078a5bb-956f-4c2b-8f0c-eb46cc1c4030 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:29.881359 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078a5bb-956f-4c2b-8f0c-eb46cc1c4030 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:29.886256 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d40f4-a82b-441f-8415-68eb7963b3ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:29.892510 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d40f4-a82b-441f-8415-68eb7963b3ae service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:29.892510 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d40f4-a82b-441f-8415-68eb7963b3ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:29.892510 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d40f4-a82b-441f-8415-68eb7963b3ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:29.900937 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d40f4-a82b-441f-8415-68eb7963b3ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:29.902463 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d40f4-a82b-441f-8415-68eb7963b3ae service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:29.912112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 944/1885] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:34:30.228617 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:31.652596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:31.715542 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:32.963343 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:33.028547 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:33.101882 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc11592-1ae5-4db2-b15c-617ca86f8e96 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:33.102169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc11592-1ae5-4db2-b15c-617ca86f8e96 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:33.102454 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc11592-1ae5-4db2-b15c-617ca86f8e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:33.121869 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-9dc11592-1ae5-4db2-b15c-617ca86f8e96 None None] MFA Rules not processed for user `0361e12d9a2d4becb92d5fb5512d787b`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:33.123099 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-9dc11592-1ae5-4db2-b15c-617ca86f8e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:33.130048 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 942/1886] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:33.367094 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:33.589619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:34.411995 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:34.743675 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:35.080683 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:35.163510 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d40f4-a82b-441f-8415-68eb7963b3ae service cinder] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:35.165082 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-564d40f4-a82b-441f-8415-68eb7963b3ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:35.247845 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d40f4-a82b-441f-8415-68eb7963b3ae service cinder] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:35.260041 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89521ea5-c9da-4988-87a6-c3c5cfed9959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:35.260395 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89521ea5-c9da-4988-87a6-c3c5cfed9959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:35.260700 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89521ea5-c9da-4988-87a6-c3c5cfed9959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:35.261095 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89521ea5-c9da-4988-87a6-c3c5cfed9959 admin admin] PATH_INFO: `/v3/users/0cf8195d9e674e4f856a984306c7a36f` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:35.262537 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89521ea5-c9da-4988-87a6-c3c5cfed9959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cf8195d9e674e4f856a984306c7a36f)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:35.264812 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89521ea5-c9da-4988-87a6-c3c5cfed9959 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:35.539877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-89521ea5-c9da-4988-87a6-c3c5cfed9959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cf8195d9e674e4f856a984306c7a36f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:35.540570 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-89521ea5-c9da-4988-87a6-c3c5cfed9959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cf8195d9e674e4f856a984306c7a36f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:35.606524 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:35.668541 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-89521ea5-c9da-4988-87a6-c3c5cfed9959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cf8195d9e674e4f856a984306c7a36f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:35.683894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-89521ea5-c9da-4988-87a6-c3c5cfed9959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cf8195d9e674e4f856a984306c7a36f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:35.684591 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-89521ea5-c9da-4988-87a6-c3c5cfed9959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cf8195d9e674e4f856a984306c7a36f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:35.697901 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 945/1887] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:34:35 2022] DELETE /identity/v3/users/0cf8195d9e674e4f856a984306c7a36f => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:35.702213 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae22e9-85fa-4618-989a-0b0d1e19ca7e None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:35.702498 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae22e9-85fa-4618-989a-0b0d1e19ca7e None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:35.702802 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae22e9-85fa-4618-989a-0b0d1e19ca7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:35.722805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-c0ae22e9-85fa-4618-989a-0b0d1e19ca7e None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:35.724349 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c0ae22e9-85fa-4618-989a-0b0d1e19ca7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:35.786313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 943/1888] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:35.796882 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89521ea5-c9da-4988-87a6-c3c5cfed9959 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:35.798323 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-89521ea5-c9da-4988-87a6-c3c5cfed9959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:35.837104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:35.842480 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae22e9-85fa-4618-989a-0b0d1e19ca7e None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:35.844155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c0ae22e9-85fa-4618-989a-0b0d1e19ca7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:35.857140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae22e9-85fa-4618-989a-0b0d1e19ca7e None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:35.861931 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490452ed-644f-429c-8d87-baaa05d4c662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:35.862563 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490452ed-644f-429c-8d87-baaa05d4c662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:35.862893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490452ed-644f-429c-8d87-baaa05d4c662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:35.863193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490452ed-644f-429c-8d87-baaa05d4c662 admin admin] PATH_INFO: `/v3/users/262ea4b2bf4d4cab986564cde8f259c9` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:35.864333 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490452ed-644f-429c-8d87-baaa05d4c662 admin admin] RBAC: Authorizing `identity:delete_user(user_id=262ea4b2bf4d4cab986564cde8f259c9)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:35.866301 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490452ed-644f-429c-8d87-baaa05d4c662 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:35.868349 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89521ea5-c9da-4988-87a6-c3c5cfed9959 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:35.873049 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6c309-3b0d-4720-85a9-c4643068f41b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:35.873795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6c309-3b0d-4720-85a9-c4643068f41b service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:35.874074 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6c309-3b0d-4720-85a9-c4643068f41b service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:35.874342 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6c309-3b0d-4720-85a9-c4643068f41b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:35.887469 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea6c309-3b0d-4720-85a9-c4643068f41b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:35.889627 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea6c309-3b0d-4720-85a9-c4643068f41b service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:35.901223 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 946/1889] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:34:36.149418 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-490452ed-644f-429c-8d87-baaa05d4c662 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '262ea4b2bf4d4cab986564cde8f259c9'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:36.150164 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-490452ed-644f-429c-8d87-baaa05d4c662 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '262ea4b2bf4d4cab986564cde8f259c9'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:36.245499 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-490452ed-644f-429c-8d87-baaa05d4c662 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '262ea4b2bf4d4cab986564cde8f259c9'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:36.253651 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-490452ed-644f-429c-8d87-baaa05d4c662 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '262ea4b2bf4d4cab986564cde8f259c9'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:36.254365 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-490452ed-644f-429c-8d87-baaa05d4c662 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '262ea4b2bf4d4cab986564cde8f259c9'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:36.272513 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 944/1890] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:34:35 2022] DELETE /identity/v3/users/262ea4b2bf4d4cab986564cde8f259c9 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:36.277851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46cd34-2e13-4655-9478-2f49f03e5ad4 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:36.278205 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46cd34-2e13-4655-9478-2f49f03e5ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:36.278585 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46cd34-2e13-4655-9478-2f49f03e5ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:36.299807 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-ea46cd34-2e13-4655-9478-2f49f03e5ad4 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:36.301239 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-ea46cd34-2e13-4655-9478-2f49f03e5ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:36.314757 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:36.368204 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 947/1891] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:34:36.378024 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490452ed-644f-429c-8d87-baaa05d4c662 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:36.379496 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-490452ed-644f-429c-8d87-baaa05d4c662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:36.412181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:36.442081 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490452ed-644f-429c-8d87-baaa05d4c662 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:36.446162 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0be5d0-d7a2-4c5a-b915-a3b350c8460c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:36.446791 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0be5d0-d7a2-4c5a-b915-a3b350c8460c service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:36.447111 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0be5d0-d7a2-4c5a-b915-a3b350c8460c service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:36.448645 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0be5d0-d7a2-4c5a-b915-a3b350c8460c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:36.459242 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0be5d0-d7a2-4c5a-b915-a3b350c8460c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:36.460788 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0be5d0-d7a2-4c5a-b915-a3b350c8460c service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:36.484603 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46cd34-2e13-4655-9478-2f49f03e5ad4 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:36.486087 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-ea46cd34-2e13-4655-9478-2f49f03e5ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:36.487051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 945/1892] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:34:36.505204 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46cd34-2e13-4655-9478-2f49f03e5ad4 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:36.519785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601f620-b7fc-4fbe-b21f-6067df32e02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:36.520450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601f620-b7fc-4fbe-b21f-6067df32e02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:36.523872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601f620-b7fc-4fbe-b21f-6067df32e02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:36.523872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601f620-b7fc-4fbe-b21f-6067df32e02e admin admin] PATH_INFO: `/v3/projects/1821c94d0cf241b3b727e2333986375a` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:36.523872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601f620-b7fc-4fbe-b21f-6067df32e02e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1821c94d0cf241b3b727e2333986375a)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:36.525086 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601f620-b7fc-4fbe-b21f-6067df32e02e admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:36.698682 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a601f620-b7fc-4fbe-b21f-6067df32e02e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1821c94d0cf241b3b727e2333986375a', 'request_id': 'req-a601f620-b7fc-4fbe-b21f-6067df32e02e'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:36.704307 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a601f620-b7fc-4fbe-b21f-6067df32e02e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1821c94d0cf241b3b727e2333986375a', 'request_id': 'req-a601f620-b7fc-4fbe-b21f-6067df32e02e'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:36.840709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a601f620-b7fc-4fbe-b21f-6067df32e02e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1821c94d0cf241b3b727e2333986375a', 'request_id': 'req-a601f620-b7fc-4fbe-b21f-6067df32e02e'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:36.855523 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a601f620-b7fc-4fbe-b21f-6067df32e02e admin admin] The token cache is being invalidate because project 1821c94d0cf241b3b727e2333986375a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:34:36.855974 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a601f620-b7fc-4fbe-b21f-6067df32e02e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:36.856721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a601f620-b7fc-4fbe-b21f-6067df32e02e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:36.858755 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 948/1893] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:34:36 2022] DELETE /identity/v3/projects/1821c94d0cf241b3b727e2333986375a => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:36.867848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0be5d0-d7a2-4c5a-b915-a3b350c8460c service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:36.880954 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0be5d0-d7a2-4c5a-b915-a3b350c8460c service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:36.955912 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f30554-6c2c-4f6d-abc4-6bdf00f65ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:36.957111 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f30554-6c2c-4f6d-abc4-6bdf00f65ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:36.957111 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f30554-6c2c-4f6d-abc4-6bdf00f65ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:36.957111 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f30554-6c2c-4f6d-abc4-6bdf00f65ad0 admin admin] PATH_INFO: `/v3/users/ed6363346a1347009726787679028117` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:36.958532 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f30554-6c2c-4f6d-abc4-6bdf00f65ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed6363346a1347009726787679028117)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:36.960665 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f30554-6c2c-4f6d-abc4-6bdf00f65ad0 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:37.034590 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:37.121115 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:37.128565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601f620-b7fc-4fbe-b21f-6067df32e02e admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:37.130050 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-a601f620-b7fc-4fbe-b21f-6067df32e02e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:37.154366 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601f620-b7fc-4fbe-b21f-6067df32e02e admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:37.165445 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a24d3-653b-4cf2-96ff-115b699c5ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:37.165445 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a24d3-653b-4cf2-96ff-115b699c5ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:37.165445 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a24d3-653b-4cf2-96ff-115b699c5ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:37.165445 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a24d3-653b-4cf2-96ff-115b699c5ff2 admin admin] PATH_INFO: `/v3/projects/d553ef591ea34294b0e73ac536b14e7d` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:37.166146 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a24d3-653b-4cf2-96ff-115b699c5ff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d553ef591ea34294b0e73ac536b14e7d)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:37.167256 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a24d3-653b-4cf2-96ff-115b699c5ff2 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:37.210725 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b3f30554-6c2c-4f6d-abc4-6bdf00f65ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed6363346a1347009726787679028117'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:37.211697 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b3f30554-6c2c-4f6d-abc4-6bdf00f65ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed6363346a1347009726787679028117'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:37.310670 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2a9a24d3-653b-4cf2-96ff-115b699c5ff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd553ef591ea34294b0e73ac536b14e7d', 'request_id': 'req-2a9a24d3-653b-4cf2-96ff-115b699c5ff2'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:37.314118 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b3f30554-6c2c-4f6d-abc4-6bdf00f65ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed6363346a1347009726787679028117'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:37.319479 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2a9a24d3-653b-4cf2-96ff-115b699c5ff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd553ef591ea34294b0e73ac536b14e7d', 'request_id': 'req-2a9a24d3-653b-4cf2-96ff-115b699c5ff2'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:37.322101 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b3f30554-6c2c-4f6d-abc4-6bdf00f65ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed6363346a1347009726787679028117'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:37.323532 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b3f30554-6c2c-4f6d-abc4-6bdf00f65ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed6363346a1347009726787679028117'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:37.344430 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 946/1894] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:34:36 2022] DELETE /identity/v3/users/ed6363346a1347009726787679028117 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:37.412434 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2a9a24d3-653b-4cf2-96ff-115b699c5ff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd553ef591ea34294b0e73ac536b14e7d', 'request_id': 'req-2a9a24d3-653b-4cf2-96ff-115b699c5ff2'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:37.429710 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2a9a24d3-653b-4cf2-96ff-115b699c5ff2 admin admin] The token cache is being invalidate because project d553ef591ea34294b0e73ac536b14e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:34:37.430127 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2a9a24d3-653b-4cf2-96ff-115b699c5ff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:37.430848 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2a9a24d3-653b-4cf2-96ff-115b699c5ff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:37.432733 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 949/1895] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:34:37 2022] DELETE /identity/v3/projects/d553ef591ea34294b0e73ac536b14e7d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:37.437304 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f30554-6c2c-4f6d-abc4-6bdf00f65ad0 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:37.438933 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-b3f30554-6c2c-4f6d-abc4-6bdf00f65ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:37.514667 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f30554-6c2c-4f6d-abc4-6bdf00f65ad0 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:37.520049 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76b965-b6af-4cff-ad45-866199bf6867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:37.522006 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:37.522519 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76b965-b6af-4cff-ad45-866199bf6867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:37.522894 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76b965-b6af-4cff-ad45-866199bf6867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:37.523177 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76b965-b6af-4cff-ad45-866199bf6867 admin admin] PATH_INFO: `/v3/users/3ec556ed4c2c4497836e01a413c5c83c` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:37.531349 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76b965-b6af-4cff-ad45-866199bf6867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ec556ed4c2c4497836e01a413c5c83c)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:37.531349 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76b965-b6af-4cff-ad45-866199bf6867 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:37.674759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:37.777432 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-0b76b965-b6af-4cff-ad45-866199bf6867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ec556ed4c2c4497836e01a413c5c83c'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:37.778321 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-0b76b965-b6af-4cff-ad45-866199bf6867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ec556ed4c2c4497836e01a413c5c83c'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:37.901691 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a24d3-653b-4cf2-96ff-115b699c5ff2 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:37.903372 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-2a9a24d3-653b-4cf2-96ff-115b699c5ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:37.915637 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:37.927841 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-0b76b965-b6af-4cff-ad45-866199bf6867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ec556ed4c2c4497836e01a413c5c83c'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:37.941250 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-0b76b965-b6af-4cff-ad45-866199bf6867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ec556ed4c2c4497836e01a413c5c83c'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:37.944911 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-0b76b965-b6af-4cff-ad45-866199bf6867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ec556ed4c2c4497836e01a413c5c83c'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:37.965511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 947/1896] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:34:37 2022] DELETE /identity/v3/users/3ec556ed4c2c4497836e01a413c5c83c => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:38.014737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a24d3-653b-4cf2-96ff-115b699c5ff2 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:38.086161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb06f3d-68bc-4413-b2c4-dc115a9c9b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:38.086951 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb06f3d-68bc-4413-b2c4-dc115a9c9b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:38.087300 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb06f3d-68bc-4413-b2c4-dc115a9c9b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:38.087644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb06f3d-68bc-4413-b2c4-dc115a9c9b12 admin admin] PATH_INFO: `/v3/projects/f96783d26b5342448e08df6495c817aa` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:38.089189 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb06f3d-68bc-4413-b2c4-dc115a9c9b12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f96783d26b5342448e08df6495c817aa)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:38.091583 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb06f3d-68bc-4413-b2c4-dc115a9c9b12 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:38.240039 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-dcb06f3d-68bc-4413-b2c4-dc115a9c9b12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f96783d26b5342448e08df6495c817aa', 'request_id': 'req-dcb06f3d-68bc-4413-b2c4-dc115a9c9b12'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:38.247640 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-dcb06f3d-68bc-4413-b2c4-dc115a9c9b12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f96783d26b5342448e08df6495c817aa', 'request_id': 'req-dcb06f3d-68bc-4413-b2c4-dc115a9c9b12'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:38.377882 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-dcb06f3d-68bc-4413-b2c4-dc115a9c9b12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f96783d26b5342448e08df6495c817aa', 'request_id': 'req-dcb06f3d-68bc-4413-b2c4-dc115a9c9b12'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:38.395188 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-dcb06f3d-68bc-4413-b2c4-dc115a9c9b12 admin admin] The token cache is being invalidate because project f96783d26b5342448e08df6495c817aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:34:38.395489 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-dcb06f3d-68bc-4413-b2c4-dc115a9c9b12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:38.396176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-dcb06f3d-68bc-4413-b2c4-dc115a9c9b12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:38.402786 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 950/1897] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:34:37 2022] DELETE /identity/v3/projects/f96783d26b5342448e08df6495c817aa => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:38.403885 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee899333-9688-48e3-8f73-b0ea1070c29e None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:38.404181 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee899333-9688-48e3-8f73-b0ea1070c29e None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:38.404668 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee899333-9688-48e3-8f73-b0ea1070c29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:38.439801 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-ee899333-9688-48e3-8f73-b0ea1070c29e None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:38.439801 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ee899333-9688-48e3-8f73-b0ea1070c29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:38.511745 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 948/1898] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:38.520991 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01f4e8-2dbb-436d-a5ff-97ebd1f75af0 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:38.521288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01f4e8-2dbb-436d-a5ff-97ebd1f75af0 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:38.521569 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01f4e8-2dbb-436d-a5ff-97ebd1f75af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:38.542331 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-6c01f4e8-2dbb-436d-a5ff-97ebd1f75af0 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:38.543569 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-6c01f4e8-2dbb-436d-a5ff-97ebd1f75af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:38.551793 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 951/1899] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:38.556061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee899333-9688-48e3-8f73-b0ea1070c29e None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:38.567127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee899333-9688-48e3-8f73-b0ea1070c29e None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:38.572552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca77f7d-b068-4520-8345-129a126a42d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:38.573191 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca77f7d-b068-4520-8345-129a126a42d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:38.573553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca77f7d-b068-4520-8345-129a126a42d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:38.573824 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca77f7d-b068-4520-8345-129a126a42d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:38.574504 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca77f7d-b068-4520-8345-129a126a42d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:34:38.574923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca77f7d-b068-4520-8345-129a126a42d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:38.576800 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca77f7d-b068-4520-8345-129a126a42d8 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:38.588959 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 949/1900] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:34:38.593378 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01f4e8-2dbb-436d-a5ff-97ebd1f75af0 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:38.603014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01f4e8-2dbb-436d-a5ff-97ebd1f75af0 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:38.608429 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2268ad-65e7-4827-baeb-ab07dc27202b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:38.609019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2268ad-65e7-4827-baeb-ab07dc27202b admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:38.609299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2268ad-65e7-4827-baeb-ab07dc27202b admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:38.609572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2268ad-65e7-4827-baeb-ab07dc27202b admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:38.610207 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2268ad-65e7-4827-baeb-ab07dc27202b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:38.612151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2268ad-65e7-4827-baeb-ab07dc27202b admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:38.637157 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca77f7d-b068-4520-8345-129a126a42d8 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:38.639220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-cca77f7d-b068-4520-8345-129a126a42d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:38.653265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca77f7d-b068-4520-8345-129a126a42d8 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:38.658066 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ced0d9-abe4-4edb-8f2b-b8277b413c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:38.658683 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ced0d9-abe4-4edb-8f2b-b8277b413c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:38.659000 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ced0d9-abe4-4edb-8f2b-b8277b413c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:38.659276 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ced0d9-abe4-4edb-8f2b-b8277b413c3b admin admin] PATH_INFO: `/v3/projects/a9ac02b310ff49d29efa758365cd47ee` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:38.660398 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ced0d9-abe4-4edb-8f2b-b8277b413c3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ac02b310ff49d29efa758365cd47ee)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:38.662325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ced0d9-abe4-4edb-8f2b-b8277b413c3b admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:38.862749 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 952/1901] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:34:38 2022] POST /identity/v3/projects => generated 367 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:38.866432 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2268ad-65e7-4827-baeb-ab07dc27202b admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:38.877978 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-19ced0d9-abe4-4edb-8f2b-b8277b413c3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ac02b310ff49d29efa758365cd47ee', 'request_id': 'req-19ced0d9-abe4-4edb-8f2b-b8277b413c3b'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:38.884935 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-19ced0d9-abe4-4edb-8f2b-b8277b413c3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ac02b310ff49d29efa758365cd47ee', 'request_id': 'req-19ced0d9-abe4-4edb-8f2b-b8277b413c3b'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:38.893489 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-19ced0d9-abe4-4edb-8f2b-b8277b413c3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ac02b310ff49d29efa758365cd47ee', 'request_id': 'req-19ced0d9-abe4-4edb-8f2b-b8277b413c3b'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:38.941201 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2268ad-65e7-4827-baeb-ab07dc27202b admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:38.946008 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34414745-3868-40dc-8628-635d3cabe99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:38.946557 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34414745-3868-40dc-8628-635d3cabe99b admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:38.946904 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34414745-3868-40dc-8628-635d3cabe99b admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:38.947149 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34414745-3868-40dc-8628-635d3cabe99b admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:38.948392 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34414745-3868-40dc-8628-635d3cabe99b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:38.950517 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34414745-3868-40dc-8628-635d3cabe99b admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:39.035047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-19ced0d9-abe4-4edb-8f2b-b8277b413c3b admin admin] The token cache is being invalidate because project a9ac02b310ff49d29efa758365cd47ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:34:39.035593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-19ced0d9-abe4-4edb-8f2b-b8277b413c3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:39.036063 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-19ced0d9-abe4-4edb-8f2b-b8277b413c3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:39.037712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 950/1902] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:34:38 2022] DELETE /identity/v3/projects/a9ac02b310ff49d29efa758365cd47ee => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:39.043271 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55466bb9-0845-450a-95a0-a970d879c9d3 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:39.043546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55466bb9-0845-450a-95a0-a970d879c9d3 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:39.043814 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55466bb9-0845-450a-95a0-a970d879c9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:39.063688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-55466bb9-0845-450a-95a0-a970d879c9d3 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:39.064806 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-55466bb9-0845-450a-95a0-a970d879c9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:39.075322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 953/1903] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:34:38 2022] POST /identity/v3/users => generated 284 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:34:39.076775 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 951/1904] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:39.084430 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34414745-3868-40dc-8628-635d3cabe99b admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:39.091540 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9043d5d-89d2-492f-9d3e-ae5161149dd5 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:39.091817 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9043d5d-89d2-492f-9d3e-ae5161149dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:39.092086 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9043d5d-89d2-492f-9d3e-ae5161149dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:39.092507 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-34414745-3868-40dc-8628-635d3cabe99b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:39.109614 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34414745-3868-40dc-8628-635d3cabe99b admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:39.116541 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d202316-a175-492e-a890-8682dc5b2213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:39.117511 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d202316-a175-492e-a890-8682dc5b2213 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:39.117996 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d202316-a175-492e-a890-8682dc5b2213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:39.118238 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-d9043d5d-89d2-492f-9d3e-ae5161149dd5 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:39.118546 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d202316-a175-492e-a890-8682dc5b2213 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:39.120194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d202316-a175-492e-a890-8682dc5b2213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:39.121009 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-d9043d5d-89d2-492f-9d3e-ae5161149dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:39.122501 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d202316-a175-492e-a890-8682dc5b2213 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:39.132813 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 952/1905] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:39.133978 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9043d5d-89d2-492f-9d3e-ae5161149dd5 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:39.138614 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 954/1906] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:39.139757 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d202316-a175-492e-a890-8682dc5b2213 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:39.145865 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9043d5d-89d2-492f-9d3e-ae5161149dd5 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:39.153416 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bcd17-fe0a-41ab-85f1-f35003867a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:39.154450 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bcd17-fe0a-41ab-85f1-f35003867a75 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:39.154942 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bcd17-fe0a-41ab-85f1-f35003867a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:39.162188 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d202316-a175-492e-a890-8682dc5b2213 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:39.162325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bcd17-fe0a-41ab-85f1-f35003867a75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:39.162325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bcd17-fe0a-41ab-85f1-f35003867a75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:34:39.162325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bcd17-fe0a-41ab-85f1-f35003867a75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:39.162325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bcd17-fe0a-41ab-85f1-f35003867a75 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:39.162586 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915ec4a-3ffc-4b12-bcb8-c52bb001e29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:39.162586 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915ec4a-3ffc-4b12-bcb8-c52bb001e29a admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:39.162586 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915ec4a-3ffc-4b12-bcb8-c52bb001e29a admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:39.162586 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915ec4a-3ffc-4b12-bcb8-c52bb001e29a admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:39.163450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915ec4a-3ffc-4b12-bcb8-c52bb001e29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:39.164661 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915ec4a-3ffc-4b12-bcb8-c52bb001e29a admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:39.177794 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 953/1907] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:34:39.183270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bcd17-fe0a-41ab-85f1-f35003867a75 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:39.185982 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 955/1908] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:39.191670 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915ec4a-3ffc-4b12-bcb8-c52bb001e29a admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:39.203259 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bcd17-fe0a-41ab-85f1-f35003867a75 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:39.216404 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88545cc5-ed58-482a-a23f-a30880351723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:39.217133 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88545cc5-ed58-482a-a23f-a30880351723 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:39.219837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88545cc5-ed58-482a-a23f-a30880351723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:39.219837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88545cc5-ed58-482a-a23f-a30880351723 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:39.221829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915ec4a-3ffc-4b12-bcb8-c52bb001e29a admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:39.222491 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88545cc5-ed58-482a-a23f-a30880351723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:39.225287 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88545cc5-ed58-482a-a23f-a30880351723 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:39.237531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe983f3-0f81-4505-a2d9-a126f115a753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:39.238298 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe983f3-0f81-4505-a2d9-a126f115a753 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:39.238582 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe983f3-0f81-4505-a2d9-a126f115a753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:39.238951 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe983f3-0f81-4505-a2d9-a126f115a753 admin admin] PATH_INFO: `/v3/projects/de3045b7f271446fb9c711655f25bd58/users/27ac973e061041fabc19f0fe121bcf32/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:39.280481 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe983f3-0f81-4505-a2d9-a126f115a753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de3045b7f271446fb9c711655f25bd58, user_id=27ac973e061041fabc19f0fe121bcf32, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:39.284934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe983f3-0f81-4505-a2d9-a126f115a753 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:39.413064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:39.432821 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 956/1909] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:39 2022] PUT /identity/v3/projects/de3045b7f271446fb9c711655f25bd58/users/27ac973e061041fabc19f0fe121bcf32/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:39.435043 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 954/1910] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:34:39 2022] POST /identity/v3/projects => generated 385 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:39.443134 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe983f3-0f81-4505-a2d9-a126f115a753 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:39.445236 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaedf99-075c-4dcc-a072-071e83422da9 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:39.445709 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaedf99-075c-4dcc-a072-071e83422da9 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:39.445992 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaedf99-075c-4dcc-a072-071e83422da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:39.491531 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-ecaedf99-075c-4dcc-a072-071e83422da9 None None] MFA Rules not processed for user `27ac973e061041fabc19f0fe121bcf32`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:39.491531 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ecaedf99-075c-4dcc-a072-071e83422da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:39.533498 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe983f3-0f81-4505-a2d9-a126f115a753 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:39.617668 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 955/1911] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:39.635524 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaedf99-075c-4dcc-a072-071e83422da9 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:39.637149 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ecaedf99-075c-4dcc-a072-071e83422da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:39.639998 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b512617-bb26-4eb8-b867-53dd1f6de9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:39.640864 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b512617-bb26-4eb8-b867-53dd1f6de9bc admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:39.641150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b512617-bb26-4eb8-b867-53dd1f6de9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:39.650175 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b512617-bb26-4eb8-b867-53dd1f6de9bc admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:39.650175 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b512617-bb26-4eb8-b867-53dd1f6de9bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:39.650175 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b512617-bb26-4eb8-b867-53dd1f6de9bc admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:39.714143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaedf99-075c-4dcc-a072-071e83422da9 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:39.722010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55d4b9-b57d-4b0f-9a2c-ad4cbead99d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9e8a7a5b8944272a2d1bd2140819ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:39.722779 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55d4b9-b57d-4b0f-9a2c-ad4cbead99d1 service glance] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:39.724428 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55d4b9-b57d-4b0f-9a2c-ad4cbead99d1 service glance] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:39.724428 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55d4b9-b57d-4b0f-9a2c-ad4cbead99d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:39.734200 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55d4b9-b57d-4b0f-9a2c-ad4cbead99d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:39.736014 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55d4b9-b57d-4b0f-9a2c-ad4cbead99d1 service glance] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:39.742769 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:39.748265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 956/1912] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:34:39.780809 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 957/1913] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:34:39 2022] POST /identity/v3/users => generated 293 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:34:39.788107 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55d4b9-b57d-4b0f-9a2c-ad4cbead99d1 service glance] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:39.800411 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55d4b9-b57d-4b0f-9a2c-ad4cbead99d1 service glance] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:39.805868 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a19ffc-b6a8-4390-af21-cca8189e9fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:39.806476 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a19ffc-b6a8-4390-af21-cca8189e9fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:39.806769 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a19ffc-b6a8-4390-af21-cca8189e9fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:39.807586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a19ffc-b6a8-4390-af21-cca8189e9fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:39.808344 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a19ffc-b6a8-4390-af21-cca8189e9fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:39.809825 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a19ffc-b6a8-4390-af21-cca8189e9fd0 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:39.833983 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 957/1914] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:39.843797 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b512617-bb26-4eb8-b867-53dd1f6de9bc admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:39.865002 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b512617-bb26-4eb8-b867-53dd1f6de9bc admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:39.878556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bec38-a2c1-4cdb-9b3d-2d8d5d1d5159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:39.879264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bec38-a2c1-4cdb-9b3d-2d8d5d1d5159 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:39.879691 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bec38-a2c1-4cdb-9b3d-2d8d5d1d5159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:39.879972 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bec38-a2c1-4cdb-9b3d-2d8d5d1d5159 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:39.880658 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31bec38-a2c1-4cdb-9b3d-2d8d5d1d5159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:39.882254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31bec38-a2c1-4cdb-9b3d-2d8d5d1d5159 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:39.902951 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 958/1915] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:39.904247 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a19ffc-b6a8-4390-af21-cca8189e9fd0 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:39.921747 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a19ffc-b6a8-4390-af21-cca8189e9fd0 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:39.926540 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a0d66-0301-44e1-84b2-12aa7309e221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:39.927379 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a0d66-0301-44e1-84b2-12aa7309e221 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:39.927803 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a0d66-0301-44e1-84b2-12aa7309e221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:39.928082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a0d66-0301-44e1-84b2-12aa7309e221 admin admin] PATH_INFO: `/v3/projects/470ec83f3db44e09ac945f97b7f880f7/users/5b7e033e161b40d7b9b292b38a369687/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:39.946542 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a0d66-0301-44e1-84b2-12aa7309e221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=470ec83f3db44e09ac945f97b7f880f7, user_id=5b7e033e161b40d7b9b292b38a369687, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:39.950669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a0d66-0301-44e1-84b2-12aa7309e221 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:40.046792 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 958/1916] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:39 2022] PUT /identity/v3/projects/470ec83f3db44e09ac945f97b7f880f7/users/5b7e033e161b40d7b9b292b38a369687/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:40.059112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc7629-08e9-4937-84ec-29b7f6692831 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:40.059647 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc7629-08e9-4937-84ec-29b7f6692831 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:40.059818 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc7629-08e9-4937-84ec-29b7f6692831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:40.095935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-61bc7629-08e9-4937-84ec-29b7f6692831 None None] MFA Rules not processed for user `5b7e033e161b40d7b9b292b38a369687`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:40.097477 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-61bc7629-08e9-4937-84ec-29b7f6692831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:40.178284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 959/1917] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:40.183714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a0d66-0301-44e1-84b2-12aa7309e221 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:40.272030 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a0d66-0301-44e1-84b2-12aa7309e221 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:40.277174 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c34b0e-641a-4850-9d04-9045f445a6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:40.277788 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c34b0e-641a-4850-9d04-9045f445a6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:40.278066 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c34b0e-641a-4850-9d04-9045f445a6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:40.278344 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c34b0e-641a-4850-9d04-9045f445a6b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:40.279073 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c34b0e-641a-4850-9d04-9045f445a6b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:40.280996 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c34b0e-641a-4850-9d04-9045f445a6b8 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:40.419789 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 959/1918] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:34:40 2022] POST /identity/v3/projects => generated 387 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:40.425077 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc7629-08e9-4937-84ec-29b7f6692831 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:40.437762 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc7629-08e9-4937-84ec-29b7f6692831 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:40.506782 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d736c-fe4a-42de-baa0-3ba668edd3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:40.507444 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d736c-fe4a-42de-baa0-3ba668edd3b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:40.507694 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d736c-fe4a-42de-baa0-3ba668edd3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:40.507966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d736c-fe4a-42de-baa0-3ba668edd3b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:40.508608 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d736c-fe4a-42de-baa0-3ba668edd3b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:40.511304 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d736c-fe4a-42de-baa0-3ba668edd3b9 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:40.572093 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:40.615469 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 960/1919] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:34:40 2022] POST /identity/v3/users => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:40.620178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c34b0e-641a-4850-9d04-9045f445a6b8 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:40.632759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c34b0e-641a-4850-9d04-9045f445a6b8 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:40.638734 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b3c7e-6284-426c-bb93-38fcf534a004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:40.643176 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b3c7e-6284-426c-bb93-38fcf534a004 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:40.643176 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b3c7e-6284-426c-bb93-38fcf534a004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:40.643176 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b3c7e-6284-426c-bb93-38fcf534a004 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:40.643176 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b3c7e-6284-426c-bb93-38fcf534a004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:40.643176 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b3c7e-6284-426c-bb93-38fcf534a004 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:40.657422 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 960/1920] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:40.664184 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d736c-fe4a-42de-baa0-3ba668edd3b9 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:40.675199 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d736c-fe4a-42de-baa0-3ba668edd3b9 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:40.680251 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df229188-5eee-4466-b8e0-ef0f21c3498b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:40.680966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df229188-5eee-4466-b8e0-ef0f21c3498b admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:40.681362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df229188-5eee-4466-b8e0-ef0f21c3498b admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:40.681589 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df229188-5eee-4466-b8e0-ef0f21c3498b admin admin] PATH_INFO: `/v3/projects/a1e76e6247d8467e9e9c309e8d9cf389/users/4a9dd5ef90a14d12a3593bfbbebb3473/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:40.699685 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df229188-5eee-4466-b8e0-ef0f21c3498b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e76e6247d8467e9e9c309e8d9cf389, user_id=4a9dd5ef90a14d12a3593bfbbebb3473, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:40.702496 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df229188-5eee-4466-b8e0-ef0f21c3498b admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:40.870420 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 961/1921] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:40 2022] PUT /identity/v3/projects/a1e76e6247d8467e9e9c309e8d9cf389/users/4a9dd5ef90a14d12a3593bfbbebb3473/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:40.889238 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b3c7e-6284-426c-bb93-38fcf534a004 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:40.904897 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b3c7e-6284-426c-bb93-38fcf534a004 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:40.976886 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9598ab-c3c4-4b9f-b208-fc0f08db1aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:40.977573 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9598ab-c3c4-4b9f-b208-fc0f08db1aed admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:40.977834 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9598ab-c3c4-4b9f-b208-fc0f08db1aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:40.978104 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9598ab-c3c4-4b9f-b208-fc0f08db1aed admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:40.979089 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9598ab-c3c4-4b9f-b208-fc0f08db1aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:40.981233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9598ab-c3c4-4b9f-b208-fc0f08db1aed admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:40.996952 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 961/1922] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:41.001446 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df229188-5eee-4466-b8e0-ef0f21c3498b admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:41.014183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:41.014942 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df229188-5eee-4466-b8e0-ef0f21c3498b admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:41.021664 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17f5e0-1a1d-462a-b1ac-173171ef395f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:41.022344 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17f5e0-1a1d-462a-b1ac-173171ef395f admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:41.022672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17f5e0-1a1d-462a-b1ac-173171ef395f admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:41.022982 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17f5e0-1a1d-462a-b1ac-173171ef395f admin admin] PATH_INFO: `/v3/projects/a1e76e6247d8467e9e9c309e8d9cf389/users/4a9dd5ef90a14d12a3593bfbbebb3473/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:41.024926 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17f5e0-1a1d-462a-b1ac-173171ef395f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e76e6247d8467e9e9c309e8d9cf389, user_id=4a9dd5ef90a14d12a3593bfbbebb3473, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:41.028940 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17f5e0-1a1d-462a-b1ac-173171ef395f admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:41.041078 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 962/1923] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:40 2022] PUT /identity/v3/projects/a1e76e6247d8467e9e9c309e8d9cf389/users/4a9dd5ef90a14d12a3593bfbbebb3473/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:34:41.052089 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824758a-3854-4e8d-804c-0fc99acbc644 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:41.052743 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824758a-3854-4e8d-804c-0fc99acbc644 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:41.053149 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824758a-3854-4e8d-804c-0fc99acbc644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:41.086262 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-2824758a-3854-4e8d-804c-0fc99acbc644 None None] MFA Rules not processed for user `4a9dd5ef90a14d12a3593bfbbebb3473`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:41.087626 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-2824758a-3854-4e8d-804c-0fc99acbc644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:41.160410 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 962/1924] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:41.173835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17f5e0-1a1d-462a-b1ac-173171ef395f admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:41.175762 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-de17f5e0-1a1d-462a-b1ac-173171ef395f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:41.247277 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17f5e0-1a1d-462a-b1ac-173171ef395f admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:41.251416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc942e1-43a8-439a-9e71-f4a87d1784cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:41.252027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc942e1-43a8-439a-9e71-f4a87d1784cf service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:41.252304 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc942e1-43a8-439a-9e71-f4a87d1784cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:41.252650 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc942e1-43a8-439a-9e71-f4a87d1784cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:41.263131 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc942e1-43a8-439a-9e71-f4a87d1784cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:41.267629 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc942e1-43a8-439a-9e71-f4a87d1784cf service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:41.274090 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 963/1925] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:34:41.305099 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824758a-3854-4e8d-804c-0fc99acbc644 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:41.326298 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:41.374238 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824758a-3854-4e8d-804c-0fc99acbc644 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:41.379202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffccd24-9c79-494d-8c06-9abc628927ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:41.379835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffccd24-9c79-494d-8c06-9abc628927ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:41.380451 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffccd24-9c79-494d-8c06-9abc628927ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:41.380451 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffccd24-9c79-494d-8c06-9abc628927ad admin admin] PATH_INFO: `/v3/users/5b7e033e161b40d7b9b292b38a369687` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:41.381612 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffccd24-9c79-494d-8c06-9abc628927ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b7e033e161b40d7b9b292b38a369687)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:41.383640 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffccd24-9c79-494d-8c06-9abc628927ad admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:41.591693 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-7ffccd24-9c79-494d-8c06-9abc628927ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b7e033e161b40d7b9b292b38a369687'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:41.592347 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-7ffccd24-9c79-494d-8c06-9abc628927ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b7e033e161b40d7b9b292b38a369687'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:41.709453 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-7ffccd24-9c79-494d-8c06-9abc628927ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b7e033e161b40d7b9b292b38a369687'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:41.717857 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-7ffccd24-9c79-494d-8c06-9abc628927ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b7e033e161b40d7b9b292b38a369687'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:41.727385 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-7ffccd24-9c79-494d-8c06-9abc628927ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b7e033e161b40d7b9b292b38a369687'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:41.753984 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 963/1926] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:34:41 2022] DELETE /identity/v3/users/5b7e033e161b40d7b9b292b38a369687 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:41.760865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdc3ac-6d4f-40db-aaae-df84ade4c145 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:41.761165 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdc3ac-6d4f-40db-aaae-df84ade4c145 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:41.761434 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdc3ac-6d4f-40db-aaae-df84ade4c145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:41.781818 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-4bfdc3ac-6d4f-40db-aaae-df84ade4c145 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:41.783078 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-4bfdc3ac-6d4f-40db-aaae-df84ade4c145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:41.790140 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:41.855644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 964/1927] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:41.866578 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffccd24-9c79-494d-8c06-9abc628927ad admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:41.868011 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-7ffccd24-9c79-494d-8c06-9abc628927ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:41.943209 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffccd24-9c79-494d-8c06-9abc628927ad admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:41.947033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871445c-5ec1-4a1a-9f57-4e64f5634ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:41.951079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871445c-5ec1-4a1a-9f57-4e64f5634ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:41.951392 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871445c-5ec1-4a1a-9f57-4e64f5634ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:41.952005 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871445c-5ec1-4a1a-9f57-4e64f5634ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:41.963015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871445c-5ec1-4a1a-9f57-4e64f5634ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:41.964814 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871445c-5ec1-4a1a-9f57-4e64f5634ee8 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:41.975533 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 964/1928] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:34:42.018018 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:42.423836 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:42.565019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfdc3ac-6d4f-40db-aaae-df84ade4c145 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:42.567471 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-4bfdc3ac-6d4f-40db-aaae-df84ade4c145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:42.582353 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfdc3ac-6d4f-40db-aaae-df84ade4c145 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:42.600806 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76824305-d63a-432f-83eb-59ca48813dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:42.601766 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76824305-d63a-432f-83eb-59ca48813dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:42.602053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76824305-d63a-432f-83eb-59ca48813dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:42.602408 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76824305-d63a-432f-83eb-59ca48813dba admin admin] PATH_INFO: `/v3/projects/470ec83f3db44e09ac945f97b7f880f7` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:42.604123 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76824305-d63a-432f-83eb-59ca48813dba admin admin] RBAC: Authorizing `identity:delete_project(project_id=470ec83f3db44e09ac945f97b7f880f7)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:42.607935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76824305-d63a-432f-83eb-59ca48813dba admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:42.780254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-76824305-d63a-432f-83eb-59ca48813dba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '470ec83f3db44e09ac945f97b7f880f7', 'request_id': 'req-76824305-d63a-432f-83eb-59ca48813dba'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:42.786049 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-76824305-d63a-432f-83eb-59ca48813dba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '470ec83f3db44e09ac945f97b7f880f7', 'request_id': 'req-76824305-d63a-432f-83eb-59ca48813dba'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:42.862257 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-76824305-d63a-432f-83eb-59ca48813dba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '470ec83f3db44e09ac945f97b7f880f7', 'request_id': 'req-76824305-d63a-432f-83eb-59ca48813dba'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:42.878363 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-76824305-d63a-432f-83eb-59ca48813dba admin admin] The token cache is being invalidate because project 470ec83f3db44e09ac945f97b7f880f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:34:42.878743 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-76824305-d63a-432f-83eb-59ca48813dba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:42.879437 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-76824305-d63a-432f-83eb-59ca48813dba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:42.882502 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 965/1929] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:34:42 2022] DELETE /identity/v3/projects/470ec83f3db44e09ac945f97b7f880f7 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:42.887204 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871445c-5ec1-4a1a-9f57-4e64f5634ee8 service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:42.900169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871445c-5ec1-4a1a-9f57-4e64f5634ee8 service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:42.922377 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:42.971228 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbc533-52cb-4c90-8d41-4bf578bf47a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:42.972018 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbc533-52cb-4c90-8d41-4bf578bf47a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:42.972487 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbc533-52cb-4c90-8d41-4bf578bf47a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:42.972765 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbc533-52cb-4c90-8d41-4bf578bf47a7 admin admin] PATH_INFO: `/v3/users/4a9dd5ef90a14d12a3593bfbbebb3473` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:42.973955 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbc533-52cb-4c90-8d41-4bf578bf47a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a9dd5ef90a14d12a3593bfbbebb3473)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:42.976121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbc533-52cb-4c90-8d41-4bf578bf47a7 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:43.180551 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-31fbc533-52cb-4c90-8d41-4bf578bf47a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a9dd5ef90a14d12a3593bfbbebb3473'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:43.181106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-31fbc533-52cb-4c90-8d41-4bf578bf47a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a9dd5ef90a14d12a3593bfbbebb3473'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:43.258743 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-31fbc533-52cb-4c90-8d41-4bf578bf47a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a9dd5ef90a14d12a3593bfbbebb3473'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:43.267396 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-31fbc533-52cb-4c90-8d41-4bf578bf47a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a9dd5ef90a14d12a3593bfbbebb3473'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:43.268813 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-31fbc533-52cb-4c90-8d41-4bf578bf47a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a9dd5ef90a14d12a3593bfbbebb3473'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:43.286499 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 965/1930] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:34:42 2022] DELETE /identity/v3/users/4a9dd5ef90a14d12a3593bfbbebb3473 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:43.572010 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:43.904256 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76824305-d63a-432f-83eb-59ca48813dba admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:43.904722 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-76824305-d63a-432f-83eb-59ca48813dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:43.923289 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76824305-d63a-432f-83eb-59ca48813dba admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:43.997117 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe5aee-3636-45f3-af00-1601bf85a4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:44.001603 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe5aee-3636-45f3-af00-1601bf85a4e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:44.001603 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe5aee-3636-45f3-af00-1601bf85a4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:44.001603 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe5aee-3636-45f3-af00-1601bf85a4e9 admin admin] PATH_INFO: `/v3/projects/a1e76e6247d8467e9e9c309e8d9cf389` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:44.001603 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe5aee-3636-45f3-af00-1601bf85a4e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1e76e6247d8467e9e9c309e8d9cf389)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:44.001603 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe5aee-3636-45f3-af00-1601bf85a4e9 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:44.023858 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:44.124897 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-bebe5aee-3636-45f3-af00-1601bf85a4e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1e76e6247d8467e9e9c309e8d9cf389', 'request_id': 'req-bebe5aee-3636-45f3-af00-1601bf85a4e9'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:44.130894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-bebe5aee-3636-45f3-af00-1601bf85a4e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1e76e6247d8467e9e9c309e8d9cf389', 'request_id': 'req-bebe5aee-3636-45f3-af00-1601bf85a4e9'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:44.263364 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-bebe5aee-3636-45f3-af00-1601bf85a4e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1e76e6247d8467e9e9c309e8d9cf389', 'request_id': 'req-bebe5aee-3636-45f3-af00-1601bf85a4e9'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:44.282405 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-bebe5aee-3636-45f3-af00-1601bf85a4e9 admin admin] The token cache is being invalidate because project a1e76e6247d8467e9e9c309e8d9cf389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:34:44.282789 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-bebe5aee-3636-45f3-af00-1601bf85a4e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:44.283544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-bebe5aee-3636-45f3-af00-1601bf85a4e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:44.285175 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 966/1931] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:34:43 2022] DELETE /identity/v3/projects/a1e76e6247d8467e9e9c309e8d9cf389 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:44.290466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8563ba-f44a-430f-9c14-90ea27a6d133 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:44.290747 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8563ba-f44a-430f-9c14-90ea27a6d133 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:44.291048 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8563ba-f44a-430f-9c14-90ea27a6d133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:44.312501 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-7b8563ba-f44a-430f-9c14-90ea27a6d133 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:44.313657 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-7b8563ba-f44a-430f-9c14-90ea27a6d133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:44.375190 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 966/1932] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:34:44.384014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65473d1-4e8b-4feb-8b21-45c4cbc7e2b1 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:44.384363 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65473d1-4e8b-4feb-8b21-45c4cbc7e2b1 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:44.384855 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65473d1-4e8b-4feb-8b21-45c4cbc7e2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:44.408313 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-b65473d1-4e8b-4feb-8b21-45c4cbc7e2b1 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:44.409547 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-b65473d1-4e8b-4feb-8b21-45c4cbc7e2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:44.428910 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 967/1933] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:44.434509 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8563ba-f44a-430f-9c14-90ea27a6d133 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:44.444485 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8563ba-f44a-430f-9c14-90ea27a6d133 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:44.450303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2609bb-d68e-4376-8684-ee026cc32a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:44.450932 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2609bb-d68e-4376-8684-ee026cc32a00 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:44.451205 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2609bb-d68e-4376-8684-ee026cc32a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:44.451476 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2609bb-d68e-4376-8684-ee026cc32a00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:44.452118 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2609bb-d68e-4376-8684-ee026cc32a00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:34:44.452429 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2609bb-d68e-4376-8684-ee026cc32a00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:44.454067 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2609bb-d68e-4376-8684-ee026cc32a00 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:44.467254 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 967/1934] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:34:44.472184 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65473d1-4e8b-4feb-8b21-45c4cbc7e2b1 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:44.482231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65473d1-4e8b-4feb-8b21-45c4cbc7e2b1 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:44.486951 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d19763-0d01-4e4b-b853-a1c9b30e52ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:44.487554 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d19763-0d01-4e4b-b853-a1c9b30e52ce admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:44.495711 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d19763-0d01-4e4b-b853-a1c9b30e52ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:44.495711 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d19763-0d01-4e4b-b853-a1c9b30e52ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:44.495711 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d19763-0d01-4e4b-b853-a1c9b30e52ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:44.495711 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d19763-0d01-4e4b-b853-a1c9b30e52ce admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:44.581067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 968/1935] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:34:44 2022] POST /identity/v3/projects => generated 361 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:44.585256 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2609bb-d68e-4376-8684-ee026cc32a00 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:44.598797 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2609bb-d68e-4376-8684-ee026cc32a00 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:44.671337 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb082b-ee80-4ef5-b7a0-9b20cf731b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:44.672316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb082b-ee80-4ef5-b7a0-9b20cf731b83 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:44.672697 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb082b-ee80-4ef5-b7a0-9b20cf731b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:44.672975 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb082b-ee80-4ef5-b7a0-9b20cf731b83 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:44.673684 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb082b-ee80-4ef5-b7a0-9b20cf731b83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:44.676126 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb082b-ee80-4ef5-b7a0-9b20cf731b83 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:44.819332 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 968/1936] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:34:44 2022] POST /identity/v3/users => generated 281 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:34:44.823885 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d19763-0d01-4e4b-b853-a1c9b30e52ce admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:44.834455 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d19763-0d01-4e4b-b853-a1c9b30e52ce admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:44.840436 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007f25c-63fa-42cf-ad23-091f53df0416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:44.841035 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007f25c-63fa-42cf-ad23-091f53df0416 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:44.841311 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007f25c-63fa-42cf-ad23-091f53df0416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:44.841580 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007f25c-63fa-42cf-ad23-091f53df0416 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:44.842221 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007f25c-63fa-42cf-ad23-091f53df0416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:44.843886 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007f25c-63fa-42cf-ad23-091f53df0416 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:44.855218 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 969/1937] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:44.859267 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb082b-ee80-4ef5-b7a0-9b20cf731b83 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:44.869201 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb082b-ee80-4ef5-b7a0-9b20cf731b83 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:44.874517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7593c-4986-447e-90bc-98155bd8dec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:44.875273 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7593c-4986-447e-90bc-98155bd8dec6 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:44.875503 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7593c-4986-447e-90bc-98155bd8dec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:44.875799 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7593c-4986-447e-90bc-98155bd8dec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:44.876471 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7593c-4986-447e-90bc-98155bd8dec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:44.878058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7593c-4986-447e-90bc-98155bd8dec6 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:44.893885 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 969/1938] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:44.894668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007f25c-63fa-42cf-ad23-091f53df0416 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:44.906411 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007f25c-63fa-42cf-ad23-091f53df0416 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:44.910181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:44.913617 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c838df-0789-4b60-a185-29cbcd692566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:44.919895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c838df-0789-4b60-a185-29cbcd692566 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:44.919895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c838df-0789-4b60-a185-29cbcd692566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:44.919895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c838df-0789-4b60-a185-29cbcd692566 admin admin] PATH_INFO: `/v3/projects/c8b8d4532dbd46b1badfb8e70c012ed9/users/1e656f50a2e74d7cbc7b5a20712d2289/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:44.931065 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c838df-0789-4b60-a185-29cbcd692566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8b8d4532dbd46b1badfb8e70c012ed9, user_id=1e656f50a2e74d7cbc7b5a20712d2289, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:44.934331 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c838df-0789-4b60-a185-29cbcd692566 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:45.012272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 970/1939] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:44 2022] PUT /identity/v3/projects/c8b8d4532dbd46b1badfb8e70c012ed9/users/1e656f50a2e74d7cbc7b5a20712d2289/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:45.022635 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e19db-7cb0-4826-9eae-aa84660fc91c None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:45.023018 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e19db-7cb0-4826-9eae-aa84660fc91c None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:45.023292 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e19db-7cb0-4826-9eae-aa84660fc91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:45.052307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-803e19db-7cb0-4826-9eae-aa84660fc91c None None] MFA Rules not processed for user `1e656f50a2e74d7cbc7b5a20712d2289`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:45.053543 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-803e19db-7cb0-4826-9eae-aa84660fc91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:45.068328 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:45.125403 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 970/1940] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:45.163213 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c838df-0789-4b60-a185-29cbcd692566 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:45.167907 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-52c838df-0789-4b60-a185-29cbcd692566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:45.232480 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c838df-0789-4b60-a185-29cbcd692566 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:45.236748 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9602a9b-6e1a-4b6f-b19e-56e4233089ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:45.237431 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9602a9b-6e1a-4b6f-b19e-56e4233089ef service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:45.237711 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9602a9b-6e1a-4b6f-b19e-56e4233089ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:45.238013 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9602a9b-6e1a-4b6f-b19e-56e4233089ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:45.247372 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9602a9b-6e1a-4b6f-b19e-56e4233089ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:45.248874 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9602a9b-6e1a-4b6f-b19e-56e4233089ef service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:45.258093 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 971/1941] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:34:45.275652 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e19db-7cb0-4826-9eae-aa84660fc91c None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:45.347188 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e19db-7cb0-4826-9eae-aa84660fc91c None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:45.352592 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0da362-e06c-4aae-8069-e8c3d704689a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:45.353287 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0da362-e06c-4aae-8069-e8c3d704689a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:45.353595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0da362-e06c-4aae-8069-e8c3d704689a admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:45.361459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0da362-e06c-4aae-8069-e8c3d704689a admin admin] PATH_INFO: `/v3/users/1e656f50a2e74d7cbc7b5a20712d2289` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:45.361459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0da362-e06c-4aae-8069-e8c3d704689a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e656f50a2e74d7cbc7b5a20712d2289)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:45.361459 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0da362-e06c-4aae-8069-e8c3d704689a admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:45.620000 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2e0da362-e06c-4aae-8069-e8c3d704689a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e656f50a2e74d7cbc7b5a20712d2289'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:45.621069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2e0da362-e06c-4aae-8069-e8c3d704689a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e656f50a2e74d7cbc7b5a20712d2289'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:45.765485 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2e0da362-e06c-4aae-8069-e8c3d704689a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e656f50a2e74d7cbc7b5a20712d2289'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:45.774484 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2e0da362-e06c-4aae-8069-e8c3d704689a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e656f50a2e74d7cbc7b5a20712d2289'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:45.775908 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2e0da362-e06c-4aae-8069-e8c3d704689a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e656f50a2e74d7cbc7b5a20712d2289'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:45.806071 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 971/1942] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:34:45 2022] DELETE /identity/v3/users/1e656f50a2e74d7cbc7b5a20712d2289 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:34:45.811384 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb4b3c-ca6d-4df4-a867-dff7b837c905 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:45.812611 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb4b3c-ca6d-4df4-a867-dff7b837c905 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:45.813187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb4b3c-ca6d-4df4-a867-dff7b837c905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:45.838173 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-88eb4b3c-ca6d-4df4-a867-dff7b837c905 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:45.839501 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-88eb4b3c-ca6d-4df4-a867-dff7b837c905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:45.926447 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 972/1943] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:45.940743 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0da362-e06c-4aae-8069-e8c3d704689a admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:45.943276 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-2e0da362-e06c-4aae-8069-e8c3d704689a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:46.007283 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:46.019106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0da362-e06c-4aae-8069-e8c3d704689a admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:46.022895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667e6c4-614d-41b9-92de-b2badba75dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:46.023525 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667e6c4-614d-41b9-92de-b2badba75dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:46.023806 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667e6c4-614d-41b9-92de-b2badba75dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:46.024078 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667e6c4-614d-41b9-92de-b2badba75dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:46.034308 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667e6c4-614d-41b9-92de-b2badba75dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:46.035965 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667e6c4-614d-41b9-92de-b2badba75dc3 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:46.056574 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 972/1944] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:34:46.056574 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:46.527933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb4b3c-ca6d-4df4-a867-dff7b837c905 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:46.529472 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-88eb4b3c-ca6d-4df4-a867-dff7b837c905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:46.548950 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb4b3c-ca6d-4df4-a867-dff7b837c905 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:46.553793 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7fafd-bb28-4a87-bdd3-f41236f6e66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:46.554515 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7fafd-bb28-4a87-bdd3-f41236f6e66c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:46.554704 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7fafd-bb28-4a87-bdd3-f41236f6e66c admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:46.555054 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7fafd-bb28-4a87-bdd3-f41236f6e66c admin admin] PATH_INFO: `/v3/projects/c8b8d4532dbd46b1badfb8e70c012ed9` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:46.556245 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7fafd-bb28-4a87-bdd3-f41236f6e66c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8b8d4532dbd46b1badfb8e70c012ed9)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:46.558718 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7fafd-bb28-4a87-bdd3-f41236f6e66c admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:46.685849 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-16f7fafd-bb28-4a87-bdd3-f41236f6e66c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8b8d4532dbd46b1badfb8e70c012ed9', 'request_id': 'req-16f7fafd-bb28-4a87-bdd3-f41236f6e66c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:46.691841 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-16f7fafd-bb28-4a87-bdd3-f41236f6e66c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8b8d4532dbd46b1badfb8e70c012ed9', 'request_id': 'req-16f7fafd-bb28-4a87-bdd3-f41236f6e66c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:46.817577 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-16f7fafd-bb28-4a87-bdd3-f41236f6e66c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8b8d4532dbd46b1badfb8e70c012ed9', 'request_id': 'req-16f7fafd-bb28-4a87-bdd3-f41236f6e66c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:46.829996 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-16f7fafd-bb28-4a87-bdd3-f41236f6e66c admin admin] The token cache is being invalidate because project c8b8d4532dbd46b1badfb8e70c012ed9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:34:46.830285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-16f7fafd-bb28-4a87-bdd3-f41236f6e66c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:46.830982 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-16f7fafd-bb28-4a87-bdd3-f41236f6e66c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:46.832523 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 973/1945] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:34:46 2022] DELETE /identity/v3/projects/c8b8d4532dbd46b1badfb8e70c012ed9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:46.837739 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9073a2-04f2-42ba-a752-a6bcbfec89f7 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:46.838147 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9073a2-04f2-42ba-a752-a6bcbfec89f7 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:46.838520 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9073a2-04f2-42ba-a752-a6bcbfec89f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:46.860198 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-fb9073a2-04f2-42ba-a752-a6bcbfec89f7 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:46.861643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-fb9073a2-04f2-42ba-a752-a6bcbfec89f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:46.929941 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 973/1946] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:46.938845 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7fbb9-a2e7-4f29-8bca-9aa780da57bc None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:46.939075 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7fbb9-a2e7-4f29-8bca-9aa780da57bc None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:46.939353 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7fbb9-a2e7-4f29-8bca-9aa780da57bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:46.959849 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-89e7fbb9-a2e7-4f29-8bca-9aa780da57bc None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:46.961063 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-89e7fbb9-a2e7-4f29-8bca-9aa780da57bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:46.969400 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 974/1947] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:46.973840 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9073a2-04f2-42ba-a752-a6bcbfec89f7 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:46.985523 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9073a2-04f2-42ba-a752-a6bcbfec89f7 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:46.990271 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff95885-ef73-4b74-855a-5c525685b749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:46.990918 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff95885-ef73-4b74-855a-5c525685b749 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:46.991195 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff95885-ef73-4b74-855a-5c525685b749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:46.991463 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff95885-ef73-4b74-855a-5c525685b749 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:46.992108 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff95885-ef73-4b74-855a-5c525685b749 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:34:46.992409 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff95885-ef73-4b74-855a-5c525685b749 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:46.994091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff95885-ef73-4b74-855a-5c525685b749 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:47.001088 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:47.010769 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 974/1948] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:34:47.012176 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7fbb9-a2e7-4f29-8bca-9aa780da57bc None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:47.022190 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7fbb9-a2e7-4f29-8bca-9aa780da57bc None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:47.027800 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df79481-b422-4ace-9270-c650cd912e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:47.028545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df79481-b422-4ace-9270-c650cd912e07 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:47.028829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df79481-b422-4ace-9270-c650cd912e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:47.029102 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df79481-b422-4ace-9270-c650cd912e07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:47.029749 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df79481-b422-4ace-9270-c650cd912e07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:47.031689 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df79481-b422-4ace-9270-c650cd912e07 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:47.136855 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 975/1949] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:34:47 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:34:47.140788 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff95885-ef73-4b74-855a-5c525685b749 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:47.155188 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff95885-ef73-4b74-855a-5c525685b749 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:47.234574 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164075a-5af2-4989-b0b4-cb3482273f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:47.234574 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164075a-5af2-4989-b0b4-cb3482273f6f admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:47.234971 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164075a-5af2-4989-b0b4-cb3482273f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:47.235320 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164075a-5af2-4989-b0b4-cb3482273f6f admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:47.236149 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e164075a-5af2-4989-b0b4-cb3482273f6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:47.238508 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e164075a-5af2-4989-b0b4-cb3482273f6f admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:47.527532 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 975/1950] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:34:47 2022] POST /identity/v3/users => generated 292 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:34:47.531979 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df79481-b422-4ace-9270-c650cd912e07 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:47.544654 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df79481-b422-4ace-9270-c650cd912e07 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:47.549306 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426e73c-6d37-46de-80eb-866fd0af42a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:47.549930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426e73c-6d37-46de-80eb-866fd0af42a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:47.550190 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426e73c-6d37-46de-80eb-866fd0af42a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:47.550462 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426e73c-6d37-46de-80eb-866fd0af42a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:47.551154 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426e73c-6d37-46de-80eb-866fd0af42a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:47.552746 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426e73c-6d37-46de-80eb-866fd0af42a3 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:47.563382 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 976/1951] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:47.567720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164075a-5af2-4989-b0b4-cb3482273f6f admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:47.578974 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164075a-5af2-4989-b0b4-cb3482273f6f admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:47.584596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0b3fc-215d-40fb-b820-45bac19dbef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:47.585417 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0b3fc-215d-40fb-b820-45bac19dbef5 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:47.585692 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0b3fc-215d-40fb-b820-45bac19dbef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:47.586235 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0b3fc-215d-40fb-b820-45bac19dbef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:47.587037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0b3fc-215d-40fb-b820-45bac19dbef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:47.589397 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0b3fc-215d-40fb-b820-45bac19dbef5 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:47.601161 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 976/1952] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:47.605619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426e73c-6d37-46de-80eb-866fd0af42a3 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:47.616124 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426e73c-6d37-46de-80eb-866fd0af42a3 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:47.621134 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638aa15-15a0-4f43-a239-7e2b26fe8550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:47.621775 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638aa15-15a0-4f43-a239-7e2b26fe8550 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:47.622051 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638aa15-15a0-4f43-a239-7e2b26fe8550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:47.622320 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638aa15-15a0-4f43-a239-7e2b26fe8550 admin admin] PATH_INFO: `/v3/projects/a5c0747189164665a1c15ea4c339a2f2/users/7381f13c2dbf47d9a7c5bc4cbf582d18/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:47.639529 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638aa15-15a0-4f43-a239-7e2b26fe8550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5c0747189164665a1c15ea4c339a2f2, user_id=7381f13c2dbf47d9a7c5bc4cbf582d18, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:47.642349 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638aa15-15a0-4f43-a239-7e2b26fe8550 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:47.829729 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:47.835248 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 977/1953] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:47 2022] PUT /identity/v3/projects/a5c0747189164665a1c15ea4c339a2f2/users/7381f13c2dbf47d9a7c5bc4cbf582d18/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:47.847090 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9034ca-67c9-436c-8b8d-46f8ebaa16e6 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:47.847371 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9034ca-67c9-436c-8b8d-46f8ebaa16e6 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:47.847640 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9034ca-67c9-436c-8b8d-46f8ebaa16e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:47.875478 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-4d9034ca-67c9-436c-8b8d-46f8ebaa16e6 None None] MFA Rules not processed for user `7381f13c2dbf47d9a7c5bc4cbf582d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:47.876686 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-4d9034ca-67c9-436c-8b8d-46f8ebaa16e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:47.944596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 977/1954] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:47.950245 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638aa15-15a0-4f43-a239-7e2b26fe8550 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:48.013216 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638aa15-15a0-4f43-a239-7e2b26fe8550 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:48.017886 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dca319-2997-4ab0-93d4-0071c436a700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:48.018509 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dca319-2997-4ab0-93d4-0071c436a700 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:48.018802 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dca319-2997-4ab0-93d4-0071c436a700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:48.019119 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dca319-2997-4ab0-93d4-0071c436a700 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:48.019909 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dca319-2997-4ab0-93d4-0071c436a700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:48.021759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dca319-2997-4ab0-93d4-0071c436a700 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:48.171171 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 978/1955] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:34:47 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:48.172489 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9034ca-67c9-436c-8b8d-46f8ebaa16e6 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:48.183696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9034ca-67c9-436c-8b8d-46f8ebaa16e6 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:48.245406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ae222-0c9e-4fbc-99a0-b482bb126bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:48.246052 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ae222-0c9e-4fbc-99a0-b482bb126bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:48.246422 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ae222-0c9e-4fbc-99a0-b482bb126bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:48.246798 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ae222-0c9e-4fbc-99a0-b482bb126bd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:48.247531 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ae222-0c9e-4fbc-99a0-b482bb126bd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:48.249926 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ae222-0c9e-4fbc-99a0-b482bb126bd3 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:48.350069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 978/1956] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:34:48 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:48.355601 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dca319-2997-4ab0-93d4-0071c436a700 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:48.367293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dca319-2997-4ab0-93d4-0071c436a700 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:48.373156 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aecec9-0460-414e-aaba-25e05cad1a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:48.373778 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aecec9-0460-414e-aaba-25e05cad1a17 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:48.374057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aecec9-0460-414e-aaba-25e05cad1a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:48.374329 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aecec9-0460-414e-aaba-25e05cad1a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:48.375020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aecec9-0460-414e-aaba-25e05cad1a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:48.376674 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aecec9-0460-414e-aaba-25e05cad1a17 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:48.391751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 979/1957] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:48.393470 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ae222-0c9e-4fbc-99a0-b482bb126bd3 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:48.406114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ae222-0c9e-4fbc-99a0-b482bb126bd3 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:48.411411 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f2854-cffa-4dd1-923c-e2089f37eb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:48.412061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f2854-cffa-4dd1-923c-e2089f37eb91 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:48.412347 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f2854-cffa-4dd1-923c-e2089f37eb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:48.412618 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f2854-cffa-4dd1-923c-e2089f37eb91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:48.412767 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:48.413348 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f2854-cffa-4dd1-923c-e2089f37eb91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:48.415111 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f2854-cffa-4dd1-923c-e2089f37eb91 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:48.426875 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 979/1958] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:48.431154 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aecec9-0460-414e-aaba-25e05cad1a17 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:48.443125 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aecec9-0460-414e-aaba-25e05cad1a17 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:48.453122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e6c4b-b30f-4d13-9bad-1de4cd98c14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:48.453973 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e6c4b-b30f-4d13-9bad-1de4cd98c14d admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:48.454256 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e6c4b-b30f-4d13-9bad-1de4cd98c14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:48.454531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e6c4b-b30f-4d13-9bad-1de4cd98c14d admin admin] PATH_INFO: `/v3/projects/4f2bd3db3ae946908520c50ab4b992dd/users/d875baabe6fb4c5c93f088b447b8671a/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:48.470032 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e6c4b-b30f-4d13-9bad-1de4cd98c14d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2bd3db3ae946908520c50ab4b992dd, user_id=d875baabe6fb4c5c93f088b447b8671a, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:48.472936 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e6c4b-b30f-4d13-9bad-1de4cd98c14d admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:48.554626 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 980/1959] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:48 2022] PUT /identity/v3/projects/4f2bd3db3ae946908520c50ab4b992dd/users/d875baabe6fb4c5c93f088b447b8671a/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:48.572479 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a84a70-1069-4c34-8856-aa2210ccbdd1 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:48.576101 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a84a70-1069-4c34-8856-aa2210ccbdd1 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:48.577313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a84a70-1069-4c34-8856-aa2210ccbdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:48.612722 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-66a84a70-1069-4c34-8856-aa2210ccbdd1 None None] MFA Rules not processed for user `d875baabe6fb4c5c93f088b447b8671a`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:48.614164 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-66a84a70-1069-4c34-8856-aa2210ccbdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:48.669942 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:48.703221 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 980/1960] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:48.708016 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e6c4b-b30f-4d13-9bad-1de4cd98c14d admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:48.780836 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e6c4b-b30f-4d13-9bad-1de4cd98c14d admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:48.785907 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e05e6-cb0e-4efd-9415-4b605ab502f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:48.788060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e05e6-cb0e-4efd-9415-4b605ab502f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:48.788060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e05e6-cb0e-4efd-9415-4b605ab502f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:48.788060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e05e6-cb0e-4efd-9415-4b605ab502f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:48.788060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e05e6-cb0e-4efd-9415-4b605ab502f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:48.790344 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e05e6-cb0e-4efd-9415-4b605ab502f6 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:48.888410 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 981/1961] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:34:48 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:48.892374 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a84a70-1069-4c34-8856-aa2210ccbdd1 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:48.905766 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a84a70-1069-4c34-8856-aa2210ccbdd1 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:48.983627 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e051bc-c182-4039-a330-b5fc093d40f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:48.984261 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e051bc-c182-4039-a330-b5fc093d40f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:48.984541 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e051bc-c182-4039-a330-b5fc093d40f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:48.984940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e051bc-c182-4039-a330-b5fc093d40f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:48.985608 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e051bc-c182-4039-a330-b5fc093d40f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:48.987574 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e051bc-c182-4039-a330-b5fc093d40f5 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:49.123036 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 981/1962] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:34:48 2022] POST /identity/v3/users => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:34:49.126660 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e05e6-cb0e-4efd-9415-4b605ab502f6 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:49.129146 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:49.145839 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e05e6-cb0e-4efd-9415-4b605ab502f6 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:49.165370 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7a831-61a1-4b29-9cb6-70ef3a5b18df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:49.166188 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7a831-61a1-4b29-9cb6-70ef3a5b18df admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:49.166533 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7a831-61a1-4b29-9cb6-70ef3a5b18df admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:49.166842 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7a831-61a1-4b29-9cb6-70ef3a5b18df admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:49.167615 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7a831-61a1-4b29-9cb6-70ef3a5b18df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:49.169315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7a831-61a1-4b29-9cb6-70ef3a5b18df admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:49.185103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 982/1963] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:49.189664 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e051bc-c182-4039-a330-b5fc093d40f5 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:49.200717 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e051bc-c182-4039-a330-b5fc093d40f5 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:49.205335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c0da7-8fa9-495d-87b0-61949f9a852f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:49.205979 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c0da7-8fa9-495d-87b0-61949f9a852f admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:49.206371 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c0da7-8fa9-495d-87b0-61949f9a852f admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:49.206647 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c0da7-8fa9-495d-87b0-61949f9a852f admin admin] PATH_INFO: `/v3/projects/b776b0bb902b46b59b51175d541b1640/users/62dc2a73e9cd4d558a064708520ca015/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:49.224430 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c0da7-8fa9-495d-87b0-61949f9a852f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b776b0bb902b46b59b51175d541b1640, user_id=62dc2a73e9cd4d558a064708520ca015, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:49.226792 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c0da7-8fa9-495d-87b0-61949f9a852f admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:49.359589 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 982/1964] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:49 2022] PUT /identity/v3/projects/b776b0bb902b46b59b51175d541b1640/users/62dc2a73e9cd4d558a064708520ca015/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:49.359691 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7a831-61a1-4b29-9cb6-70ef3a5b18df admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:49.371579 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7a831-61a1-4b29-9cb6-70ef3a5b18df admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:49.447130 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95352dc-7f29-468f-b3f7-7c2f51f481d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:49.451224 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95352dc-7f29-468f-b3f7-7c2f51f481d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:49.451224 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95352dc-7f29-468f-b3f7-7c2f51f481d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:49.451224 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95352dc-7f29-468f-b3f7-7c2f51f481d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:49.451224 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95352dc-7f29-468f-b3f7-7c2f51f481d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:49.451655 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95352dc-7f29-468f-b3f7-7c2f51f481d7 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:49.461528 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 983/1965] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:34:49.465890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c0da7-8fa9-495d-87b0-61949f9a852f admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:49.476375 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c0da7-8fa9-495d-87b0-61949f9a852f admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:49.481241 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cff00-4c80-4101-94f3-4c40c58af65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:49.481883 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cff00-4c80-4101-94f3-4c40c58af65c admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:49.482157 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cff00-4c80-4101-94f3-4c40c58af65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:49.482429 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cff00-4c80-4101-94f3-4c40c58af65c admin admin] PATH_INFO: `/v3/projects/b776b0bb902b46b59b51175d541b1640/users/62dc2a73e9cd4d558a064708520ca015/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:49.484369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cff00-4c80-4101-94f3-4c40c58af65c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b776b0bb902b46b59b51175d541b1640, user_id=62dc2a73e9cd4d558a064708520ca015, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:49.491223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cff00-4c80-4101-94f3-4c40c58af65c admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:49.497770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 983/1966] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:34:49 2022] PUT /identity/v3/projects/b776b0bb902b46b59b51175d541b1640/users/62dc2a73e9cd4d558a064708520ca015/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:34:49.508869 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11375006-5560-470b-a4c6-bea451a709e8 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:49.509153 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11375006-5560-470b-a4c6-bea451a709e8 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:49.509426 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11375006-5560-470b-a4c6-bea451a709e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:49.526470 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:49.538395 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-11375006-5560-470b-a4c6-bea451a709e8 None None] MFA Rules not processed for user `62dc2a73e9cd4d558a064708520ca015`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:49.539726 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-11375006-5560-470b-a4c6-bea451a709e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:49.613297 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 984/1967] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:49.625238 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cff00-4c80-4101-94f3-4c40c58af65c admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:49.627005 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-240cff00-4c80-4101-94f3-4c40c58af65c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:49.690155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cff00-4c80-4101-94f3-4c40c58af65c admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:49.693844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71784cf6-bf6b-41ca-8a28-dddd51e2a971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:49.694447 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71784cf6-bf6b-41ca-8a28-dddd51e2a971 service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:49.694721 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71784cf6-bf6b-41ca-8a28-dddd51e2a971 service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:49.695063 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71784cf6-bf6b-41ca-8a28-dddd51e2a971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:49.755304 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71784cf6-bf6b-41ca-8a28-dddd51e2a971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:49.756758 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71784cf6-bf6b-41ca-8a28-dddd51e2a971 service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:49.768604 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 984/1968] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:34:50.035346 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:52.991810 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11375006-5560-470b-a4c6-bea451a709e8 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:52.993202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-11375006-5560-470b-a4c6-bea451a709e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:53.005629 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11375006-5560-470b-a4c6-bea451a709e8 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:53.009173 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47464e37-a7f7-4bad-9a65-a6859a47fec7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:53.009769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47464e37-a7f7-4bad-9a65-a6859a47fec7 service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:53.010048 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47464e37-a7f7-4bad-9a65-a6859a47fec7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:53.010325 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47464e37-a7f7-4bad-9a65-a6859a47fec7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:53.027835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:53.069609 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47464e37-a7f7-4bad-9a65-a6859a47fec7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:53.071248 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47464e37-a7f7-4bad-9a65-a6859a47fec7 service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:53.082128 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 985/1969] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:34:54.745519 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71784cf6-bf6b-41ca-8a28-dddd51e2a971 service cinder] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:54.754413 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71784cf6-bf6b-41ca-8a28-dddd51e2a971 service cinder] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:54.758061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0ab42-5ccd-4eb2-aa1d-1e19076567e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:54.758666 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0ab42-5ccd-4eb2-aa1d-1e19076567e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:54.758970 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0ab42-5ccd-4eb2-aa1d-1e19076567e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:54.759240 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0ab42-5ccd-4eb2-aa1d-1e19076567e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:54.769268 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0ab42-5ccd-4eb2-aa1d-1e19076567e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:54.770700 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0ab42-5ccd-4eb2-aa1d-1e19076567e5 service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:54.781121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 985/1970] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:34:58.303781 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47464e37-a7f7-4bad-9a65-a6859a47fec7 service cinder] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:58.305448 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-47464e37-a7f7-4bad-9a65-a6859a47fec7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:58.377908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47464e37-a7f7-4bad-9a65-a6859a47fec7 service cinder] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:58.382550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb033d1-801c-447b-b2da-842d9a39e5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:58.383255 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb033d1-801c-447b-b2da-842d9a39e5e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:58.384005 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb033d1-801c-447b-b2da-842d9a39e5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:58.384005 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb033d1-801c-447b-b2da-842d9a39e5e8 admin admin] PATH_INFO: `/v3/users/9adda55e1a6a4e1d8ea39ccbe0f10b36` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:58.384997 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb033d1-801c-447b-b2da-842d9a39e5e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9adda55e1a6a4e1d8ea39ccbe0f10b36)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:58.386996 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb033d1-801c-447b-b2da-842d9a39e5e8 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:58.574647 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-3bb033d1-801c-447b-b2da-842d9a39e5e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9adda55e1a6a4e1d8ea39ccbe0f10b36'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:58.575250 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-3bb033d1-801c-447b-b2da-842d9a39e5e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9adda55e1a6a4e1d8ea39ccbe0f10b36'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:58.668580 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-3bb033d1-801c-447b-b2da-842d9a39e5e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9adda55e1a6a4e1d8ea39ccbe0f10b36'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:58.682063 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-3bb033d1-801c-447b-b2da-842d9a39e5e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9adda55e1a6a4e1d8ea39ccbe0f10b36'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:58.683246 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-3bb033d1-801c-447b-b2da-842d9a39e5e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9adda55e1a6a4e1d8ea39ccbe0f10b36'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:34:58.695784 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 986/1971] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:34:58 2022] DELETE /identity/v3/users/9adda55e1a6a4e1d8ea39ccbe0f10b36 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:34:58.700942 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3a67a-0647-45a9-b69a-6ea443aac56c None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:58.701454 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3a67a-0647-45a9-b69a-6ea443aac56c None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:58.701566 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3a67a-0647-45a9-b69a-6ea443aac56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:58.721153 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-94e3a67a-0647-45a9-b69a-6ea443aac56c None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:34:58.722360 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-94e3a67a-0647-45a9-b69a-6ea443aac56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:58.748067 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:58.780982 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 986/1972] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:34:58.790808 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb033d1-801c-447b-b2da-842d9a39e5e8 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:34:58.793055 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-3bb033d1-801c-447b-b2da-842d9a39e5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:34:58.839582 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:34:58.854908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb033d1-801c-447b-b2da-842d9a39e5e8 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:34:58.858592 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca62c0e-7da7-4c3f-96ef-aa1fdcb95ece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:34:58.859227 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca62c0e-7da7-4c3f-96ef-aa1fdcb95ece service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:34:58.859501 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca62c0e-7da7-4c3f-96ef-aa1fdcb95ece service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:34:58.859770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca62c0e-7da7-4c3f-96ef-aa1fdcb95ece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:34:58.868661 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca62c0e-7da7-4c3f-96ef-aa1fdcb95ece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:34:58.871027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca62c0e-7da7-4c3f-96ef-aa1fdcb95ece service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:34:58.881353 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 987/1973] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:34:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:35:00.005534 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3a67a-0647-45a9-b69a-6ea443aac56c None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:00.007361 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-94e3a67a-0647-45a9-b69a-6ea443aac56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:00.022874 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3a67a-0647-45a9-b69a-6ea443aac56c None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:00.029261 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18907e55-615d-4390-aa65-264bade177a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:00.030169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18907e55-615d-4390-aa65-264bade177a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:00.030414 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18907e55-615d-4390-aa65-264bade177a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:00.030724 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18907e55-615d-4390-aa65-264bade177a2 admin admin] PATH_INFO: `/v3/projects/ff1e447b7be2499b8d392832aae8f81f` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:00.032168 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18907e55-615d-4390-aa65-264bade177a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff1e447b7be2499b8d392832aae8f81f)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:00.034505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18907e55-615d-4390-aa65-264bade177a2 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:00.152402 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-18907e55-615d-4390-aa65-264bade177a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1e447b7be2499b8d392832aae8f81f', 'request_id': 'req-18907e55-615d-4390-aa65-264bade177a2'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:00.159473 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-18907e55-615d-4390-aa65-264bade177a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1e447b7be2499b8d392832aae8f81f', 'request_id': 'req-18907e55-615d-4390-aa65-264bade177a2'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:00.167749 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-18907e55-615d-4390-aa65-264bade177a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1e447b7be2499b8d392832aae8f81f', 'request_id': 'req-18907e55-615d-4390-aa65-264bade177a2'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:00.267159 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-18907e55-615d-4390-aa65-264bade177a2 admin admin] The token cache is being invalidate because project ff1e447b7be2499b8d392832aae8f81f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:35:00.267525 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-18907e55-615d-4390-aa65-264bade177a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:00.268364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-18907e55-615d-4390-aa65-264bade177a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:00.270003 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 987/1974] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:35:00 2022] DELETE /identity/v3/projects/ff1e447b7be2499b8d392832aae8f81f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:35:00.374621 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289e11c-88df-4f45-9eea-5570daae12aa None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:00.375237 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289e11c-88df-4f45-9eea-5570daae12aa None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:00.375237 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289e11c-88df-4f45-9eea-5570daae12aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:00.397768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-8289e11c-88df-4f45-9eea-5570daae12aa None None] MFA Rules not processed for user `34ba60c6edb94c27bbd01819da05acd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:00.399614 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-8289e11c-88df-4f45-9eea-5570daae12aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:00.476481 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 988/1975] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:35:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:01.128929 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18907e55-615d-4390-aa65-264bade177a2 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:01.130446 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-18907e55-615d-4390-aa65-264bade177a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:01.197283 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18907e55-615d-4390-aa65-264bade177a2 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:01.202481 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652d616-0bf6-4f20-9328-a0cda8943613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:01.203137 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652d616-0bf6-4f20-9328-a0cda8943613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:01.203416 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652d616-0bf6-4f20-9328-a0cda8943613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:01.203690 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652d616-0bf6-4f20-9328-a0cda8943613 admin admin] PATH_INFO: `/v3/users/7381f13c2dbf47d9a7c5bc4cbf582d18` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:01.204838 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652d616-0bf6-4f20-9328-a0cda8943613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7381f13c2dbf47d9a7c5bc4cbf582d18)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:01.206782 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652d616-0bf6-4f20-9328-a0cda8943613 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:01.434301 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-d652d616-0bf6-4f20-9328-a0cda8943613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7381f13c2dbf47d9a7c5bc4cbf582d18'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:01.435242 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-d652d616-0bf6-4f20-9328-a0cda8943613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7381f13c2dbf47d9a7c5bc4cbf582d18'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:01.532160 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-d652d616-0bf6-4f20-9328-a0cda8943613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7381f13c2dbf47d9a7c5bc4cbf582d18'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:01.534903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:01.541059 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-d652d616-0bf6-4f20-9328-a0cda8943613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7381f13c2dbf47d9a7c5bc4cbf582d18'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:01.541885 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-d652d616-0bf6-4f20-9328-a0cda8943613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7381f13c2dbf47d9a7c5bc4cbf582d18'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:01.560869 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 988/1976] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:35:01 2022] DELETE /identity/v3/users/7381f13c2dbf47d9a7c5bc4cbf582d18 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:35:01.566752 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3c205-80ee-48f2-83b5-e3cf87da59e9 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:01.567274 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3c205-80ee-48f2-83b5-e3cf87da59e9 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:01.567364 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3c205-80ee-48f2-83b5-e3cf87da59e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:01.588345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-0af3c205-80ee-48f2-83b5-e3cf87da59e9 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:01.589864 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-0af3c205-80ee-48f2-83b5-e3cf87da59e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:01.660408 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 989/1977] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:01.683901 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652d616-0bf6-4f20-9328-a0cda8943613 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:01.683901 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-d652d616-0bf6-4f20-9328-a0cda8943613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:01.758016 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652d616-0bf6-4f20-9328-a0cda8943613 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:01.762480 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe223d3-23f4-4e35-8d33-54bb259dcf77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:01.763128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe223d3-23f4-4e35-8d33-54bb259dcf77 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:01.763409 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe223d3-23f4-4e35-8d33-54bb259dcf77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:01.763689 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe223d3-23f4-4e35-8d33-54bb259dcf77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:01.773454 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe223d3-23f4-4e35-8d33-54bb259dcf77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:01.777418 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe223d3-23f4-4e35-8d33-54bb259dcf77 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:01.786671 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 989/1978] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:35:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:35:02.271554 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3c205-80ee-48f2-83b5-e3cf87da59e9 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:02.273329 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-0af3c205-80ee-48f2-83b5-e3cf87da59e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:02.288451 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3c205-80ee-48f2-83b5-e3cf87da59e9 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:02.295696 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53192775-851e-438b-a511-a6b71ff90a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:02.296341 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53192775-851e-438b-a511-a6b71ff90a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:02.296617 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53192775-851e-438b-a511-a6b71ff90a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:02.296889 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53192775-851e-438b-a511-a6b71ff90a64 admin admin] PATH_INFO: `/v3/projects/a5c0747189164665a1c15ea4c339a2f2` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:02.298033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53192775-851e-438b-a511-a6b71ff90a64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5c0747189164665a1c15ea4c339a2f2)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:02.300018 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53192775-851e-438b-a511-a6b71ff90a64 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:02.408312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-53192775-851e-438b-a511-a6b71ff90a64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5c0747189164665a1c15ea4c339a2f2', 'request_id': 'req-53192775-851e-438b-a511-a6b71ff90a64'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:02.413871 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-53192775-851e-438b-a511-a6b71ff90a64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5c0747189164665a1c15ea4c339a2f2', 'request_id': 'req-53192775-851e-438b-a511-a6b71ff90a64'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:02.513493 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-53192775-851e-438b-a511-a6b71ff90a64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5c0747189164665a1c15ea4c339a2f2', 'request_id': 'req-53192775-851e-438b-a511-a6b71ff90a64'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:02.526279 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-53192775-851e-438b-a511-a6b71ff90a64 admin admin] The token cache is being invalidate because project a5c0747189164665a1c15ea4c339a2f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:35:02.526569 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-53192775-851e-438b-a511-a6b71ff90a64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:02.527301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-53192775-851e-438b-a511-a6b71ff90a64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:02.528773 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 990/1979] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:35:02 2022] DELETE /identity/v3/projects/a5c0747189164665a1c15ea4c339a2f2 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:35:02.532700 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe223d3-23f4-4e35-8d33-54bb259dcf77 service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:02.543571 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe223d3-23f4-4e35-8d33-54bb259dcf77 service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:02.603945 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe913e2-1fc8-42cb-b4ac-35f1d04244bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:02.605326 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe913e2-1fc8-42cb-b4ac-35f1d04244bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:02.605687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe913e2-1fc8-42cb-b4ac-35f1d04244bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:02.605956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe913e2-1fc8-42cb-b4ac-35f1d04244bd admin admin] PATH_INFO: `/v3/users/d875baabe6fb4c5c93f088b447b8671a` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:02.607377 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe913e2-1fc8-42cb-b4ac-35f1d04244bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d875baabe6fb4c5c93f088b447b8671a)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:02.609392 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe913e2-1fc8-42cb-b4ac-35f1d04244bd admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:03.089519 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-9fe913e2-1fc8-42cb-b4ac-35f1d04244bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd875baabe6fb4c5c93f088b447b8671a'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:03.090183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-9fe913e2-1fc8-42cb-b4ac-35f1d04244bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd875baabe6fb4c5c93f088b447b8671a'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:03.190425 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f323fd8-b5eb-4757-90a5-f3538d0adf25 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:03.190891 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f323fd8-b5eb-4757-90a5-f3538d0adf25 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:03.191039 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f323fd8-b5eb-4757-90a5-f3538d0adf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:03.212393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-9fe913e2-1fc8-42cb-b4ac-35f1d04244bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd875baabe6fb4c5c93f088b447b8671a'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:03.221219 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-2f323fd8-b5eb-4757-90a5-f3538d0adf25 None None] MFA Rules not processed for user `e58cdf090af44b508767e821be2f379f`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:03.222523 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-2f323fd8-b5eb-4757-90a5-f3538d0adf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:03.223729 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-9fe913e2-1fc8-42cb-b4ac-35f1d04244bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd875baabe6fb4c5c93f088b447b8671a'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:03.228783 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-9fe913e2-1fc8-42cb-b4ac-35f1d04244bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd875baabe6fb4c5c93f088b447b8671a'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:03.229013 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:03.254232 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:03.263092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 990/1980] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:35:02 2022] DELETE /identity/v3/users/d875baabe6fb4c5c93f088b447b8671a => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:35:03.284421 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 991/1981] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 02:35:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:35:03.329807 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe913e2-1fc8-42cb-b4ac-35f1d04244bd admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:03.331354 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-9fe913e2-1fc8-42cb-b4ac-35f1d04244bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:03.402344 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe913e2-1fc8-42cb-b4ac-35f1d04244bd admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:03.407342 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a913d-99bd-4169-be48-a999e649b3cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906e9835f5c4e709915c6553b41aeff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:03.407976 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a913d-99bd-4169-be48-a999e649b3cf service swift] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:03.408252 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a913d-99bd-4169-be48-a999e649b3cf service swift] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:03.408522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a913d-99bd-4169-be48-a999e649b3cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:03.470672 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a913d-99bd-4169-be48-a999e649b3cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:03.472424 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a913d-99bd-4169-be48-a999e649b3cf service swift] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:03.482518 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 991/1982] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 02:35:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 02:35:03.780127 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f323fd8-b5eb-4757-90a5-f3538d0adf25 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:03.781842 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-2f323fd8-b5eb-4757-90a5-f3538d0adf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:03.801964 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f323fd8-b5eb-4757-90a5-f3538d0adf25 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:03.862281 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112c5d2-76a7-49e0-917f-84a32d6dcf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:03.862944 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112c5d2-76a7-49e0-917f-84a32d6dcf50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:03.863221 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112c5d2-76a7-49e0-917f-84a32d6dcf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:03.863495 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112c5d2-76a7-49e0-917f-84a32d6dcf50 admin admin] PATH_INFO: `/v3/projects/4f2bd3db3ae946908520c50ab4b992dd` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:03.864656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112c5d2-76a7-49e0-917f-84a32d6dcf50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f2bd3db3ae946908520c50ab4b992dd)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:03.866556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112c5d2-76a7-49e0-917f-84a32d6dcf50 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:03.999926 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a112c5d2-76a7-49e0-917f-84a32d6dcf50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f2bd3db3ae946908520c50ab4b992dd', 'request_id': 'req-a112c5d2-76a7-49e0-917f-84a32d6dcf50'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:04.005550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a112c5d2-76a7-49e0-917f-84a32d6dcf50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f2bd3db3ae946908520c50ab4b992dd', 'request_id': 'req-a112c5d2-76a7-49e0-917f-84a32d6dcf50'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:04.092358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a112c5d2-76a7-49e0-917f-84a32d6dcf50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f2bd3db3ae946908520c50ab4b992dd', 'request_id': 'req-a112c5d2-76a7-49e0-917f-84a32d6dcf50'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:04.111623 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a112c5d2-76a7-49e0-917f-84a32d6dcf50 admin admin] The token cache is being invalidate because project 4f2bd3db3ae946908520c50ab4b992dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:35:04.114671 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a112c5d2-76a7-49e0-917f-84a32d6dcf50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:04.115508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a112c5d2-76a7-49e0-917f-84a32d6dcf50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:04.117116 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 992/1983] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:35:03 2022] DELETE /identity/v3/projects/4f2bd3db3ae946908520c50ab4b992dd => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:35:04.121671 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a913d-99bd-4169-be48-a999e649b3cf service swift] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:04.137766 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a913d-99bd-4169-be48-a999e649b3cf service swift] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:04.233166 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f623d-1849-4dc3-83e6-24c71b3cb6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:04.233865 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f623d-1849-4dc3-83e6-24c71b3cb6b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:04.234654 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f623d-1849-4dc3-83e6-24c71b3cb6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:04.234654 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f623d-1849-4dc3-83e6-24c71b3cb6b0 admin admin] PATH_INFO: `/v3/users/62dc2a73e9cd4d558a064708520ca015` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:04.235751 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f623d-1849-4dc3-83e6-24c71b3cb6b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62dc2a73e9cd4d558a064708520ca015)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:04.237667 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f623d-1849-4dc3-83e6-24c71b3cb6b0 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:04.435193 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:04.441695 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-8c5f623d-1849-4dc3-83e6-24c71b3cb6b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62dc2a73e9cd4d558a064708520ca015'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:04.442450 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-8c5f623d-1849-4dc3-83e6-24c71b3cb6b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62dc2a73e9cd4d558a064708520ca015'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:04.561488 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-8c5f623d-1849-4dc3-83e6-24c71b3cb6b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62dc2a73e9cd4d558a064708520ca015'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:04.571371 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-8c5f623d-1849-4dc3-83e6-24c71b3cb6b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62dc2a73e9cd4d558a064708520ca015'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:04.572305 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-8c5f623d-1849-4dc3-83e6-24c71b3cb6b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62dc2a73e9cd4d558a064708520ca015'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:04.593785 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 992/1984] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:35:04 2022] DELETE /identity/v3/users/62dc2a73e9cd4d558a064708520ca015 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:35:04.631957 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf0885-9f98-4bc3-9857-789ae8d62091 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:04.632474 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf0885-9f98-4bc3-9857-789ae8d62091 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:04.632566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf0885-9f98-4bc3-9857-789ae8d62091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:04.656858 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-45bf0885-9f98-4bc3-9857-789ae8d62091 None None] MFA Rules not processed for user `e58cdf090af44b508767e821be2f379f`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:04.658972 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-45bf0885-9f98-4bc3-9857-789ae8d62091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:04.716045 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:04.734079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 993/1985] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 19 02:35:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:04.750586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f623d-1849-4dc3-83e6-24c71b3cb6b0 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:04.752706 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-8c5f623d-1849-4dc3-83e6-24c71b3cb6b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:04.825673 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f623d-1849-4dc3-83e6-24c71b3cb6b0 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:04.830754 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1108559-e47f-4660-9093-bb741e7ace6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906e9835f5c4e709915c6553b41aeff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:04.831399 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1108559-e47f-4660-9093-bb741e7ace6b service swift] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:04.831680 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1108559-e47f-4660-9093-bb741e7ace6b service swift] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:04.831954 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1108559-e47f-4660-9093-bb741e7ace6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:04.840910 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1108559-e47f-4660-9093-bb741e7ace6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:04.842523 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1108559-e47f-4660-9093-bb741e7ace6b service swift] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:04.851482 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 993/1986] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 02:35:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:35:05.155132 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf0885-9f98-4bc3-9857-789ae8d62091 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:05.161626 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-45bf0885-9f98-4bc3-9857-789ae8d62091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:05.280638 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf0885-9f98-4bc3-9857-789ae8d62091 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:05.285515 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d6dee-97dd-413a-b3d1-f162fe9cbaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:05.286162 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d6dee-97dd-413a-b3d1-f162fe9cbaf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:05.286439 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d6dee-97dd-413a-b3d1-f162fe9cbaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:05.288570 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d6dee-97dd-413a-b3d1-f162fe9cbaf4 admin admin] PATH_INFO: `/v3/projects/b776b0bb902b46b59b51175d541b1640` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:05.288570 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d6dee-97dd-413a-b3d1-f162fe9cbaf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b776b0bb902b46b59b51175d541b1640)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:05.289981 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d6dee-97dd-413a-b3d1-f162fe9cbaf4 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:05.430519 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-9a3d6dee-97dd-413a-b3d1-f162fe9cbaf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b776b0bb902b46b59b51175d541b1640', 'request_id': 'req-9a3d6dee-97dd-413a-b3d1-f162fe9cbaf4'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:05.437993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-9a3d6dee-97dd-413a-b3d1-f162fe9cbaf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b776b0bb902b46b59b51175d541b1640', 'request_id': 'req-9a3d6dee-97dd-413a-b3d1-f162fe9cbaf4'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:05.561159 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-9a3d6dee-97dd-413a-b3d1-f162fe9cbaf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b776b0bb902b46b59b51175d541b1640', 'request_id': 'req-9a3d6dee-97dd-413a-b3d1-f162fe9cbaf4'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:05.573831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-9a3d6dee-97dd-413a-b3d1-f162fe9cbaf4 admin admin] The token cache is being invalidate because project b776b0bb902b46b59b51175d541b1640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:35:05.574114 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-9a3d6dee-97dd-413a-b3d1-f162fe9cbaf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:05.574889 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-9a3d6dee-97dd-413a-b3d1-f162fe9cbaf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:05.576464 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 994/1987] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:35:05 2022] DELETE /identity/v3/projects/b776b0bb902b46b59b51175d541b1640 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:35:05.581258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33963d-7aef-4b41-9fe9-e100b8dced75 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:05.582069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33963d-7aef-4b41-9fe9-e100b8dced75 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:05.582343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33963d-7aef-4b41-9fe9-e100b8dced75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:05.603257 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-fc33963d-7aef-4b41-9fe9-e100b8dced75 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:05.605271 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-fc33963d-7aef-4b41-9fe9-e100b8dced75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:05.682217 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 994/1988] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:35:05.693221 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d391d-60d6-44a2-a0f5-65adef834e7a None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:05.693741 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d391d-60d6-44a2-a0f5-65adef834e7a None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:05.694005 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d391d-60d6-44a2-a0f5-65adef834e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:05.716036 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-294d391d-60d6-44a2-a0f5-65adef834e7a None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:05.717278 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-294d391d-60d6-44a2-a0f5-65adef834e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:05.725159 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 995/1989] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:35:05.730164 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33963d-7aef-4b41-9fe9-e100b8dced75 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:05.740172 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33963d-7aef-4b41-9fe9-e100b8dced75 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:05.744920 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00344e3f-57f1-4eec-8540-3ee8e6a1cd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:05.745770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00344e3f-57f1-4eec-8540-3ee8e6a1cd41 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:05.746051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00344e3f-57f1-4eec-8540-3ee8e6a1cd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:05.746318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00344e3f-57f1-4eec-8540-3ee8e6a1cd41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:05.746985 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00344e3f-57f1-4eec-8540-3ee8e6a1cd41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:35:05.747286 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00344e3f-57f1-4eec-8540-3ee8e6a1cd41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:05.748876 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00344e3f-57f1-4eec-8540-3ee8e6a1cd41 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:05.761138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 995/1990] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:35:05.766207 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d391d-60d6-44a2-a0f5-65adef834e7a None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:05.775562 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d391d-60d6-44a2-a0f5-65adef834e7a None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:05.781953 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90362126-0247-422d-8ebb-6a4f319d4b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:05.782619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90362126-0247-422d-8ebb-6a4f319d4b25 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:05.782940 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90362126-0247-422d-8ebb-6a4f319d4b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:05.783216 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90362126-0247-422d-8ebb-6a4f319d4b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:05.784705 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90362126-0247-422d-8ebb-6a4f319d4b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:05.786474 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c94029-6f98-4224-9c13-a9469b8d9d05 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:05.786684 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90362126-0247-422d-8ebb-6a4f319d4b25 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:05.786865 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c94029-6f98-4224-9c13-a9469b8d9d05 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:05.787199 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c94029-6f98-4224-9c13-a9469b8d9d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:05.806942 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-61c94029-6f98-4224-9c13-a9469b8d9d05 None None] MFA Rules not processed for user `e58cdf090af44b508767e821be2f379f`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:05.808238 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-61c94029-6f98-4224-9c13-a9469b8d9d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:05.841206 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:05.867755 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 996/1991] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 02:35:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:35:05.884617 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c94029-6f98-4224-9c13-a9469b8d9d05 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:05.884617 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-61c94029-6f98-4224-9c13-a9469b8d9d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:05.919012 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 996/1992] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:35:05 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:35:05.923423 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90362126-0247-422d-8ebb-6a4f319d4b25 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:05.960095 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c94029-6f98-4224-9c13-a9469b8d9d05 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:05.985765 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:06.001646 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90362126-0247-422d-8ebb-6a4f319d4b25 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:06.009719 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292b07b-ed91-4421-aa2c-ba33b03a0105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:06.011264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292b07b-ed91-4421-aa2c-ba33b03a0105 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:06.011354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292b07b-ed91-4421-aa2c-ba33b03a0105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:06.011962 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292b07b-ed91-4421-aa2c-ba33b03a0105 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:06.013064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292b07b-ed91-4421-aa2c-ba33b03a0105 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:06.015223 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292b07b-ed91-4421-aa2c-ba33b03a0105 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:06.048371 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a36596-998b-45ba-9991-0d9374c32b1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906e9835f5c4e709915c6553b41aeff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:06.048996 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a36596-998b-45ba-9991-0d9374c32b1a service swift] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:06.049406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a36596-998b-45ba-9991-0d9374c32b1a service swift] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:06.049676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a36596-998b-45ba-9991-0d9374c32b1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:06.109056 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a36596-998b-45ba-9991-0d9374c32b1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:06.112601 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 997/1993] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:35:05 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:35:06.112774 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a36596-998b-45ba-9991-0d9374c32b1a service swift] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:06.113936 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292b07b-ed91-4421-aa2c-ba33b03a0105 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:06.120692 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 997/1994] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 02:35:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 02:35:06.125879 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292b07b-ed91-4421-aa2c-ba33b03a0105 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:06.131320 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27384da7-7260-47d6-950a-1bda1e618090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:06.131931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27384da7-7260-47d6-950a-1bda1e618090 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:06.132205 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27384da7-7260-47d6-950a-1bda1e618090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:06.132474 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27384da7-7260-47d6-950a-1bda1e618090 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:06.133123 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27384da7-7260-47d6-950a-1bda1e618090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:06.134955 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27384da7-7260-47d6-950a-1bda1e618090 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:06.146566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 998/1995] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:35:06.150550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a36596-998b-45ba-9991-0d9374c32b1a service swift] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:06.161372 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a36596-998b-45ba-9991-0d9374c32b1a service swift] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:06.166477 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612c1af-1f58-4d13-a0e3-9ca455dbbe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:06.174136 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612c1af-1f58-4d13-a0e3-9ca455dbbe39 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:06.174136 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612c1af-1f58-4d13-a0e3-9ca455dbbe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:06.174136 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612c1af-1f58-4d13-a0e3-9ca455dbbe39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:06.174136 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612c1af-1f58-4d13-a0e3-9ca455dbbe39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:06.174136 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612c1af-1f58-4d13-a0e3-9ca455dbbe39 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:06.180290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 998/1996] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:35:06.184871 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27384da7-7260-47d6-950a-1bda1e618090 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:06.195595 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27384da7-7260-47d6-950a-1bda1e618090 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:06.201780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac70ab-4881-485c-b07a-c362e1613ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:06.202528 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac70ab-4881-485c-b07a-c362e1613ce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:06.202916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac70ab-4881-485c-b07a-c362e1613ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:06.203204 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac70ab-4881-485c-b07a-c362e1613ce8 admin admin] PATH_INFO: `/v3/projects/46bbec1795544eaab2a935865e1d2ee0/users/8f0520677bda41e78c362f149c8fb713/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:06.220750 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac70ab-4881-485c-b07a-c362e1613ce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46bbec1795544eaab2a935865e1d2ee0, user_id=8f0520677bda41e78c362f149c8fb713, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:06.223511 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac70ab-4881-485c-b07a-c362e1613ce8 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:06.337818 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 999/1997] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:35:06 2022] PUT /identity/v3/projects/46bbec1795544eaab2a935865e1d2ee0/users/8f0520677bda41e78c362f149c8fb713/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:35:06.351295 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c0629-2171-4842-ad38-bb4d6009b65f None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:06.351572 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c0629-2171-4842-ad38-bb4d6009b65f None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:06.351910 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c0629-2171-4842-ad38-bb4d6009b65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:06.394028 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-573c0629-2171-4842-ad38-bb4d6009b65f None None] MFA Rules not processed for user `8f0520677bda41e78c362f149c8fb713`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:06.395265 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-573c0629-2171-4842-ad38-bb4d6009b65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:06.491805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 999/1998] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:35:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:06.503527 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac70ab-4881-485c-b07a-c362e1613ce8 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:06.505309 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-cdac70ab-4881-485c-b07a-c362e1613ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:06.571316 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac70ab-4881-485c-b07a-c362e1613ce8 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:06.576310 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9b048-9351-4b87-8851-79f2c65d00d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:06.583193 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9b048-9351-4b87-8851-79f2c65d00d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:06.583193 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9b048-9351-4b87-8851-79f2c65d00d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:06.583193 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9b048-9351-4b87-8851-79f2c65d00d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:06.586370 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9b048-9351-4b87-8851-79f2c65d00d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:06.587852 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9b048-9351-4b87-8851-79f2c65d00d5 service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:06.599247 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1000/1999] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:35:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:35:06.804875 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc17fa6-42ed-4c40-ade8-60381e79f56b None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:06.805380 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc17fa6-42ed-4c40-ade8-60381e79f56b None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:06.809808 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc17fa6-42ed-4c40-ade8-60381e79f56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:06.827630 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-fcc17fa6-42ed-4c40-ade8-60381e79f56b None None] MFA Rules not processed for user `e58cdf090af44b508767e821be2f379f`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:06.828969 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-fcc17fa6-42ed-4c40-ade8-60381e79f56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:06.890418 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1000/2000] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 19 02:35:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:06.893495 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:06.905636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9b048-9351-4b87-8851-79f2c65d00d5 service cinder] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:06.977611 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9b048-9351-4b87-8851-79f2c65d00d5 service cinder] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:06.983192 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cd90d-5a70-47dd-96bd-fa1f6c0885b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906e9835f5c4e709915c6553b41aeff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:06.988816 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cd90d-5a70-47dd-96bd-fa1f6c0885b4 service swift] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:06.988816 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cd90d-5a70-47dd-96bd-fa1f6c0885b4 service swift] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:06.988816 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cd90d-5a70-47dd-96bd-fa1f6c0885b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:06.992801 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433cd90d-5a70-47dd-96bd-fa1f6c0885b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:06.994615 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433cd90d-5a70-47dd-96bd-fa1f6c0885b4 service swift] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:07.003555 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1001/2001] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 02:35:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:35:09.900644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc17fa6-42ed-4c40-ade8-60381e79f56b None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:09.902107 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-fcc17fa6-42ed-4c40-ade8-60381e79f56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:09.973768 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc17fa6-42ed-4c40-ade8-60381e79f56b None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:09.978476 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869edfbc-e0bf-453b-b0bd-9a54ba27ec33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:09.979144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869edfbc-e0bf-453b-b0bd-9a54ba27ec33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:09.980066 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869edfbc-e0bf-453b-b0bd-9a54ba27ec33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:09.980416 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869edfbc-e0bf-453b-b0bd-9a54ba27ec33 admin admin] PATH_INFO: `/v3/users/0361e12d9a2d4becb92d5fb5512d787b` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:09.981507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869edfbc-e0bf-453b-b0bd-9a54ba27ec33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0361e12d9a2d4becb92d5fb5512d787b)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:09.983470 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869edfbc-e0bf-453b-b0bd-9a54ba27ec33 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:10.180567 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-869edfbc-e0bf-453b-b0bd-9a54ba27ec33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0361e12d9a2d4becb92d5fb5512d787b'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:10.181272 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-869edfbc-e0bf-453b-b0bd-9a54ba27ec33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0361e12d9a2d4becb92d5fb5512d787b'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:10.183872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:10.280723 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-869edfbc-e0bf-453b-b0bd-9a54ba27ec33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0361e12d9a2d4becb92d5fb5512d787b'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:10.288128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-869edfbc-e0bf-453b-b0bd-9a54ba27ec33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0361e12d9a2d4becb92d5fb5512d787b'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:10.288759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-869edfbc-e0bf-453b-b0bd-9a54ba27ec33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0361e12d9a2d4becb92d5fb5512d787b'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:10.306099 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1001/2002] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:35:09 2022] DELETE /identity/v3/users/0361e12d9a2d4becb92d5fb5512d787b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:35:10.311382 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e87530-28ae-4590-9fa2-464a0f89cc06 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:10.311982 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e87530-28ae-4590-9fa2-464a0f89cc06 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:10.311982 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e87530-28ae-4590-9fa2-464a0f89cc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:10.331340 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-03e87530-28ae-4590-9fa2-464a0f89cc06 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:10.332574 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-03e87530-28ae-4590-9fa2-464a0f89cc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:10.367951 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:10.393716 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1002/2003] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:10.404053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869edfbc-e0bf-453b-b0bd-9a54ba27ec33 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:10.405466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-869edfbc-e0bf-453b-b0bd-9a54ba27ec33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:10.466211 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869edfbc-e0bf-453b-b0bd-9a54ba27ec33 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:10.469995 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c58b69-9e92-4c13-9874-920a26532a0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:10.470605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c58b69-9e92-4c13-9874-920a26532a0e service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:10.470913 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c58b69-9e92-4c13-9874-920a26532a0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:10.471187 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c58b69-9e92-4c13-9874-920a26532a0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:10.481307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c58b69-9e92-4c13-9874-920a26532a0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:10.482783 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c58b69-9e92-4c13-9874-920a26532a0e service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:10.493249 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1002/2004] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:35:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:35:10.772580 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e87530-28ae-4590-9fa2-464a0f89cc06 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:10.773988 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-03e87530-28ae-4590-9fa2-464a0f89cc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:10.787321 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e87530-28ae-4590-9fa2-464a0f89cc06 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:10.793763 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657e543-45bd-4108-afae-2305e4b336c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:10.793763 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657e543-45bd-4108-afae-2305e4b336c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:10.794626 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657e543-45bd-4108-afae-2305e4b336c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:10.794982 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657e543-45bd-4108-afae-2305e4b336c7 admin admin] PATH_INFO: `/v3/projects/1a654d620971454d84f761df29c4be3a` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:10.796126 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657e543-45bd-4108-afae-2305e4b336c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a654d620971454d84f761df29c4be3a)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:10.798492 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657e543-45bd-4108-afae-2305e4b336c7 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:10.922112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a657e543-45bd-4108-afae-2305e4b336c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a654d620971454d84f761df29c4be3a', 'request_id': 'req-a657e543-45bd-4108-afae-2305e4b336c7'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:10.927604 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a657e543-45bd-4108-afae-2305e4b336c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a654d620971454d84f761df29c4be3a', 'request_id': 'req-a657e543-45bd-4108-afae-2305e4b336c7'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:11.010409 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a657e543-45bd-4108-afae-2305e4b336c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a654d620971454d84f761df29c4be3a', 'request_id': 'req-a657e543-45bd-4108-afae-2305e4b336c7'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:11.022889 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a657e543-45bd-4108-afae-2305e4b336c7 admin admin] The token cache is being invalidate because project 1a654d620971454d84f761df29c4be3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:35:11.023184 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a657e543-45bd-4108-afae-2305e4b336c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:11.023832 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a657e543-45bd-4108-afae-2305e4b336c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:11.024117 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c58b69-9e92-4c13-9874-920a26532a0e service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:11.025324 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1003/2005] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:35:10 2022] DELETE /identity/v3/projects/1a654d620971454d84f761df29c4be3a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:35:11.031089 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-70c58b69-9e92-4c13-9874-920a26532a0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:11.044817 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c58b69-9e92-4c13-9874-920a26532a0e service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:11.109385 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddac0c-5e86-4dc0-af62-861ebfec080b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:11.110047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddac0c-5e86-4dc0-af62-861ebfec080b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:11.110325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddac0c-5e86-4dc0-af62-861ebfec080b admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:11.110598 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddac0c-5e86-4dc0-af62-861ebfec080b admin admin] PATH_INFO: `/v3/users/8f0520677bda41e78c362f149c8fb713` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:11.111817 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddac0c-5e86-4dc0-af62-861ebfec080b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0520677bda41e78c362f149c8fb713)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:11.113774 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddac0c-5e86-4dc0-af62-861ebfec080b admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:11.356843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-26ddac0c-5e86-4dc0-af62-861ebfec080b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0520677bda41e78c362f149c8fb713'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:11.357515 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-26ddac0c-5e86-4dc0-af62-861ebfec080b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0520677bda41e78c362f149c8fb713'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:11.464591 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-26ddac0c-5e86-4dc0-af62-861ebfec080b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0520677bda41e78c362f149c8fb713'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:11.472058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-26ddac0c-5e86-4dc0-af62-861ebfec080b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0520677bda41e78c362f149c8fb713'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:11.472690 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-26ddac0c-5e86-4dc0-af62-861ebfec080b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0520677bda41e78c362f149c8fb713'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:11.477883 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:11.490939 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1003/2006] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:35:11 2022] DELETE /identity/v3/users/8f0520677bda41e78c362f149c8fb713 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:35:11.496841 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d06c9-017c-4ff2-8404-df099438a3a3 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:11.497306 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d06c9-017c-4ff2-8404-df099438a3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:11.497399 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d06c9-017c-4ff2-8404-df099438a3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:11.516189 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-6c9d06c9-017c-4ff2-8404-df099438a3a3 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:11.517379 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-6c9d06c9-017c-4ff2-8404-df099438a3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:11.579199 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1004/2007] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:11.588553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddac0c-5e86-4dc0-af62-861ebfec080b admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:11.592498 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-26ddac0c-5e86-4dc0-af62-861ebfec080b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:11.649316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddac0c-5e86-4dc0-af62-861ebfec080b admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:11.653773 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab99ed-7d7b-46de-b24e-7d24e3a6112c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:11.654393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab99ed-7d7b-46de-b24e-7d24e3a6112c service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:11.654654 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab99ed-7d7b-46de-b24e-7d24e3a6112c service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:11.654978 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab99ed-7d7b-46de-b24e-7d24e3a6112c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:11.663992 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab99ed-7d7b-46de-b24e-7d24e3a6112c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:11.665409 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab99ed-7d7b-46de-b24e-7d24e3a6112c service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:11.675038 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1004/2008] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:35:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:35:12.178374 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d06c9-017c-4ff2-8404-df099438a3a3 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:12.179926 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-6c9d06c9-017c-4ff2-8404-df099438a3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:12.193109 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d06c9-017c-4ff2-8404-df099438a3a3 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:12.198013 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8aad89-1bf0-4f95-af4c-a9b7979f213b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:12.199281 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8aad89-1bf0-4f95-af4c-a9b7979f213b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:12.199562 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8aad89-1bf0-4f95-af4c-a9b7979f213b admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:12.199835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8aad89-1bf0-4f95-af4c-a9b7979f213b admin admin] PATH_INFO: `/v3/projects/46bbec1795544eaab2a935865e1d2ee0` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:12.200974 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8aad89-1bf0-4f95-af4c-a9b7979f213b admin admin] RBAC: Authorizing `identity:delete_project(project_id=46bbec1795544eaab2a935865e1d2ee0)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:12.202990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8aad89-1bf0-4f95-af4c-a9b7979f213b admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:12.314516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-8b8aad89-1bf0-4f95-af4c-a9b7979f213b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46bbec1795544eaab2a935865e1d2ee0', 'request_id': 'req-8b8aad89-1bf0-4f95-af4c-a9b7979f213b'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:12.319223 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:12.320431 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-8b8aad89-1bf0-4f95-af4c-a9b7979f213b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46bbec1795544eaab2a935865e1d2ee0', 'request_id': 'req-8b8aad89-1bf0-4f95-af4c-a9b7979f213b'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:12.447157 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-8b8aad89-1bf0-4f95-af4c-a9b7979f213b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46bbec1795544eaab2a935865e1d2ee0', 'request_id': 'req-8b8aad89-1bf0-4f95-af4c-a9b7979f213b'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:12.459630 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-8b8aad89-1bf0-4f95-af4c-a9b7979f213b admin admin] The token cache is being invalidate because project 46bbec1795544eaab2a935865e1d2ee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:35:12.459920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-8b8aad89-1bf0-4f95-af4c-a9b7979f213b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:12.460561 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-8b8aad89-1bf0-4f95-af4c-a9b7979f213b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:12.462079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1005/2009] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:35:12 2022] DELETE /identity/v3/projects/46bbec1795544eaab2a935865e1d2ee0 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:35:12.467217 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505b191-a36e-4542-9064-cabaf3083411 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:12.467679 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505b191-a36e-4542-9064-cabaf3083411 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:12.467786 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505b191-a36e-4542-9064-cabaf3083411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:12.489804 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-d505b191-a36e-4542-9064-cabaf3083411 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:12.491033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-d505b191-a36e-4542-9064-cabaf3083411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:12.550683 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1005/2010] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:12.560197 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc78d26-a133-48c0-b03d-13024bd886e3 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:12.560723 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc78d26-a133-48c0-b03d-13024bd886e3 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:12.560723 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc78d26-a133-48c0-b03d-13024bd886e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:12.581396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-9dc78d26-a133-48c0-b03d-13024bd886e3 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:12.582638 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-9dc78d26-a133-48c0-b03d-13024bd886e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:12.591200 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1006/2011] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:12.595499 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505b191-a36e-4542-9064-cabaf3083411 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:12.606393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505b191-a36e-4542-9064-cabaf3083411 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:12.611213 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b6a8b-60db-4c47-a9bc-50574865cef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:12.611816 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b6a8b-60db-4c47-a9bc-50574865cef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:12.612090 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b6a8b-60db-4c47-a9bc-50574865cef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:12.612364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b6a8b-60db-4c47-a9bc-50574865cef9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:12.613003 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b6a8b-60db-4c47-a9bc-50574865cef9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:35:12.613303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b6a8b-60db-4c47-a9bc-50574865cef9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:12.614929 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b6a8b-60db-4c47-a9bc-50574865cef9 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:12.627753 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1006/2012] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:35:12.632064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc78d26-a133-48c0-b03d-13024bd886e3 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:12.641783 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc78d26-a133-48c0-b03d-13024bd886e3 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:12.646507 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4fd86-db29-4e5b-b23a-3462cb551535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:12.647131 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4fd86-db29-4e5b-b23a-3462cb551535 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:12.647411 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4fd86-db29-4e5b-b23a-3462cb551535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:12.647682 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4fd86-db29-4e5b-b23a-3462cb551535 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:12.648324 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4fd86-db29-4e5b-b23a-3462cb551535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:12.650254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4fd86-db29-4e5b-b23a-3462cb551535 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:12.776704 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1007/2013] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:35:12 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:35:12.779679 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b6a8b-60db-4c47-a9bc-50574865cef9 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:12.790010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b6a8b-60db-4c47-a9bc-50574865cef9 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:12.850702 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cec58-58ee-4f84-bab6-9464a52feada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:12.851349 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cec58-58ee-4f84-bab6-9464a52feada admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:12.851651 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cec58-58ee-4f84-bab6-9464a52feada admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:12.851923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cec58-58ee-4f84-bab6-9464a52feada admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:12.852562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133cec58-58ee-4f84-bab6-9464a52feada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:12.855318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133cec58-58ee-4f84-bab6-9464a52feada admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:13.002360 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1007/2014] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:35:12 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:35:13.003587 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4fd86-db29-4e5b-b23a-3462cb551535 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:13.014198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4fd86-db29-4e5b-b23a-3462cb551535 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:13.018766 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27835922-beab-430e-9512-084c1019911b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:13.019381 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27835922-beab-430e-9512-084c1019911b admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:13.019660 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27835922-beab-430e-9512-084c1019911b admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:13.019932 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27835922-beab-430e-9512-084c1019911b admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:13.020573 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27835922-beab-430e-9512-084c1019911b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:13.022142 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27835922-beab-430e-9512-084c1019911b admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:13.032964 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1008/2015] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:35:13.036765 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cec58-58ee-4f84-bab6-9464a52feada admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:13.046742 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cec58-58ee-4f84-bab6-9464a52feada admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:13.051424 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd2c06-0fb5-4e63-8352-a5f461b06077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:13.052013 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd2c06-0fb5-4e63-8352-a5f461b06077 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:13.052288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd2c06-0fb5-4e63-8352-a5f461b06077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:13.052559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd2c06-0fb5-4e63-8352-a5f461b06077 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:13.053198 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd2c06-0fb5-4e63-8352-a5f461b06077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:13.054777 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd2c06-0fb5-4e63-8352-a5f461b06077 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:13.056050 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:13.071557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1008/2016] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:35:13.076034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27835922-beab-430e-9512-084c1019911b admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:13.086277 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27835922-beab-430e-9512-084c1019911b admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:13.092141 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960b7c0-0c95-4653-be34-008436f683ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:13.092832 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960b7c0-0c95-4653-be34-008436f683ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:13.093148 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960b7c0-0c95-4653-be34-008436f683ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:13.093423 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960b7c0-0c95-4653-be34-008436f683ff admin admin] PATH_INFO: `/v3/projects/56d51e2bb8264c0d878a96ebd5ea8e21/users/05605d6d3ef4418d969c170c22af23a5/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:13.110354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960b7c0-0c95-4653-be34-008436f683ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d51e2bb8264c0d878a96ebd5ea8e21, user_id=05605d6d3ef4418d969c170c22af23a5, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:13.113161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960b7c0-0c95-4653-be34-008436f683ff admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:13.241393 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1009/2017] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:35:13 2022] PUT /identity/v3/projects/56d51e2bb8264c0d878a96ebd5ea8e21/users/05605d6d3ef4418d969c170c22af23a5/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:35:13.253723 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837827a-be0a-4486-a464-0c731a5e8301 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:13.253945 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837827a-be0a-4486-a464-0c731a5e8301 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:13.254219 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837827a-be0a-4486-a464-0c731a5e8301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:13.282766 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-e837827a-be0a-4486-a464-0c731a5e8301 None None] MFA Rules not processed for user `05605d6d3ef4418d969c170c22af23a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:13.284010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-e837827a-be0a-4486-a464-0c731a5e8301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:13.347871 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1009/2018] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:35:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:13.359367 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960b7c0-0c95-4653-be34-008436f683ff admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:13.361085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-e960b7c0-0c95-4653-be34-008436f683ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:13.419682 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960b7c0-0c95-4653-be34-008436f683ff admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:13.423445 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce227e7-9d2f-4cde-8d2c-7677ec42e2f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:13.424044 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce227e7-9d2f-4cde-8d2c-7677ec42e2f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:13.424347 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce227e7-9d2f-4cde-8d2c-7677ec42e2f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:13.424616 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce227e7-9d2f-4cde-8d2c-7677ec42e2f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:13.434395 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce227e7-9d2f-4cde-8d2c-7677ec42e2f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:13.435854 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce227e7-9d2f-4cde-8d2c-7677ec42e2f3 service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:13.445055 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1010/2019] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:35:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:35:13.471358 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837827a-be0a-4486-a464-0c731a5e8301 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:13.533363 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837827a-be0a-4486-a464-0c731a5e8301 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:13.537920 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750ec2c-8139-48bf-862d-aa52c546f93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:13.538547 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750ec2c-8139-48bf-862d-aa52c546f93a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:13.538845 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750ec2c-8139-48bf-862d-aa52c546f93a admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:13.539121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750ec2c-8139-48bf-862d-aa52c546f93a admin admin] PATH_INFO: `/v3/users/05605d6d3ef4418d969c170c22af23a5` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:13.540240 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750ec2c-8139-48bf-862d-aa52c546f93a admin admin] RBAC: Authorizing `identity:delete_user(user_id=05605d6d3ef4418d969c170c22af23a5)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:13.542490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750ec2c-8139-48bf-862d-aa52c546f93a admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:13.775242 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2750ec2c-8139-48bf-862d-aa52c546f93a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05605d6d3ef4418d969c170c22af23a5'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:13.775944 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2750ec2c-8139-48bf-862d-aa52c546f93a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05605d6d3ef4418d969c170c22af23a5'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:13.949388 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2750ec2c-8139-48bf-862d-aa52c546f93a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05605d6d3ef4418d969c170c22af23a5'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:13.961289 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2750ec2c-8139-48bf-862d-aa52c546f93a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05605d6d3ef4418d969c170c22af23a5'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:13.962677 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2750ec2c-8139-48bf-862d-aa52c546f93a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05605d6d3ef4418d969c170c22af23a5'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:13.997169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1010/2020] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:35:13 2022] DELETE /identity/v3/users/05605d6d3ef4418d969c170c22af23a5 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:35:14.001839 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a662a75-2f10-44a4-b890-69bec37fef49 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:14.002288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a662a75-2f10-44a4-b890-69bec37fef49 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:14.002508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a662a75-2f10-44a4-b890-69bec37fef49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:14.023219 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-7a662a75-2f10-44a4-b890-69bec37fef49 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:14.024431 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-7a662a75-2f10-44a4-b890-69bec37fef49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:14.088007 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1011/2021] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:14.098621 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750ec2c-8139-48bf-862d-aa52c546f93a admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:14.100058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-2750ec2c-8139-48bf-862d-aa52c546f93a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:14.107493 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:14.158535 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750ec2c-8139-48bf-862d-aa52c546f93a admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:14.162251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c67aac-d081-484b-8115-5f20fdd78546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:14.162882 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c67aac-d081-484b-8115-5f20fdd78546 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:14.163164 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c67aac-d081-484b-8115-5f20fdd78546 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:14.163433 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c67aac-d081-484b-8115-5f20fdd78546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:14.173018 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c67aac-d081-484b-8115-5f20fdd78546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:14.174438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c67aac-d081-484b-8115-5f20fdd78546 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:14.184456 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1011/2022] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:35:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:35:14.644022 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a662a75-2f10-44a4-b890-69bec37fef49 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:14.645579 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-7a662a75-2f10-44a4-b890-69bec37fef49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:14.664234 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a662a75-2f10-44a4-b890-69bec37fef49 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:14.666220 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad3890-03ee-4b37-93fa-c697f9392e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:14.667194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad3890-03ee-4b37-93fa-c697f9392e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:14.667558 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad3890-03ee-4b37-93fa-c697f9392e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:14.668010 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad3890-03ee-4b37-93fa-c697f9392e30 admin admin] PATH_INFO: `/v3/projects/56d51e2bb8264c0d878a96ebd5ea8e21` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:14.669186 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad3890-03ee-4b37-93fa-c697f9392e30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56d51e2bb8264c0d878a96ebd5ea8e21)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:14.671495 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad3890-03ee-4b37-93fa-c697f9392e30 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:14.694165 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:14.876350 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-98ad3890-03ee-4b37-93fa-c697f9392e30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56d51e2bb8264c0d878a96ebd5ea8e21', 'request_id': 'req-98ad3890-03ee-4b37-93fa-c697f9392e30'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:14.881645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-98ad3890-03ee-4b37-93fa-c697f9392e30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56d51e2bb8264c0d878a96ebd5ea8e21', 'request_id': 'req-98ad3890-03ee-4b37-93fa-c697f9392e30'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:14.989454 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-98ad3890-03ee-4b37-93fa-c697f9392e30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56d51e2bb8264c0d878a96ebd5ea8e21', 'request_id': 'req-98ad3890-03ee-4b37-93fa-c697f9392e30'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:15.001699 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-98ad3890-03ee-4b37-93fa-c697f9392e30 admin admin] The token cache is being invalidate because project 56d51e2bb8264c0d878a96ebd5ea8e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:35:15.001987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-98ad3890-03ee-4b37-93fa-c697f9392e30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:15.002612 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-98ad3890-03ee-4b37-93fa-c697f9392e30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:15.004134 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1012/2023] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:35:14 2022] DELETE /identity/v3/projects/56d51e2bb8264c0d878a96ebd5ea8e21 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:35:15.009039 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d76c3-3db3-44d1-9aa8-6ee8280f3e9b None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:15.009477 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d76c3-3db3-44d1-9aa8-6ee8280f3e9b None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:15.009629 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d76c3-3db3-44d1-9aa8-6ee8280f3e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:15.029733 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-cc6d76c3-3db3-44d1-9aa8-6ee8280f3e9b None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:15.030950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-cc6d76c3-3db3-44d1-9aa8-6ee8280f3e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:15.090694 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1012/2024] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:15.098506 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f0200-e814-4ce1-8d1f-b1d73d6688f1 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:15.098788 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f0200-e814-4ce1-8d1f-b1d73d6688f1 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:15.099091 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f0200-e814-4ce1-8d1f-b1d73d6688f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:15.119390 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-500f0200-e814-4ce1-8d1f-b1d73d6688f1 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:15.121166 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-500f0200-e814-4ce1-8d1f-b1d73d6688f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:15.129048 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1013/2025] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:15.133291 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d76c3-3db3-44d1-9aa8-6ee8280f3e9b None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:15.144304 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d76c3-3db3-44d1-9aa8-6ee8280f3e9b None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:15.148952 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b94c34-0611-4650-b273-928d0f6cf6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:15.149540 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b94c34-0611-4650-b273-928d0f6cf6ef admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:15.152375 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b94c34-0611-4650-b273-928d0f6cf6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:15.152375 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b94c34-0611-4650-b273-928d0f6cf6ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:15.152375 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b94c34-0611-4650-b273-928d0f6cf6ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:35:15.152375 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b94c34-0611-4650-b273-928d0f6cf6ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:15.153271 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b94c34-0611-4650-b273-928d0f6cf6ef admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:15.165097 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1013/2026] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:35:15.169385 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f0200-e814-4ce1-8d1f-b1d73d6688f1 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:15.178913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f0200-e814-4ce1-8d1f-b1d73d6688f1 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:15.184292 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a7f3c-bcee-4624-8153-b88a41fade60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:15.184896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a7f3c-bcee-4624-8153-b88a41fade60 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:15.185168 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a7f3c-bcee-4624-8153-b88a41fade60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:15.185439 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a7f3c-bcee-4624-8153-b88a41fade60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:15.186202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a7f3c-bcee-4624-8153-b88a41fade60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:15.188411 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a7f3c-bcee-4624-8153-b88a41fade60 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:15.298711 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1014/2027] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:35:15 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:35:15.303575 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b94c34-0611-4650-b273-928d0f6cf6ef admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:15.315071 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b94c34-0611-4650-b273-928d0f6cf6ef admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:15.372415 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49f410-5474-4455-b770-293216e1b4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:15.373042 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49f410-5474-4455-b770-293216e1b4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:15.373318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49f410-5474-4455-b770-293216e1b4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:15.373584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49f410-5474-4455-b770-293216e1b4a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:15.374309 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49f410-5474-4455-b770-293216e1b4a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:15.376259 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49f410-5474-4455-b770-293216e1b4a6 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:15.464248 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1014/2028] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:35:15 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:35:15.468218 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a7f3c-bcee-4624-8153-b88a41fade60 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:15.479154 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a7f3c-bcee-4624-8153-b88a41fade60 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:15.484582 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f854ce3-036b-4732-87bd-fc413654a93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:15.485275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f854ce3-036b-4732-87bd-fc413654a93c admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:15.485625 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f854ce3-036b-4732-87bd-fc413654a93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:15.485902 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f854ce3-036b-4732-87bd-fc413654a93c admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:15.486555 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f854ce3-036b-4732-87bd-fc413654a93c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:15.488193 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f854ce3-036b-4732-87bd-fc413654a93c admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:15.499686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1015/2029] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:35:15.512353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49f410-5474-4455-b770-293216e1b4a6 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:15.522854 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49f410-5474-4455-b770-293216e1b4a6 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:15.527652 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d5a63-accd-41a4-9822-e65404c23bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:15.528261 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d5a63-accd-41a4-9822-e65404c23bee admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:15.528536 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d5a63-accd-41a4-9822-e65404c23bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:15.528806 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d5a63-accd-41a4-9822-e65404c23bee admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:15.529450 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d5a63-accd-41a4-9822-e65404c23bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:15.531121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d5a63-accd-41a4-9822-e65404c23bee admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:15.544803 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1015/2030] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:35:15.552613 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f854ce3-036b-4732-87bd-fc413654a93c admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:15.564178 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f854ce3-036b-4732-87bd-fc413654a93c admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:15.569346 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b09904-c468-42bc-a284-f8ac77db593e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:15.570262 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b09904-c468-42bc-a284-f8ac77db593e admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:15.570845 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b09904-c468-42bc-a284-f8ac77db593e admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:15.571178 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b09904-c468-42bc-a284-f8ac77db593e admin admin] PATH_INFO: `/v3/projects/5d8bb704c20b4acaa4ec593839c9275a/users/e56c6e02cba541888589acd0732bfaa7/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:15.588160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b09904-c468-42bc-a284-f8ac77db593e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8bb704c20b4acaa4ec593839c9275a, user_id=e56c6e02cba541888589acd0732bfaa7, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:15.591519 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b09904-c468-42bc-a284-f8ac77db593e admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:15.767987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1016/2031] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:35:15 2022] PUT /identity/v3/projects/5d8bb704c20b4acaa4ec593839c9275a/users/e56c6e02cba541888589acd0732bfaa7/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:35:15.773133 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195e838-eb69-4954-8df1-8c361ec5ad54 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:15.773422 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195e838-eb69-4954-8df1-8c361ec5ad54 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:15.773695 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195e838-eb69-4954-8df1-8c361ec5ad54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:15.792978 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-6195e838-eb69-4954-8df1-8c361ec5ad54 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:15.794225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-6195e838-eb69-4954-8df1-8c361ec5ad54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:15.802584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:15.858984 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1016/2032] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:15.868577 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b09904-c468-42bc-a284-f8ac77db593e admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:15.870766 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-36b09904-c468-42bc-a284-f8ac77db593e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:15.933671 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b09904-c468-42bc-a284-f8ac77db593e admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:15.937600 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d5b5a-4d53-4973-ae25-5f3103097ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:15.938483 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d5b5a-4d53-4973-ae25-5f3103097ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:15.938763 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d5b5a-4d53-4973-ae25-5f3103097ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:15.939071 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d5b5a-4d53-4973-ae25-5f3103097ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:15.949378 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d5b5a-4d53-4973-ae25-5f3103097ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:15.950927 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d5b5a-4d53-4973-ae25-5f3103097ee2 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:15.960817 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1017/2033] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:35:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:35:18.964045 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acc1be-32a3-4bbf-bf6e-8e7859bf45db None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:18.964594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acc1be-32a3-4bbf-bf6e-8e7859bf45db None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:18.964594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acc1be-32a3-4bbf-bf6e-8e7859bf45db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:18.999305 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-68acc1be-32a3-4bbf-bf6e-8e7859bf45db None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:19.000828 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-68acc1be-32a3-4bbf-bf6e-8e7859bf45db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:19.009757 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1017/2034] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Oct 19 02:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:19.046019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d5b5a-4d53-4973-ae25-5f3103097ee2 service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:19.049626 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-d32d5b5a-4d53-4973-ae25-5f3103097ee2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:19.144408 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:19.192290 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d5b5a-4d53-4973-ae25-5f3103097ee2 service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:19.201189 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b179c-d853-48fb-b536-bc7ffad1cb0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:19.202289 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b179c-d853-48fb-b536-bc7ffad1cb0a service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:19.203259 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b179c-d853-48fb-b536-bc7ffad1cb0a service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:19.203631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b179c-d853-48fb-b536-bc7ffad1cb0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:19.218944 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b179c-d853-48fb-b536-bc7ffad1cb0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:19.220661 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b179c-d853-48fb-b536-bc7ffad1cb0a service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:19.257231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1018/2035] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:35:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:35:23.717999 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4930e-66b5-43e4-8fbd-205bd89c1d25 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:23.722904 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4930e-66b5-43e4-8fbd-205bd89c1d25 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:23.722904 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4930e-66b5-43e4-8fbd-205bd89c1d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:23.753531 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-3de4930e-66b5-43e4-8fbd-205bd89c1d25 None None] MFA Rules not processed for user `e56c6e02cba541888589acd0732bfaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:23.755071 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-3de4930e-66b5-43e4-8fbd-205bd89c1d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:23.840366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1018/2036] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:35:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:23.843933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b179c-d853-48fb-b536-bc7ffad1cb0a service nova] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:23.858725 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b179c-d853-48fb-b536-bc7ffad1cb0a service nova] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:23.871453 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d97003-c26d-474b-8de4-4366c72a03bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:23.872383 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d97003-c26d-474b-8de4-4366c72a03bd admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:23.872850 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d97003-c26d-474b-8de4-4366c72a03bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:23.873368 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d97003-c26d-474b-8de4-4366c72a03bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:23.874331 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d97003-c26d-474b-8de4-4366c72a03bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:23.876536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d97003-c26d-474b-8de4-4366c72a03bd admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:24.005256 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1019/2037] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:35:23 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:35:24.009955 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4930e-66b5-43e4-8fbd-205bd89c1d25 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:24.023486 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4930e-66b5-43e4-8fbd-205bd89c1d25 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:24.090025 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ffaf9-b006-475d-a2f0-6ff06007c8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:24.090811 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ffaf9-b006-475d-a2f0-6ff06007c8ac admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:24.091122 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ffaf9-b006-475d-a2f0-6ff06007c8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:24.091400 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ffaf9-b006-475d-a2f0-6ff06007c8ac admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:24.092052 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ffaf9-b006-475d-a2f0-6ff06007c8ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:24.094092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ffaf9-b006-475d-a2f0-6ff06007c8ac admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:24.205019 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1019/2038] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:35:24 2022] POST /identity/v3/users => generated 299 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:35:24.214798 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d97003-c26d-474b-8de4-4366c72a03bd admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:24.234085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d97003-c26d-474b-8de4-4366c72a03bd admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:24.239820 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79c0c8-1bde-47e8-a4fe-80b73dad1e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:24.240544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79c0c8-1bde-47e8-a4fe-80b73dad1e29 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:24.241021 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79c0c8-1bde-47e8-a4fe-80b73dad1e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:24.241297 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79c0c8-1bde-47e8-a4fe-80b73dad1e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:24.241947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79c0c8-1bde-47e8-a4fe-80b73dad1e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:24.243703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79c0c8-1bde-47e8-a4fe-80b73dad1e29 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:24.257751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1020/2039] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:35:24.262080 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ffaf9-b006-475d-a2f0-6ff06007c8ac admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:24.272749 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ffaf9-b006-475d-a2f0-6ff06007c8ac admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:24.278530 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd70c2-1575-47dc-8f51-07bdafcc41c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:24.279230 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd70c2-1575-47dc-8f51-07bdafcc41c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:24.279508 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd70c2-1575-47dc-8f51-07bdafcc41c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:24.279805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd70c2-1575-47dc-8f51-07bdafcc41c4 admin admin] PATH_INFO: `/v3/projects/dc8953bf829e41dd9b00f1c64d4ac020/users/48f94027d551424d901af1e818ba3df0/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:24.298706 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd70c2-1575-47dc-8f51-07bdafcc41c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8953bf829e41dd9b00f1c64d4ac020, user_id=48f94027d551424d901af1e818ba3df0, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:24.301700 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd70c2-1575-47dc-8f51-07bdafcc41c4 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:24.413246 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1020/2040] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:35:24 2022] PUT /identity/v3/projects/dc8953bf829e41dd9b00f1c64d4ac020/users/48f94027d551424d901af1e818ba3df0/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:35:24.418055 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79c0c8-1bde-47e8-a4fe-80b73dad1e29 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:24.428401 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79c0c8-1bde-47e8-a4fe-80b73dad1e29 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:24.490088 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01b34a-b184-4455-a779-0d281acd8bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:24.490699 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01b34a-b184-4455-a779-0d281acd8bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:24.491053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01b34a-b184-4455-a779-0d281acd8bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:24.491275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01b34a-b184-4455-a779-0d281acd8bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:24.492301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01b34a-b184-4455-a779-0d281acd8bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:24.493505 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01b34a-b184-4455-a779-0d281acd8bc0 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:24.503622 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1021/2041] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:35:24.508031 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd70c2-1575-47dc-8f51-07bdafcc41c4 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:24.514540 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:24.522164 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd70c2-1575-47dc-8f51-07bdafcc41c4 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:24.527866 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0d51e-c1bf-472d-a594-a0143d3a0d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:24.528532 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0d51e-c1bf-472d-a594-a0143d3a0d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:24.528813 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0d51e-c1bf-472d-a594-a0143d3a0d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:24.529094 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0d51e-c1bf-472d-a594-a0143d3a0d8a admin admin] PATH_INFO: `/v3/projects/dc8953bf829e41dd9b00f1c64d4ac020/users/48f94027d551424d901af1e818ba3df0/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:24.531045 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0d51e-c1bf-472d-a594-a0143d3a0d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8953bf829e41dd9b00f1c64d4ac020, user_id=48f94027d551424d901af1e818ba3df0, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:24.533756 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0d51e-c1bf-472d-a594-a0143d3a0d8a admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:24.550529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1021/2042] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:35:24 2022] PUT /identity/v3/projects/dc8953bf829e41dd9b00f1c64d4ac020/users/48f94027d551424d901af1e818ba3df0/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:35:25.976762 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60264968-09b7-4d63-89e0-b36c3aa287a3 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:25.977302 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60264968-09b7-4d63-89e0-b36c3aa287a3 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:25.977407 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60264968-09b7-4d63-89e0-b36c3aa287a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:26.003211 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-60264968-09b7-4d63-89e0-b36c3aa287a3 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:26.004508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-60264968-09b7-4d63-89e0-b36c3aa287a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:26.075767 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1022/2043] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Oct 19 02:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:26.118069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0d51e-c1bf-472d-a594-a0143d3a0d8a admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:26.120831 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c7f0d51e-c1bf-472d-a594-a0143d3a0d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:26.274714 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0d51e-c1bf-472d-a594-a0143d3a0d8a admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:26.282976 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65457803-8603-4b22-b2db-e8db97f5067c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:26.283827 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65457803-8603-4b22-b2db-e8db97f5067c service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:26.284267 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65457803-8603-4b22-b2db-e8db97f5067c service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:26.284814 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65457803-8603-4b22-b2db-e8db97f5067c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:26.307271 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65457803-8603-4b22-b2db-e8db97f5067c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:26.309678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65457803-8603-4b22-b2db-e8db97f5067c service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:26.337261 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1022/2044] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:35:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:35:30.413488 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60264968-09b7-4d63-89e0-b36c3aa287a3 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:30.415006 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-60264968-09b7-4d63-89e0-b36c3aa287a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:30.431808 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60264968-09b7-4d63-89e0-b36c3aa287a3 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:30.447340 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46d423-c9b3-4f29-afa3-7a04eafac3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:30.448102 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46d423-c9b3-4f29-afa3-7a04eafac3e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:30.448887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46d423-c9b3-4f29-afa3-7a04eafac3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:30.449256 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46d423-c9b3-4f29-afa3-7a04eafac3e7 admin admin] PATH_INFO: `/v3/users/27ac973e061041fabc19f0fe121bcf32` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:30.451899 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46d423-c9b3-4f29-afa3-7a04eafac3e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27ac973e061041fabc19f0fe121bcf32)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:30.455624 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46d423-c9b3-4f29-afa3-7a04eafac3e7 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:30.740452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:30.758994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-de46d423-c9b3-4f29-afa3-7a04eafac3e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27ac973e061041fabc19f0fe121bcf32'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:30.759728 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-de46d423-c9b3-4f29-afa3-7a04eafac3e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27ac973e061041fabc19f0fe121bcf32'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:30.888781 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-de46d423-c9b3-4f29-afa3-7a04eafac3e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27ac973e061041fabc19f0fe121bcf32'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:30.908687 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-de46d423-c9b3-4f29-afa3-7a04eafac3e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27ac973e061041fabc19f0fe121bcf32'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:30.908687 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-de46d423-c9b3-4f29-afa3-7a04eafac3e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27ac973e061041fabc19f0fe121bcf32'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:30.934837 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1023/2045] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:35:30 2022] DELETE /identity/v3/users/27ac973e061041fabc19f0fe121bcf32 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:35:30.942230 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca17ea4-ba87-496c-bacd-1569420135a1 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:30.942766 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca17ea4-ba87-496c-bacd-1569420135a1 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:30.943030 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca17ea4-ba87-496c-bacd-1569420135a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:30.975739 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-dca17ea4-ba87-496c-bacd-1569420135a1 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:30.977205 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-dca17ea4-ba87-496c-bacd-1569420135a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:31.100228 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1023/2046] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:31.111020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46d423-c9b3-4f29-afa3-7a04eafac3e7 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:31.112470 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-de46d423-c9b3-4f29-afa3-7a04eafac3e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:31.155017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3e82a-bdf9-413d-8d0f-deb1ab0424cf None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:31.156121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3e82a-bdf9-413d-8d0f-deb1ab0424cf None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:31.156510 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3e82a-bdf9-413d-8d0f-deb1ab0424cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:31.247073 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-00c3e82a-bdf9-413d-8d0f-deb1ab0424cf None None] MFA Rules not processed for user `48f94027d551424d901af1e818ba3df0`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:31.248489 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-00c3e82a-bdf9-413d-8d0f-deb1ab0424cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:31.258488 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46d423-c9b3-4f29-afa3-7a04eafac3e7 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:31.264438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec92ef6-7613-48b4-b9ed-38ede9d326d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:31.265636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec92ef6-7613-48b4-b9ed-38ede9d326d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:31.265915 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec92ef6-7613-48b4-b9ed-38ede9d326d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:31.266189 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec92ef6-7613-48b4-b9ed-38ede9d326d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:31.276389 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec92ef6-7613-48b4-b9ed-38ede9d326d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:31.278883 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec92ef6-7613-48b4-b9ed-38ede9d326d0 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:31.291361 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1024/2047] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:35:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:35:31.342806 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:31.347562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1024/2048] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:35:31 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:31.364577 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec92ef6-7613-48b4-b9ed-38ede9d326d0 service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:31.365907 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-7ec92ef6-7613-48b4-b9ed-38ede9d326d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:31.447737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec92ef6-7613-48b4-b9ed-38ede9d326d0 service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:31.453060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59d9e8-9233-45f6-ac29-7624b4142c3a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9e8a7a5b8944272a2d1bd2140819ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:31.453914 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59d9e8-9233-45f6-ac29-7624b4142c3a service glance] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:31.454605 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59d9e8-9233-45f6-ac29-7624b4142c3a service glance] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:31.455081 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59d9e8-9233-45f6-ac29-7624b4142c3a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:31.457166 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-5f59d9e8-9233-45f6-ac29-7624b4142c3a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:31.543846 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59d9e8-9233-45f6-ac29-7624b4142c3a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:31.545553 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59d9e8-9233-45f6-ac29-7624b4142c3a service glance] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:31.555653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1025/2049] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:35:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:35:31.701358 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa14b4-5b33-48ae-9bee-0b25f131d8d9 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:31.701635 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa14b4-5b33-48ae-9bee-0b25f131d8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:31.701908 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa14b4-5b33-48ae-9bee-0b25f131d8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:31.723306 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-7aaa14b4-5b33-48ae-9bee-0b25f131d8d9 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:31.724513 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-7aaa14b4-5b33-48ae-9bee-0b25f131d8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:31.744767 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1025/2050] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Oct 19 02:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:31.766333 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59d9e8-9233-45f6-ac29-7624b4142c3a service glance] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:31.767824 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-5f59d9e8-9233-45f6-ac29-7624b4142c3a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:31.802691 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa14b4-5b33-48ae-9bee-0b25f131d8d9 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:31.804168 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-7aaa14b4-5b33-48ae-9bee-0b25f131d8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:31.822786 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa14b4-5b33-48ae-9bee-0b25f131d8d9 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:31.823676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170439cc-20b2-49d6-9214-c0ae915384db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:31.824415 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170439cc-20b2-49d6-9214-c0ae915384db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:31.824699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170439cc-20b2-49d6-9214-c0ae915384db admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:31.825002 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170439cc-20b2-49d6-9214-c0ae915384db admin admin] PATH_INFO: `/v3/projects/de3045b7f271446fb9c711655f25bd58` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:31.826189 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170439cc-20b2-49d6-9214-c0ae915384db admin admin] RBAC: Authorizing `identity:delete_project(project_id=de3045b7f271446fb9c711655f25bd58)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:31.828158 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170439cc-20b2-49d6-9214-c0ae915384db admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:31.871856 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59d9e8-9233-45f6-ac29-7624b4142c3a service glance] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:31.878630 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1cb8c-6971-45f8-8cf3-19f5061040cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:31.886288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1cb8c-6971-45f8-8cf3-19f5061040cf service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:31.886288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1cb8c-6971-45f8-8cf3-19f5061040cf service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:31.886288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1cb8c-6971-45f8-8cf3-19f5061040cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:31.889932 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1cb8c-6971-45f8-8cf3-19f5061040cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:31.891815 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1cb8c-6971-45f8-8cf3-19f5061040cf service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:31.903646 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1026/2051] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:35:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:35:31.904896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1d1df-c3a4-4146-a882-e81842433447 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:31.905204 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1d1df-c3a4-4146-a882-e81842433447 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:31.905474 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1d1df-c3a4-4146-a882-e81842433447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:31.925896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-62c1d1df-c3a4-4146-a882-e81842433447 None None] MFA Rules not processed for user `e58cdf090af44b508767e821be2f379f`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:31.927127 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-62c1d1df-c3a4-4146-a882-e81842433447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:31.984904 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1027/2052] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 02:35:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:31.995321 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-170439cc-20b2-49d6-9214-c0ae915384db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de3045b7f271446fb9c711655f25bd58', 'request_id': 'req-170439cc-20b2-49d6-9214-c0ae915384db'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:31.998215 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1d1df-c3a4-4146-a882-e81842433447 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:31.999391 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-62c1d1df-c3a4-4146-a882-e81842433447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:32.002432 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-170439cc-20b2-49d6-9214-c0ae915384db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de3045b7f271446fb9c711655f25bd58', 'request_id': 'req-170439cc-20b2-49d6-9214-c0ae915384db'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:32.008956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-170439cc-20b2-49d6-9214-c0ae915384db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de3045b7f271446fb9c711655f25bd58', 'request_id': 'req-170439cc-20b2-49d6-9214-c0ae915384db'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:32.078187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1d1df-c3a4-4146-a882-e81842433447 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:32.111812 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-170439cc-20b2-49d6-9214-c0ae915384db admin admin] The token cache is being invalidate because project de3045b7f271446fb9c711655f25bd58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:35:32.112200 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-170439cc-20b2-49d6-9214-c0ae915384db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:32.112917 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-170439cc-20b2-49d6-9214-c0ae915384db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:32.114504 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1026/2053] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:35:31 2022] DELETE /identity/v3/projects/de3045b7f271446fb9c711655f25bd58 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:35:32.122230 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13109e10-ba93-41df-94ec-0a0d7d3998f4 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:32.125424 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13109e10-ba93-41df-94ec-0a0d7d3998f4 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:32.125424 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13109e10-ba93-41df-94ec-0a0d7d3998f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:32.136593 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:32.146263 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-13109e10-ba93-41df-94ec-0a0d7d3998f4 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:32.147598 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-13109e10-ba93-41df-94ec-0a0d7d3998f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:32.173293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9726d32-ecd9-43d4-98a9-e18d4b4af7a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906e9835f5c4e709915c6553b41aeff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:32.173903 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9726d32-ecd9-43d4-98a9-e18d4b4af7a9 service swift] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:32.174183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9726d32-ecd9-43d4-98a9-e18d4b4af7a9 service swift] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:32.174466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9726d32-ecd9-43d4-98a9-e18d4b4af7a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:32.176295 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-f9726d32-ecd9-43d4-98a9-e18d4b4af7a9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:32.218351 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1027/2054] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:32.219314 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0fedc-94a9-45f7-a869-3e5eb685cf81 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:32.219602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0fedc-94a9-45f7-a869-3e5eb685cf81 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:32.219876 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0fedc-94a9-45f7-a869-3e5eb685cf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:32.240383 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-98e0fedc-94a9-45f7-a869-3e5eb685cf81 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:32.241508 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-98e0fedc-94a9-45f7-a869-3e5eb685cf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:32.250132 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9726d32-ecd9-43d4-98a9-e18d4b4af7a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:32.254120 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1028/2055] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:32.254224 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9726d32-ecd9-43d4-98a9-e18d4b4af7a9 service swift] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:32.255494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0fedc-94a9-45f7-a869-3e5eb685cf81 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:32.264394 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1028/2056] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 02:35:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 02:35:32.265481 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0fedc-94a9-45f7-a869-3e5eb685cf81 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:32.271518 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024711a8-8935-41c3-9e67-0fe7efaa953d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:32.272172 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024711a8-8935-41c3-9e67-0fe7efaa953d admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:32.272428 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024711a8-8935-41c3-9e67-0fe7efaa953d admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:32.276029 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024711a8-8935-41c3-9e67-0fe7efaa953d admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:32.276029 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024711a8-8935-41c3-9e67-0fe7efaa953d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:35:32.276029 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024711a8-8935-41c3-9e67-0fe7efaa953d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:32.276029 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024711a8-8935-41c3-9e67-0fe7efaa953d admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:32.302862 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1029/2057] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:35:32.312587 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9726d32-ecd9-43d4-98a9-e18d4b4af7a9 service swift] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:32.324104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9726d32-ecd9-43d4-98a9-e18d4b4af7a9 service swift] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:32.328641 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c539ac-1645-4587-9afa-1fde0846ddca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:32.329244 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c539ac-1645-4587-9afa-1fde0846ddca admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:32.329524 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c539ac-1645-4587-9afa-1fde0846ddca admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:32.329799 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c539ac-1645-4587-9afa-1fde0846ddca admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:32.330470 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c539ac-1645-4587-9afa-1fde0846ddca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:32.332457 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c539ac-1645-4587-9afa-1fde0846ddca admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:32.497373 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1029/2058] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:35:32 2022] POST /identity/v3/projects => generated 389 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:35:32.501250 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024711a8-8935-41c3-9e67-0fe7efaa953d admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:32.522640 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024711a8-8935-41c3-9e67-0fe7efaa953d admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:32.635624 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9976976-8784-4112-a7a4-8f122b85de33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:32.637163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9976976-8784-4112-a7a4-8f122b85de33 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:32.637594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9976976-8784-4112-a7a4-8f122b85de33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:32.637891 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9976976-8784-4112-a7a4-8f122b85de33 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:32.638547 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9976976-8784-4112-a7a4-8f122b85de33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:32.643222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9976976-8784-4112-a7a4-8f122b85de33 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:32.669965 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:32.798642 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1030/2059] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:35:32 2022] POST /identity/v3/users => generated 295 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:35:32.799656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c539ac-1645-4587-9afa-1fde0846ddca admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:32.814363 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c539ac-1645-4587-9afa-1fde0846ddca admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:32.821250 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290cb11-d17f-4676-b192-2dcd54de9171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:32.821866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290cb11-d17f-4676-b192-2dcd54de9171 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:32.822319 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290cb11-d17f-4676-b192-2dcd54de9171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:32.822593 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290cb11-d17f-4676-b192-2dcd54de9171 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:32.823281 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2290cb11-d17f-4676-b192-2dcd54de9171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:32.825720 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2290cb11-d17f-4676-b192-2dcd54de9171 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:32.843869 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1030/2060] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:35:32.847619 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9976976-8784-4112-a7a4-8f122b85de33 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:32.864377 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9976976-8784-4112-a7a4-8f122b85de33 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:32.873317 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0a60f-e8b5-4210-be41-77b22d52f11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:32.873929 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0a60f-e8b5-4210-be41-77b22d52f11f admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:32.874200 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0a60f-e8b5-4210-be41-77b22d52f11f admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:32.874467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0a60f-e8b5-4210-be41-77b22d52f11f admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:32.875169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0a60f-e8b5-4210-be41-77b22d52f11f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:32.876752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0a60f-e8b5-4210-be41-77b22d52f11f admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:32.891145 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1031/2061] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:35:32.895297 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290cb11-d17f-4676-b192-2dcd54de9171 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:32.909194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290cb11-d17f-4676-b192-2dcd54de9171 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:32.915633 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f1cac-5262-4381-8f63-5ef7254407c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:32.916632 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f1cac-5262-4381-8f63-5ef7254407c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:32.917167 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f1cac-5262-4381-8f63-5ef7254407c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:32.917984 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f1cac-5262-4381-8f63-5ef7254407c7 admin admin] PATH_INFO: `/v3/projects/de860c66f0af496c8f96cb318890b846/users/c33819c023544fed86a448f811fa4032/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:32.940440 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f1cac-5262-4381-8f63-5ef7254407c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de860c66f0af496c8f96cb318890b846, user_id=c33819c023544fed86a448f811fa4032, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:32.943629 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f1cac-5262-4381-8f63-5ef7254407c7 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:33.033072 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1031/2062] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:35:32 2022] PUT /identity/v3/projects/de860c66f0af496c8f96cb318890b846/users/c33819c023544fed86a448f811fa4032/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:35:33.049049 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d551923-8d57-4853-ab63-343366a59ab2 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:33.049717 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d551923-8d57-4853-ab63-343366a59ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:33.049717 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d551923-8d57-4853-ab63-343366a59ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:33.097167 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-7d551923-8d57-4853-ab63-343366a59ab2 None None] MFA Rules not processed for user `c33819c023544fed86a448f811fa4032`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:33.098615 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-7d551923-8d57-4853-ab63-343366a59ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:33.208209 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:33.215678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1032/2063] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:35:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:33.234455 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f1cac-5262-4381-8f63-5ef7254407c7 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:33.238547 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-926f1cac-5262-4381-8f63-5ef7254407c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:33.323205 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f1cac-5262-4381-8f63-5ef7254407c7 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:33.330283 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba6916-d4ce-4c87-850a-32167bfc5f6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:33.331075 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba6916-d4ce-4c87-850a-32167bfc5f6c service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:33.331353 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba6916-d4ce-4c87-850a-32167bfc5f6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:33.331625 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba6916-d4ce-4c87-850a-32167bfc5f6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:33.344567 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba6916-d4ce-4c87-850a-32167bfc5f6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:33.352950 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba6916-d4ce-4c87-850a-32167bfc5f6c service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:33.389549 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1032/2064] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:35:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:35:36.080561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d551923-8d57-4853-ab63-343366a59ab2 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:36.081237 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-7d551923-8d57-4853-ab63-343366a59ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:36.157694 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d551923-8d57-4853-ab63-343366a59ab2 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:36.162875 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080f88d-6f4a-4441-a378-e66eee0817da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66b9bc695b44877a06f17ea6bbeb27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:36.163504 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080f88d-6f4a-4441-a378-e66eee0817da service placement] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:36.163781 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080f88d-6f4a-4441-a378-e66eee0817da service placement] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:36.164048 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080f88d-6f4a-4441-a378-e66eee0817da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:36.165815 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-8080f88d-6f4a-4441-a378-e66eee0817da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:36.178363 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080f88d-6f4a-4441-a378-e66eee0817da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:36.179976 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080f88d-6f4a-4441-a378-e66eee0817da service placement] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:36.190420 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1033/2065] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:35:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:35:37.956826 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345432-c208-440e-8a91-7ec2538c6b4c None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:37.960425 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345432-c208-440e-8a91-7ec2538c6b4c None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:37.960425 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345432-c208-440e-8a91-7ec2538c6b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:37.997978 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-c8345432-c208-440e-8a91-7ec2538c6b4c None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:37.999380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-c8345432-c208-440e-8a91-7ec2538c6b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:38.038044 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:38.090381 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1033/2066] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Oct 19 02:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:38.115267 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080f88d-6f4a-4441-a378-e66eee0817da service placement] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:38.116769 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-8080f88d-6f4a-4441-a378-e66eee0817da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:38.192073 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:38.219246 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080f88d-6f4a-4441-a378-e66eee0817da service placement] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:38.225580 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294af89-1ab0-4182-8320-acfbdcfa0d68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:38.226224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294af89-1ab0-4182-8320-acfbdcfa0d68 service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:38.226498 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294af89-1ab0-4182-8320-acfbdcfa0d68 service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:38.226766 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294af89-1ab0-4182-8320-acfbdcfa0d68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:38.237232 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294af89-1ab0-4182-8320-acfbdcfa0d68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:38.238865 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294af89-1ab0-4182-8320-acfbdcfa0d68 service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:38.252017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1034/2067] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:35:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:35:44.004202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5dd03-4d67-4c21-9c42-f0aa8b676038 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:44.004659 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5dd03-4d67-4c21-9c42-f0aa8b676038 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:44.004776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5dd03-4d67-4c21-9c42-f0aa8b676038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:44.044869 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-29a5dd03-4d67-4c21-9c42-f0aa8b676038 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:44.047042 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-29a5dd03-4d67-4c21-9c42-f0aa8b676038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:44.056616 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1034/2068] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Oct 19 02:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:44.080321 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294af89-1ab0-4182-8320-acfbdcfa0d68 service nova] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:44.081775 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-a294af89-1ab0-4182-8320-acfbdcfa0d68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:44.111128 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294af89-1ab0-4182-8320-acfbdcfa0d68 service nova] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:44.124291 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e1661-0bb9-4300-a29b-37d7d864b4d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:44.124291 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e1661-0bb9-4300-a29b-37d7d864b4d7 service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:44.124291 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e1661-0bb9-4300-a29b-37d7d864b4d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:44.124291 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e1661-0bb9-4300-a29b-37d7d864b4d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:44.131889 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e1661-0bb9-4300-a29b-37d7d864b4d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:44.133757 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e1661-0bb9-4300-a29b-37d7d864b4d7 service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:44.145748 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1035/2069] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:35:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:35:45.264053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ecaeb-70bf-412b-a970-019665e85104 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:45.264625 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ecaeb-70bf-412b-a970-019665e85104 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:45.264625 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ecaeb-70bf-412b-a970-019665e85104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:45.285177 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-736ecaeb-70bf-412b-a970-019665e85104 None None] MFA Rules not processed for user `e56c6e02cba541888589acd0732bfaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:45.286404 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-736ecaeb-70bf-412b-a970-019665e85104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:45.341825 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1035/2070] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:35:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:46.667584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ac059-d543-40aa-bcf0-fb574e1bc09e None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:46.668101 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ac059-d543-40aa-bcf0-fb574e1bc09e None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:46.668308 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ac059-d543-40aa-bcf0-fb574e1bc09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:46.690667 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-5f5ac059-d543-40aa-bcf0-fb574e1bc09e None None] MFA Rules not processed for user `e58cdf090af44b508767e821be2f379f`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:46.691898 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-5f5ac059-d543-40aa-bcf0-fb574e1bc09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:46.757780 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1036/2071] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 02:35:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:46.771088 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ecaeb-70bf-412b-a970-019665e85104 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:46.772555 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-736ecaeb-70bf-412b-a970-019665e85104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:46.857498 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ecaeb-70bf-412b-a970-019665e85104 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:46.863790 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931582a6-4d69-4e8a-be62-cafcb42929d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906e9835f5c4e709915c6553b41aeff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:46.864396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931582a6-4d69-4e8a-be62-cafcb42929d9 service swift] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:46.864670 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931582a6-4d69-4e8a-be62-cafcb42929d9 service swift] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:46.864942 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931582a6-4d69-4e8a-be62-cafcb42929d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:46.875474 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931582a6-4d69-4e8a-be62-cafcb42929d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:46.877085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931582a6-4d69-4e8a-be62-cafcb42929d9 service swift] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:46.885525 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1036/2072] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 02:35:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:35:49.318515 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a59c8a-cef7-449d-b34b-d3840ef8c7aa None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:49.319618 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a59c8a-cef7-449d-b34b-d3840ef8c7aa None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:49.320761 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a59c8a-cef7-449d-b34b-d3840ef8c7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:49.385835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-a2a59c8a-cef7-449d-b34b-d3840ef8c7aa None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:49.387102 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-a2a59c8a-cef7-449d-b34b-d3840ef8c7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:49.397527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1037/2073] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Oct 19 02:35:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:49.423718 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931582a6-4d69-4e8a-be62-cafcb42929d9 service swift] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:49.441942 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931582a6-4d69-4e8a-be62-cafcb42929d9 service swift] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:49.452735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f27a0-d48b-4448-b687-af955b71e2d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:49.453750 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f27a0-d48b-4448-b687-af955b71e2d2 service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:49.454026 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f27a0-d48b-4448-b687-af955b71e2d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:49.454305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f27a0-d48b-4448-b687-af955b71e2d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:49.463953 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f27a0-d48b-4448-b687-af955b71e2d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:49.465830 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f27a0-d48b-4448-b687-af955b71e2d2 service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:49.480045 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1037/2074] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:35:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:35:50.000948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a59c8a-cef7-449d-b34b-d3840ef8c7aa None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:50.010880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a59c8a-cef7-449d-b34b-d3840ef8c7aa None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:50.015748 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2aa85-1d77-4231-9be5-d897320177e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:50.016422 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2aa85-1d77-4231-9be5-d897320177e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:50.016704 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2aa85-1d77-4231-9be5-d897320177e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:50.016977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2aa85-1d77-4231-9be5-d897320177e7 admin admin] PATH_INFO: `/v3/users/c33819c023544fed86a448f811fa4032` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:50.018110 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2aa85-1d77-4231-9be5-d897320177e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c33819c023544fed86a448f811fa4032)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:50.020089 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2aa85-1d77-4231-9be5-d897320177e7 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:50.539537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-f3b2aa85-1d77-4231-9be5-d897320177e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c33819c023544fed86a448f811fa4032'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:50.541748 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-f3b2aa85-1d77-4231-9be5-d897320177e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c33819c023544fed86a448f811fa4032'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:50.646059 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-f3b2aa85-1d77-4231-9be5-d897320177e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c33819c023544fed86a448f811fa4032'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:50.661256 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-f3b2aa85-1d77-4231-9be5-d897320177e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c33819c023544fed86a448f811fa4032'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:50.662237 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-f3b2aa85-1d77-4231-9be5-d897320177e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c33819c023544fed86a448f811fa4032'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:50.690809 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1038/2075] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:35:49 2022] DELETE /identity/v3/users/c33819c023544fed86a448f811fa4032 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:35:50.698765 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8bd44-b178-4e9c-b495-646abf266938 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:50.698765 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8bd44-b178-4e9c-b495-646abf266938 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:50.698765 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8bd44-b178-4e9c-b495-646abf266938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:50.721534 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-10c8bd44-b178-4e9c-b495-646abf266938 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:50.722999 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-10c8bd44-b178-4e9c-b495-646abf266938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:50.763436 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:50.815794 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1038/2076] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:35:50.834865 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2aa85-1d77-4231-9be5-d897320177e7 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:50.840239 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-f3b2aa85-1d77-4231-9be5-d897320177e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:50.914308 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:35:50.932769 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2aa85-1d77-4231-9be5-d897320177e7 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:50.937055 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd1447-00fc-408f-85d5-8541037234f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:50.943097 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd1447-00fc-408f-85d5-8541037234f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:50.943097 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd1447-00fc-408f-85d5-8541037234f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:50.943097 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd1447-00fc-408f-85d5-8541037234f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:50.952003 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd1447-00fc-408f-85d5-8541037234f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:50.954070 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd1447-00fc-408f-85d5-8541037234f5 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:50.967574 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1039/2077] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:35:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:35:51.594707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8bd44-b178-4e9c-b495-646abf266938 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:51.594707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-10c8bd44-b178-4e9c-b495-646abf266938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:51.616535 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8bd44-b178-4e9c-b495-646abf266938 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:51.625233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01079cd-0351-4ca4-abf6-cf2656322e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:51.641475 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01079cd-0351-4ca4-abf6-cf2656322e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:51.642838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01079cd-0351-4ca4-abf6-cf2656322e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:51.645107 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01079cd-0351-4ca4-abf6-cf2656322e4e admin admin] PATH_INFO: `/v3/projects/de860c66f0af496c8f96cb318890b846` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:51.653911 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01079cd-0351-4ca4-abf6-cf2656322e4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=de860c66f0af496c8f96cb318890b846)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:51.664404 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01079cd-0351-4ca4-abf6-cf2656322e4e admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:51.866591 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a01079cd-0351-4ca4-abf6-cf2656322e4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de860c66f0af496c8f96cb318890b846', 'request_id': 'req-a01079cd-0351-4ca4-abf6-cf2656322e4e'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:51.880381 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a01079cd-0351-4ca4-abf6-cf2656322e4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de860c66f0af496c8f96cb318890b846', 'request_id': 'req-a01079cd-0351-4ca4-abf6-cf2656322e4e'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:51.955309 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a01079cd-0351-4ca4-abf6-cf2656322e4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de860c66f0af496c8f96cb318890b846', 'request_id': 'req-a01079cd-0351-4ca4-abf6-cf2656322e4e'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:51.981843 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a01079cd-0351-4ca4-abf6-cf2656322e4e admin admin] The token cache is being invalidate because project de860c66f0af496c8f96cb318890b846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:35:51.982269 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a01079cd-0351-4ca4-abf6-cf2656322e4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:51.995000 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-a01079cd-0351-4ca4-abf6-cf2656322e4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:35:51.995000 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1039/2078] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:35:51 2022] DELETE /identity/v3/projects/de860c66f0af496c8f96cb318890b846 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:35:53.068090 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589baca-b9cf-4242-9c13-effd54c750f5 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:53.068758 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589baca-b9cf-4242-9c13-effd54c750f5 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:53.068983 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589baca-b9cf-4242-9c13-effd54c750f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:53.101737 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-1589baca-b9cf-4242-9c13-effd54c750f5 None None] MFA Rules not processed for user `e58cdf090af44b508767e821be2f379f`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:35:53.103099 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-1589baca-b9cf-4242-9c13-effd54c750f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:53.200141 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1040/2079] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 02:35:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:35:53.215599 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01079cd-0351-4ca4-abf6-cf2656322e4e admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:35:53.220017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-a01079cd-0351-4ca4-abf6-cf2656322e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:35:53.317090 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01079cd-0351-4ca4-abf6-cf2656322e4e admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:35:53.326305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f3a7f-4185-4552-a06e-11e25d63386f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906e9835f5c4e709915c6553b41aeff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:35:53.327996 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f3a7f-4185-4552-a06e-11e25d63386f service swift] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:35:53.328566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f3a7f-4185-4552-a06e-11e25d63386f service swift] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:35:53.329214 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f3a7f-4185-4552-a06e-11e25d63386f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:35:53.339996 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f3a7f-4185-4552-a06e-11e25d63386f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:35:53.342431 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f3a7f-4185-4552-a06e-11e25d63386f service swift] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:35:53.353580 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1040/2080] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 02:35:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:36:03.181166 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=34 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:36:03.349042 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=68,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:36:23.604738 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176e1c5-4a83-4b20-af71-b2cf71463049 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:36:23.605362 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176e1c5-4a83-4b20-af71-b2cf71463049 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:36:23.605362 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176e1c5-4a83-4b20-af71-b2cf71463049 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:36:23.606988 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1041/2081] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 19 02:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:36:23.613821 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f1315-2ed6-43a7-b08e-ecb213847363 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:36:23.614409 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f1315-2ed6-43a7-b08e-ecb213847363 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:36:23.614409 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f1315-2ed6-43a7-b08e-ecb213847363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:36:23.636535 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-5f8f1315-2ed6-43a7-b08e-ecb213847363 None None] MFA Rules not processed for user `58a78f75a63e4d258a4afbeb748e59f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:36:23.637788 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-5f8f1315-2ed6-43a7-b08e-ecb213847363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:36:23.728412 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1041/2082] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 19 02:36:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:36:23.740770 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176e1c5-4a83-4b20-af71-b2cf71463049 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:36:23.742541 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c176e1c5-4a83-4b20-af71-b2cf71463049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:36:23.800510 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176e1c5-4a83-4b20-af71-b2cf71463049 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:36:23.804045 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb42c19-2bc9-4d83-8bb1-8d6b67d9e705 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9e8a7a5b8944272a2d1bd2140819ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:36:23.804635 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb42c19-2bc9-4d83-8bb1-8d6b67d9e705 service glance] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:36:23.804907 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb42c19-2bc9-4d83-8bb1-8d6b67d9e705 service glance] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:36:23.805171 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb42c19-2bc9-4d83-8bb1-8d6b67d9e705 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:36:23.815222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb42c19-2bc9-4d83-8bb1-8d6b67d9e705 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:36:23.816913 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb42c19-2bc9-4d83-8bb1-8d6b67d9e705 service glance] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:36:23.828667 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1042/2083] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:36:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:36:24.130471 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a8305-932a-4cc6-bc7a-9f02ec64b0b2 None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:36:24.130785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a8305-932a-4cc6-bc7a-9f02ec64b0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:36:24.131195 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a8305-932a-4cc6-bc7a-9f02ec64b0b2 None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:36:24.132410 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1042/2084] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 19 02:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:36:24.137701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79499f3-d56e-4a4f-9778-12f7715b008a None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:36:24.137986 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79499f3-d56e-4a4f-9778-12f7715b008a None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:36:24.138283 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79499f3-d56e-4a4f-9778-12f7715b008a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:36:24.158379 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-b79499f3-d56e-4a4f-9778-12f7715b008a None None] MFA Rules not processed for user `e7e4640bd879468d81ec0281827687ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:36:24.160034 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-b79499f3-d56e-4a4f-9778-12f7715b008a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:36:24.218373 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1043/2085] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 19 02:36:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:36:24.230480 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a8305-932a-4cc6-bc7a-9f02ec64b0b2 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:36:24.232259 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-970a8305-932a-4cc6-bc7a-9f02ec64b0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:36:24.247719 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a8305-932a-4cc6-bc7a-9f02ec64b0b2 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:36:24.251278 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7834ca-9446-47ac-a575-15dd780e7e11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:36:24.251878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7834ca-9446-47ac-a575-15dd780e7e11 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:36:24.252796 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7834ca-9446-47ac-a575-15dd780e7e11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:36:24.253130 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7834ca-9446-47ac-a575-15dd780e7e11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:36:24.260639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7834ca-9446-47ac-a575-15dd780e7e11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:36:24.262077 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7834ca-9446-47ac-a575-15dd780e7e11 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:36:24.270688 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1043/2086] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:36:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:36:24.354182 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dd4cd-730f-44e0-b531-7c4c9ef46b3b None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:36:24.354465 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dd4cd-730f-44e0-b531-7c4c9ef46b3b None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:36:24.354733 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dd4cd-730f-44e0-b531-7c4c9ef46b3b None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:36:24.356098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1044/2087] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 19 02:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:36:24.361994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131ef29-bd49-4a8e-9f01-2f82efd84656 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:36:24.362639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131ef29-bd49-4a8e-9f01-2f82efd84656 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:36:24.362639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131ef29-bd49-4a8e-9f01-2f82efd84656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:36:24.392922 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-3131ef29-bd49-4a8e-9f01-2f82efd84656 None None] MFA Rules not processed for user `58a78f75a63e4d258a4afbeb748e59f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:36:24.394285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-3131ef29-bd49-4a8e-9f01-2f82efd84656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:36:24.407690 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1044/2088] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 19 02:36:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:36:24.418119 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dd4cd-730f-44e0-b531-7c4c9ef46b3b None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:36:24.430053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dd4cd-730f-44e0-b531-7c4c9ef46b3b None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:36:24.433856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4f9d3-58fe-40d1-b779-2a356b979ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:36:24.434495 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4f9d3-58fe-40d1-b779-2a356b979ffd service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:36:24.434725 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4f9d3-58fe-40d1-b779-2a356b979ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:36:24.436130 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4f9d3-58fe-40d1-b779-2a356b979ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:36:24.447975 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4f9d3-58fe-40d1-b779-2a356b979ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:36:24.449418 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4f9d3-58fe-40d1-b779-2a356b979ffd service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:36:24.462933 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1045/2089] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:36:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:36:28.974209 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056ea35-07f5-46cd-afba-a23bd687008f None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:36:28.979357 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056ea35-07f5-46cd-afba-a23bd687008f None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:36:28.979357 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056ea35-07f5-46cd-afba-a23bd687008f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:36:28.995133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-0056ea35-07f5-46cd-afba-a23bd687008f None None] MFA Rules not processed for user `e58cdf090af44b508767e821be2f379f`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:36:28.996506 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-0056ea35-07f5-46cd-afba-a23bd687008f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:36:29.004538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1045/2090] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 02:36:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:36:29.026210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4f9d3-58fe-40d1-b779-2a356b979ffd service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:36:29.038284 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4f9d3-58fe-40d1-b779-2a356b979ffd service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:36:29.043911 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814988c4-cef5-4735-ad4b-741836440e84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906e9835f5c4e709915c6553b41aeff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:36:29.044499 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814988c4-cef5-4735-ad4b-741836440e84 service swift] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:36:29.044775 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814988c4-cef5-4735-ad4b-741836440e84 service swift] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:36:29.045041 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814988c4-cef5-4735-ad4b-741836440e84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:36:29.054543 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814988c4-cef5-4735-ad4b-741836440e84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:36:29.056182 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814988c4-cef5-4735-ad4b-741836440e84 service swift] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:36:29.064535 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1046/2091] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 02:36:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:36:29.916542 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317fb8c-e938-44ec-8879-8d2f0bf09e59 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:36:29.916825 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317fb8c-e938-44ec-8879-8d2f0bf09e59 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:36:29.917314 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317fb8c-e938-44ec-8879-8d2f0bf09e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:36:29.941674 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-1317fb8c-e938-44ec-8879-8d2f0bf09e59 None None] MFA Rules not processed for user `39a3f523d6b244e6a241b891599cfbb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:36:29.943258 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-1317fb8c-e938-44ec-8879-8d2f0bf09e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:36:30.027014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1046/2092] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:36:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:36:39.061072 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=61 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:36:40.020477 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=68 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:36:50.194763 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814988c4-cef5-4735-ad4b-741836440e84 service swift] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:36:50.196225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-814988c4-cef5-4735-ad4b-741836440e84 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:36:50.208274 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814988c4-cef5-4735-ad4b-741836440e84 service swift] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:36:50.211887 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a84f8-e011-49aa-befc-56c136e0649d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:36:50.212480 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a84f8-e011-49aa-befc-56c136e0649d service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:36:50.212757 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a84f8-e011-49aa-befc-56c136e0649d service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:36:50.213025 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a84f8-e011-49aa-befc-56c136e0649d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:36:50.214722 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-329a84f8-e011-49aa-befc-56c136e0649d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:36:50.283800 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a84f8-e011-49aa-befc-56c136e0649d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:36:50.285243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a84f8-e011-49aa-befc-56c136e0649d service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:36:50.296047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1047/2093] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:36:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:36:53.616147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f89c40-4950-43bd-83ca-52de8babcf45 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:36:53.616147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f89c40-4950-43bd-83ca-52de8babcf45 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:36:53.616147 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f89c40-4950-43bd-83ca-52de8babcf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:36:53.633114 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-f0f89c40-4950-43bd-83ca-52de8babcf45 None None] MFA Rules not processed for user `e58cdf090af44b508767e821be2f379f`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:36:53.634304 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-f0f89c40-4950-43bd-83ca-52de8babcf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:36:53.641726 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1047/2094] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 19 02:36:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:36:53.655281 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a84f8-e011-49aa-befc-56c136e0649d service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:36:53.667539 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a84f8-e011-49aa-befc-56c136e0649d service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:36:53.672800 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d8234-06cc-40ae-aa9b-ba23303f2dea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906e9835f5c4e709915c6553b41aeff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:36:53.673425 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d8234-06cc-40ae-aa9b-ba23303f2dea service swift] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:36:53.673696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d8234-06cc-40ae-aa9b-ba23303f2dea service swift] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:36:53.674000 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d8234-06cc-40ae-aa9b-ba23303f2dea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:36:53.683434 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d8234-06cc-40ae-aa9b-ba23303f2dea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:36:53.685000 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d8234-06cc-40ae-aa9b-ba23303f2dea service swift] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:36:53.694208 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1048/2095] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 02:36:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:37:03.627707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:37:03.689813 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=36 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:37:11.066690 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b77c7c-79d6-4d4a-b025-b31d184fccf0 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:37:11.067280 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b77c7c-79d6-4d4a-b025-b31d184fccf0 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:37:11.067280 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b77c7c-79d6-4d4a-b025-b31d184fccf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:37:11.087365 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-09b77c7c-79d6-4d4a-b025-b31d184fccf0 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:37:11.088487 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-09b77c7c-79d6-4d4a-b025-b31d184fccf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:37:11.147735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1048/2096] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Oct 19 02:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:37:11.170955 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d8234-06cc-40ae-aa9b-ba23303f2dea service swift] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:37:11.172502 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-cb3d8234-06cc-40ae-aa9b-ba23303f2dea service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:37:11.188567 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d8234-06cc-40ae-aa9b-ba23303f2dea service swift] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:37:11.194606 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c5755-d264-4ab6-8f57-f90c5b3093c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:37:11.195233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c5755-d264-4ab6-8f57-f90c5b3093c0 service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:37:11.195508 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c5755-d264-4ab6-8f57-f90c5b3093c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:37:11.195785 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c5755-d264-4ab6-8f57-f90c5b3093c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:37:11.203937 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c5755-d264-4ab6-8f57-f90c5b3093c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:37:11.205659 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c5755-d264-4ab6-8f57-f90c5b3093c0 service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:37:11.215679 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1049/2097] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:37:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:37:15.587414 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15c2df-d5f4-477d-8569-ae6a6aa31739 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:37:15.587942 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15c2df-d5f4-477d-8569-ae6a6aa31739 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:37:15.588042 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15c2df-d5f4-477d-8569-ae6a6aa31739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:37:15.607736 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-4d15c2df-d5f4-477d-8569-ae6a6aa31739 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:37:15.608940 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-4d15c2df-d5f4-477d-8569-ae6a6aa31739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:37:15.617115 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1049/2098] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Oct 19 02:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:37:15.640013 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c5755-d264-4ab6-8f57-f90c5b3093c0 service nova] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:37:15.641414 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-654c5755-d264-4ab6-8f57-f90c5b3093c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:37:15.657563 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c5755-d264-4ab6-8f57-f90c5b3093c0 service nova] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:37:15.663251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ea5bd-a0cb-47fb-be36-58f1abab366e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:37:15.663981 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ea5bd-a0cb-47fb-be36-58f1abab366e service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:37:15.664263 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ea5bd-a0cb-47fb-be36-58f1abab366e service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:37:15.664532 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ea5bd-a0cb-47fb-be36-58f1abab366e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:37:15.672958 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ea5bd-a0cb-47fb-be36-58f1abab366e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:37:15.674589 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ea5bd-a0cb-47fb-be36-58f1abab366e service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:37:15.684381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1050/2099] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:37:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:37:19.491277 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45d257-1779-46cf-abc6-a8c9cf0241b3 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:37:19.491747 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45d257-1779-46cf-abc6-a8c9cf0241b3 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:37:19.491862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45d257-1779-46cf-abc6-a8c9cf0241b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:37:19.512891 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-6d45d257-1779-46cf-abc6-a8c9cf0241b3 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:37:19.514098 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-6d45d257-1779-46cf-abc6-a8c9cf0241b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:37:19.522338 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1050/2100] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Oct 19 02:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:37:19.544530 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ea5bd-a0cb-47fb-be36-58f1abab366e service nova] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:37:19.556458 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ea5bd-a0cb-47fb-be36-58f1abab366e service nova] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:37:19.562176 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6edce35-f15f-4163-831e-0cdfffdc30e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:37:19.562771 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edce35-f15f-4163-831e-0cdfffdc30e0 service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:37:19.563077 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edce35-f15f-4163-831e-0cdfffdc30e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:37:19.563347 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edce35-f15f-4163-831e-0cdfffdc30e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:37:19.572298 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6edce35-f15f-4163-831e-0cdfffdc30e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:37:19.573897 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6edce35-f15f-4163-831e-0cdfffdc30e0 service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:37:19.584182 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1051/2101] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:37:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:37:23.766678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bea78-639d-40b8-b116-246094945a9b None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:37:23.767198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bea78-639d-40b8-b116-246094945a9b None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:37:23.767391 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bea78-639d-40b8-b116-246094945a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:37:23.787221 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-774bea78-639d-40b8-b116-246094945a9b None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:37:23.788450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-774bea78-639d-40b8-b116-246094945a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:37:23.796254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1051/2102] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Oct 19 02:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:37:23.819579 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6edce35-f15f-4163-831e-0cdfffdc30e0 service nova] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:37:23.830650 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6edce35-f15f-4163-831e-0cdfffdc30e0 service nova] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:37:23.837127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47702239-8110-4915-a65e-59f094087127 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:37:23.837710 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47702239-8110-4915-a65e-59f094087127 service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:37:23.837981 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47702239-8110-4915-a65e-59f094087127 service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:37:23.838246 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47702239-8110-4915-a65e-59f094087127 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:37:23.846412 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47702239-8110-4915-a65e-59f094087127 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:37:23.848225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47702239-8110-4915-a65e-59f094087127 service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:37:23.857599 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1052/2103] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:37:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:37:29.044768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630538cb-4ed3-4c5b-8161-5c4f0b347a89 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:37:29.045181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630538cb-4ed3-4c5b-8161-5c4f0b347a89 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:37:29.045307 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630538cb-4ed3-4c5b-8161-5c4f0b347a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:37:29.065295 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-630538cb-4ed3-4c5b-8161-5c4f0b347a89 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:37:29.067029 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-630538cb-4ed3-4c5b-8161-5c4f0b347a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:37:29.075236 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1052/2104] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Oct 19 02:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:37:29.097649 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47702239-8110-4915-a65e-59f094087127 service nova] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:37:29.108586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47702239-8110-4915-a65e-59f094087127 service nova] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:37:29.114202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70608274-855d-45fe-80ed-54ac3a0494a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:37:29.114829 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70608274-855d-45fe-80ed-54ac3a0494a3 service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:37:29.115113 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70608274-855d-45fe-80ed-54ac3a0494a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:37:29.115379 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70608274-855d-45fe-80ed-54ac3a0494a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:37:29.124186 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70608274-855d-45fe-80ed-54ac3a0494a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:37:29.125814 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70608274-855d-45fe-80ed-54ac3a0494a3 service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:37:29.135765 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1053/2105] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:37:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:37:33.691152 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630538cb-4ed3-4c5b-8161-5c4f0b347a89 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:37:33.700909 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630538cb-4ed3-4c5b-8161-5c4f0b347a89 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:37:33.704370 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c05595-48bd-4e25-a4f6-ec86ce7f9e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:37:33.704955 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c05595-48bd-4e25-a4f6-ec86ce7f9e63 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:37:33.705231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c05595-48bd-4e25-a4f6-ec86ce7f9e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:37:33.705500 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c05595-48bd-4e25-a4f6-ec86ce7f9e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:37:33.707342 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-35c05595-48bd-4e25-a4f6-ec86ce7f9e63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:37:33.720206 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c05595-48bd-4e25-a4f6-ec86ce7f9e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:37:33.721613 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c05595-48bd-4e25-a4f6-ec86ce7f9e63 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:37:33.732937 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1053/2106] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:37:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:37:34.915899 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70608274-855d-45fe-80ed-54ac3a0494a3 service nova] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:37:34.920287 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=31 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:37:34.926708 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70608274-855d-45fe-80ed-54ac3a0494a3 service nova] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:37:34.930455 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbbc5b-5fdc-4d25-b5df-a6d872a42140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:37:34.931080 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbbc5b-5fdc-4d25-b5df-a6d872a42140 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:37:34.931357 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbbc5b-5fdc-4d25-b5df-a6d872a42140 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:37:34.931625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbbc5b-5fdc-4d25-b5df-a6d872a42140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:37:34.933336 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-d5cbbc5b-5fdc-4d25-b5df-a6d872a42140 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:37:34.946974 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbbc5b-5fdc-4d25-b5df-a6d872a42140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:37:34.948485 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbbc5b-5fdc-4d25-b5df-a6d872a42140 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:37:34.959541 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1054/2107] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:37:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:37:38.814708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2490e-e54e-42ce-b252-dce0d48d99b1 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:37:38.815293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2490e-e54e-42ce-b252-dce0d48d99b1 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:37:38.815293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2490e-e54e-42ce-b252-dce0d48d99b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:37:38.822763 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=46 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:37:38.834717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-f4e2490e-e54e-42ce-b252-dce0d48d99b1 None None] MFA Rules not processed for user `34ba60c6edb94c27bbd01819da05acd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:37:38.839158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-f4e2490e-e54e-42ce-b252-dce0d48d99b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:37:38.891427 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1054/2108] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:37:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:37:44.973831 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=5 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:37:48.884322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=24 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:38:05.937622 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbbc5b-5fdc-4d25-b5df-a6d872a42140 service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:38:05.949139 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbbc5b-5fdc-4d25-b5df-a6d872a42140 service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:38:05.954630 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57efb2e-ea66-4753-afc7-ffe3e9664eac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:38:05.955269 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57efb2e-ea66-4753-afc7-ffe3e9664eac service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:38:05.955543 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57efb2e-ea66-4753-afc7-ffe3e9664eac service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:38:05.955808 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57efb2e-ea66-4753-afc7-ffe3e9664eac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:38:05.957517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-e57efb2e-ea66-4753-afc7-ffe3e9664eac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:38:06.015817 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57efb2e-ea66-4753-afc7-ffe3e9664eac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:38:06.017634 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57efb2e-ea66-4753-afc7-ffe3e9664eac service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:38:06.027226 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1055/2109] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:38:05 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:38:12.448961 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2490e-e54e-42ce-b252-dce0d48d99b1 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:38:12.465512 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2490e-e54e-42ce-b252-dce0d48d99b1 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:38:12.474264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fad0a5-d557-4693-b9c1-f5efedd512a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:38:12.475134 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fad0a5-d557-4693-b9c1-f5efedd512a9 service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:38:12.475516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fad0a5-d557-4693-b9c1-f5efedd512a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:38:12.475889 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fad0a5-d557-4693-b9c1-f5efedd512a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:38:12.477799 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-79fad0a5-d557-4693-b9c1-f5efedd512a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:38:12.493000 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fad0a5-d557-4693-b9c1-f5efedd512a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:38:12.495004 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fad0a5-d557-4693-b9c1-f5efedd512a9 service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:38:12.506530 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1055/2110] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:38:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:38:13.111703 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57efb2e-ea66-4753-afc7-ffe3e9664eac service nova] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:38:13.113848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-e57efb2e-ea66-4753-afc7-ffe3e9664eac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:38:13.131828 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57efb2e-ea66-4753-afc7-ffe3e9664eac service nova] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:38:13.136530 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90d03c-c20e-4f1d-bca2-946aadc64f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:38:13.137166 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90d03c-c20e-4f1d-bca2-946aadc64f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:38:13.137448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90d03c-c20e-4f1d-bca2-946aadc64f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:38:13.137720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90d03c-c20e-4f1d-bca2-946aadc64f55 admin admin] PATH_INFO: `/v3/users/39a3f523d6b244e6a241b891599cfbb9` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:38:13.139560 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90d03c-c20e-4f1d-bca2-946aadc64f55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39a3f523d6b244e6a241b891599cfbb9)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:38:13.141515 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90d03c-c20e-4f1d-bca2-946aadc64f55 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:38:13.338112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-8d90d03c-c20e-4f1d-bca2-946aadc64f55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39a3f523d6b244e6a241b891599cfbb9'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:38:13.338981 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-8d90d03c-c20e-4f1d-bca2-946aadc64f55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39a3f523d6b244e6a241b891599cfbb9'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:38:13.423596 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-8d90d03c-c20e-4f1d-bca2-946aadc64f55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39a3f523d6b244e6a241b891599cfbb9'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:38:13.431819 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-8d90d03c-c20e-4f1d-bca2-946aadc64f55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39a3f523d6b244e6a241b891599cfbb9'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:38:13.432515 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-8d90d03c-c20e-4f1d-bca2-946aadc64f55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39a3f523d6b244e6a241b891599cfbb9'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:38:13.455925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1056/2111] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:38:13 2022] DELETE /identity/v3/users/39a3f523d6b244e6a241b891599cfbb9 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:38:13.727872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fad0a5-d557-4693-b9c1-f5efedd512a9 service nova] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:38:13.763976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fad0a5-d557-4693-b9c1-f5efedd512a9 service nova] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:38:13.840799 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e75e5-a084-48ce-a87c-f7475cc74b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:38:13.841480 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e75e5-a084-48ce-a87c-f7475cc74b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:38:13.842246 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e75e5-a084-48ce-a87c-f7475cc74b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:38:13.842576 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e75e5-a084-48ce-a87c-f7475cc74b9f admin admin] PATH_INFO: `/v3/projects/0ad9dc77d6ea4e7790a8093539b51cd7` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:38:13.843737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e75e5-a084-48ce-a87c-f7475cc74b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ad9dc77d6ea4e7790a8093539b51cd7)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:38:13.845890 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e75e5-a084-48ce-a87c-f7475cc74b9f admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:38:13.995077 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-4a5e75e5-a084-48ce-a87c-f7475cc74b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ad9dc77d6ea4e7790a8093539b51cd7', 'request_id': 'req-4a5e75e5-a084-48ce-a87c-f7475cc74b9f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:38:14.000630 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-4a5e75e5-a084-48ce-a87c-f7475cc74b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ad9dc77d6ea4e7790a8093539b51cd7', 'request_id': 'req-4a5e75e5-a084-48ce-a87c-f7475cc74b9f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:38:14.147035 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-4a5e75e5-a084-48ce-a87c-f7475cc74b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ad9dc77d6ea4e7790a8093539b51cd7', 'request_id': 'req-4a5e75e5-a084-48ce-a87c-f7475cc74b9f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:38:14.160031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-4a5e75e5-a084-48ce-a87c-f7475cc74b9f admin admin] The token cache is being invalidate because project 0ad9dc77d6ea4e7790a8093539b51cd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:38:14.160563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-4a5e75e5-a084-48ce-a87c-f7475cc74b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:38:14.161443 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-4a5e75e5-a084-48ce-a87c-f7475cc74b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:38:14.162982 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1056/2112] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:38:13 2022] DELETE /identity/v3/projects/0ad9dc77d6ea4e7790a8093539b51cd7 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:38:17.520870 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1974e16-de39-4d2f-bb16-94d7bda8ce88 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:38:17.524101 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1974e16-de39-4d2f-bb16-94d7bda8ce88 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:38:17.524101 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1974e16-de39-4d2f-bb16-94d7bda8ce88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:38:17.541390 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-c1974e16-de39-4d2f-bb16-94d7bda8ce88 None None] MFA Rules not processed for user `5eabc00f209a48f88e8e2ca28dd3e8df`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:38:17.542615 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c1974e16-de39-4d2f-bb16-94d7bda8ce88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:38:17.597453 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1057/2113] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:38:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:38:17.899296 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e75e5-a084-48ce-a87c-f7475cc74b9f admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:38:17.900752 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-4a5e75e5-a084-48ce-a87c-f7475cc74b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:38:17.957043 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e75e5-a084-48ce-a87c-f7475cc74b9f admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:38:17.960622 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25be20-20e6-4f3a-9120-62aa29e818ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:38:17.961241 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25be20-20e6-4f3a-9120-62aa29e818ad service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:38:17.961547 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25be20-20e6-4f3a-9120-62aa29e818ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:38:17.961820 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25be20-20e6-4f3a-9120-62aa29e818ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:38:17.963515 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-1f25be20-20e6-4f3a-9120-62aa29e818ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:38:17.972978 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25be20-20e6-4f3a-9120-62aa29e818ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:38:17.974403 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25be20-20e6-4f3a-9120-62aa29e818ad service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:38:17.982278 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1057/2114] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:38:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:38:18.408592 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1974e16-de39-4d2f-bb16-94d7bda8ce88 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:38:18.410037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c1974e16-de39-4d2f-bb16-94d7bda8ce88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:38:18.429371 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:38:18.484576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1974e16-de39-4d2f-bb16-94d7bda8ce88 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:38:18.489549 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d9c9e-0d35-4df4-94f1-aa4c7c19d7b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66b9bc695b44877a06f17ea6bbeb27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:38:18.490150 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d9c9e-0d35-4df4-94f1-aa4c7c19d7b9 service placement] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:38:18.490422 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d9c9e-0d35-4df4-94f1-aa4c7c19d7b9 service placement] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:38:18.490690 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d9c9e-0d35-4df4-94f1-aa4c7c19d7b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:38:18.492428 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-124d9c9e-0d35-4df4-94f1-aa4c7c19d7b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:38:18.504791 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d9c9e-0d35-4df4-94f1-aa4c7c19d7b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:38:18.506370 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d9c9e-0d35-4df4-94f1-aa4c7c19d7b9 service placement] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:38:18.517223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1058/2115] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:38:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:38:22.156150 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25be20-20e6-4f3a-9120-62aa29e818ad service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:38:22.164859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25be20-20e6-4f3a-9120-62aa29e818ad service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:38:22.168521 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3edb7-4a82-49db-882f-b7de490daaeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:38:22.169110 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3edb7-4a82-49db-882f-b7de490daaeb service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:38:22.169387 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3edb7-4a82-49db-882f-b7de490daaeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:38:22.170187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3edb7-4a82-49db-882f-b7de490daaeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:38:22.172010 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-3cb3edb7-4a82-49db-882f-b7de490daaeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:38:22.181426 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3edb7-4a82-49db-882f-b7de490daaeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:38:22.182954 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3edb7-4a82-49db-882f-b7de490daaeb service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:38:22.192045 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1058/2116] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:38:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:38:28.542648 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=25 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:38:31.066113 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d9c9e-0d35-4df4-94f1-aa4c7c19d7b9 service placement] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:38:31.067638 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-124d9c9e-0d35-4df4-94f1-aa4c7c19d7b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:38:31.146982 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d9c9e-0d35-4df4-94f1-aa4c7c19d7b9 service placement] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:38:31.152813 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae94ea3-d1b7-4be4-8140-e532af7c7460 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:38:31.153441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae94ea3-d1b7-4be4-8140-e532af7c7460 service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:38:31.153715 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae94ea3-d1b7-4be4-8140-e532af7c7460 service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:38:31.154062 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae94ea3-d1b7-4be4-8140-e532af7c7460 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:38:31.156115 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-eae94ea3-d1b7-4be4-8140-e532af7c7460 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:38:31.173472 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae94ea3-d1b7-4be4-8140-e532af7c7460 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:38:31.175769 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae94ea3-d1b7-4be4-8140-e532af7c7460 service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:38:31.188404 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1059/2117] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:38:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:38:32.067679 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3edb7-4a82-49db-882f-b7de490daaeb service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:38:32.069060 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-3cb3edb7-4a82-49db-882f-b7de490daaeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:38:32.079766 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:38:32.126865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3edb7-4a82-49db-882f-b7de490daaeb service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:38:32.130494 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71e492-caeb-46d9-a8d0-b31462b537a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:38:32.131121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71e492-caeb-46d9-a8d0-b31462b537a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:38:32.131402 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71e492-caeb-46d9-a8d0-b31462b537a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:38:32.131675 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71e492-caeb-46d9-a8d0-b31462b537a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:38:32.133438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-ab71e492-caeb-46d9-a8d0-b31462b537a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:38:32.193920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71e492-caeb-46d9-a8d0-b31462b537a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:38:32.195385 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71e492-caeb-46d9-a8d0-b31462b537a0 service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:38:32.205720 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1059/2118] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:38:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:38:41.182660 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=34 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:38:42.157837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152caac8-84bf-454b-af56-3e3682e57e5d None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:38:42.158117 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152caac8-84bf-454b-af56-3e3682e57e5d None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:38:42.158397 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152caac8-84bf-454b-af56-3e3682e57e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:38:42.178286 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-152caac8-84bf-454b-af56-3e3682e57e5d None None] MFA Rules not processed for user `4e5c1ceb415a47fb81c7226508f011ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:38:42.179587 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-152caac8-84bf-454b-af56-3e3682e57e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:38:42.187802 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1060/2119] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:38:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:38:42.219233 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=45 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:38:42.500532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71e492-caeb-46d9-a8d0-b31462b537a0 service cinder] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:38:42.510041 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71e492-caeb-46d9-a8d0-b31462b537a0 service cinder] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:38:42.513809 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2814a-af3d-4f73-b7eb-d0c61a47ff2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:38:42.514455 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2814a-af3d-4f73-b7eb-d0c61a47ff2a service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:38:42.514980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2814a-af3d-4f73-b7eb-d0c61a47ff2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:38:42.515441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2814a-af3d-4f73-b7eb-d0c61a47ff2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:38:42.517254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-c8f2814a-af3d-4f73-b7eb-d0c61a47ff2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:38:42.527120 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2814a-af3d-4f73-b7eb-d0c61a47ff2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:38:42.528547 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2814a-af3d-4f73-b7eb-d0c61a47ff2a service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:38:42.537518 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1060/2120] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:38:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:38:43.071535 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152caac8-84bf-454b-af56-3e3682e57e5d None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:38:43.081160 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152caac8-84bf-454b-af56-3e3682e57e5d None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:38:43.084671 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e4810-22ec-4f92-9eeb-7016405dbf1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:38:43.085259 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e4810-22ec-4f92-9eeb-7016405dbf1e service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:38:43.085536 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e4810-22ec-4f92-9eeb-7016405dbf1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:38:43.085805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e4810-22ec-4f92-9eeb-7016405dbf1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:38:43.087538 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-750e4810-22ec-4f92-9eeb-7016405dbf1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:38:43.147089 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e4810-22ec-4f92-9eeb-7016405dbf1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:38:43.148593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e4810-22ec-4f92-9eeb-7016405dbf1e service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:38:43.158102 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1061/2121] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:38:43 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:38:52.533692 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=6 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:38:53.153535 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=31 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:39:09.601471 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2814a-af3d-4f73-b7eb-d0c61a47ff2a service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:39:09.614370 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2814a-af3d-4f73-b7eb-d0c61a47ff2a service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:39:09.618219 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0575b2-8b51-46e4-921b-f6da9b5a4a2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:39:09.618874 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0575b2-8b51-46e4-921b-f6da9b5a4a2b service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:39:09.619153 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0575b2-8b51-46e4-921b-f6da9b5a4a2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:39:09.619427 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0575b2-8b51-46e4-921b-f6da9b5a4a2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:39:09.621433 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-8a0575b2-8b51-46e4-921b-f6da9b5a4a2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:39:09.752959 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0575b2-8b51-46e4-921b-f6da9b5a4a2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:39:09.754633 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0575b2-8b51-46e4-921b-f6da9b5a4a2b service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:39:09.774861 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1061/2122] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:39:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:39:14.774080 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e4810-22ec-4f92-9eeb-7016405dbf1e service cinder] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:39:14.815483 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e4810-22ec-4f92-9eeb-7016405dbf1e service cinder] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:39:14.820568 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d27654-14ed-402c-8d46-e0725d82ac61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66b9bc695b44877a06f17ea6bbeb27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:39:14.821236 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d27654-14ed-402c-8d46-e0725d82ac61 service placement] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:39:14.821516 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d27654-14ed-402c-8d46-e0725d82ac61 service placement] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:39:14.822040 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d27654-14ed-402c-8d46-e0725d82ac61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:39:14.823945 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-24d27654-14ed-402c-8d46-e0725d82ac61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:39:14.837006 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d27654-14ed-402c-8d46-e0725d82ac61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:39:14.838608 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d27654-14ed-402c-8d46-e0725d82ac61 service placement] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:39:14.849306 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1062/2123] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:39:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:39:14.910683 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0575b2-8b51-46e4-921b-f6da9b5a4a2b service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:39:14.912221 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-8a0575b2-8b51-46e4-921b-f6da9b5a4a2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:39:14.926177 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0575b2-8b51-46e4-921b-f6da9b5a4a2b service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:39:14.931190 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67df85a-b893-4e20-990e-162bb2c129c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:39:14.931842 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67df85a-b893-4e20-990e-162bb2c129c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:39:14.932125 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67df85a-b893-4e20-990e-162bb2c129c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:39:14.932454 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67df85a-b893-4e20-990e-162bb2c129c9 admin admin] PATH_INFO: `/v3/users/34ba60c6edb94c27bbd01819da05acd2` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:39:14.933603 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67df85a-b893-4e20-990e-162bb2c129c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34ba60c6edb94c27bbd01819da05acd2)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:39:14.936386 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67df85a-b893-4e20-990e-162bb2c129c9 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:39:15.172228 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e67df85a-b893-4e20-990e-162bb2c129c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34ba60c6edb94c27bbd01819da05acd2'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:15.172872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e67df85a-b893-4e20-990e-162bb2c129c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34ba60c6edb94c27bbd01819da05acd2'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:15.245607 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e67df85a-b893-4e20-990e-162bb2c129c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34ba60c6edb94c27bbd01819da05acd2'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:15.261062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e67df85a-b893-4e20-990e-162bb2c129c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34ba60c6edb94c27bbd01819da05acd2'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:15.262941 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e67df85a-b893-4e20-990e-162bb2c129c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34ba60c6edb94c27bbd01819da05acd2'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:15.275934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1062/2124] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:39:14 2022] DELETE /identity/v3/users/34ba60c6edb94c27bbd01819da05acd2 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:39:15.521170 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d27654-14ed-402c-8d46-e0725d82ac61 service placement] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:39:15.533050 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d27654-14ed-402c-8d46-e0725d82ac61 service placement] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:39:15.590291 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bb93f-6f84-4178-a629-b000f9413a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:39:15.590961 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bb93f-6f84-4178-a629-b000f9413a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:39:15.591241 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bb93f-6f84-4178-a629-b000f9413a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:39:15.591514 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bb93f-6f84-4178-a629-b000f9413a1f admin admin] PATH_INFO: `/v3/projects/e555f689df1f4700897e7e501dc49f7e` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:39:15.592615 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bb93f-6f84-4178-a629-b000f9413a1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e555f689df1f4700897e7e501dc49f7e)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:39:15.595207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bb93f-6f84-4178-a629-b000f9413a1f admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:39:15.714741 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a35bb93f-6f84-4178-a629-b000f9413a1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e555f689df1f4700897e7e501dc49f7e', 'request_id': 'req-a35bb93f-6f84-4178-a629-b000f9413a1f'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:15.720880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a35bb93f-6f84-4178-a629-b000f9413a1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e555f689df1f4700897e7e501dc49f7e', 'request_id': 'req-a35bb93f-6f84-4178-a629-b000f9413a1f'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:15.727585 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a35bb93f-6f84-4178-a629-b000f9413a1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e555f689df1f4700897e7e501dc49f7e', 'request_id': 'req-a35bb93f-6f84-4178-a629-b000f9413a1f'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:15.838904 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a35bb93f-6f84-4178-a629-b000f9413a1f admin admin] The token cache is being invalidate because project e555f689df1f4700897e7e501dc49f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:39:15.839490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a35bb93f-6f84-4178-a629-b000f9413a1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:15.839828 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a35bb93f-6f84-4178-a629-b000f9413a1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:15.841476 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1063/2125] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:39:15 2022] DELETE /identity/v3/projects/e555f689df1f4700897e7e501dc49f7e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:39:15.847266 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a377de-5537-456e-815e-dd5f3e95fbcb None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:39:15.847580 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a377de-5537-456e-815e-dd5f3e95fbcb None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:39:15.847859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a377de-5537-456e-815e-dd5f3e95fbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:39:15.856607 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:39:15.876984 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-22a377de-5537-456e-815e-dd5f3e95fbcb None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:39:15.878229 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-22a377de-5537-456e-815e-dd5f3e95fbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:39:15.939256 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1063/2126] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:39:15.947267 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf72790-3fd4-4568-be4a-e8aaeaba9c11 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:39:15.947545 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf72790-3fd4-4568-be4a-e8aaeaba9c11 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:39:15.947813 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf72790-3fd4-4568-be4a-e8aaeaba9c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:39:15.970325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-ccf72790-3fd4-4568-be4a-e8aaeaba9c11 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:39:15.971544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ccf72790-3fd4-4568-be4a-e8aaeaba9c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:39:15.979347 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1064/2127] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:39:15.983757 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a377de-5537-456e-815e-dd5f3e95fbcb None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:39:15.993655 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a377de-5537-456e-815e-dd5f3e95fbcb None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:39:15.998323 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c233258-fd3f-4703-8a0b-b5b2a014dff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:39:15.998991 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c233258-fd3f-4703-8a0b-b5b2a014dff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:39:15.999282 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c233258-fd3f-4703-8a0b-b5b2a014dff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:39:15.999558 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c233258-fd3f-4703-8a0b-b5b2a014dff0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:39:16.000216 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c233258-fd3f-4703-8a0b-b5b2a014dff0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:39:16.000523 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c233258-fd3f-4703-8a0b-b5b2a014dff0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:39:16.002160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c233258-fd3f-4703-8a0b-b5b2a014dff0 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:39:16.013640 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1064/2128] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:39:16.018501 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf72790-3fd4-4568-be4a-e8aaeaba9c11 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:39:16.027585 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf72790-3fd4-4568-be4a-e8aaeaba9c11 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:39:16.032837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec7179-cde6-4746-a6fd-170d7e2578fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:39:16.033420 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec7179-cde6-4746-a6fd-170d7e2578fc admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:39:16.033691 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec7179-cde6-4746-a6fd-170d7e2578fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:39:16.033958 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec7179-cde6-4746-a6fd-170d7e2578fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:39:16.034590 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec7179-cde6-4746-a6fd-170d7e2578fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:39:16.036506 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec7179-cde6-4746-a6fd-170d7e2578fc admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:39:16.115343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1065/2129] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:39:16 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:39:16.119861 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c233258-fd3f-4703-8a0b-b5b2a014dff0 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:39:16.130123 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c233258-fd3f-4703-8a0b-b5b2a014dff0 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:39:16.186768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa650a-6f11-4b1a-90ca-52e81276c442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:39:16.187402 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa650a-6f11-4b1a-90ca-52e81276c442 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:39:16.187682 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa650a-6f11-4b1a-90ca-52e81276c442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:39:16.187959 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa650a-6f11-4b1a-90ca-52e81276c442 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:39:16.188603 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa650a-6f11-4b1a-90ca-52e81276c442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:39:16.190533 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa650a-6f11-4b1a-90ca-52e81276c442 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:39:16.337710 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1065/2130] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:39:16 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:39:16.341734 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec7179-cde6-4746-a6fd-170d7e2578fc admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:39:16.352277 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec7179-cde6-4746-a6fd-170d7e2578fc admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:39:16.356884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03dca4-2b69-43d0-9d30-ebc813107eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:39:16.357477 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03dca4-2b69-43d0-9d30-ebc813107eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:39:16.357754 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03dca4-2b69-43d0-9d30-ebc813107eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:39:16.358022 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03dca4-2b69-43d0-9d30-ebc813107eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:39:16.358722 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03dca4-2b69-43d0-9d30-ebc813107eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:39:16.360522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03dca4-2b69-43d0-9d30-ebc813107eb0 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:39:16.374642 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1066/2131] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:39:16.375867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa650a-6f11-4b1a-90ca-52e81276c442 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:39:16.386276 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa650a-6f11-4b1a-90ca-52e81276c442 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:39:16.392192 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64a1fd-ae00-4c86-b4d5-d8210f06c6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:39:16.393679 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64a1fd-ae00-4c86-b4d5-d8210f06c6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:39:16.393679 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64a1fd-ae00-4c86-b4d5-d8210f06c6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:39:16.393679 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64a1fd-ae00-4c86-b4d5-d8210f06c6d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:39:16.393935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64a1fd-ae00-4c86-b4d5-d8210f06c6d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:39:16.395569 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64a1fd-ae00-4c86-b4d5-d8210f06c6d3 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:39:16.406588 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1066/2132] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:39:16.411110 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03dca4-2b69-43d0-9d30-ebc813107eb0 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:39:16.421593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03dca4-2b69-43d0-9d30-ebc813107eb0 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:39:16.426844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54103636-a738-4f34-878c-c19e23945b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:39:16.427505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54103636-a738-4f34-878c-c19e23945b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:39:16.433296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54103636-a738-4f34-878c-c19e23945b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:39:16.433296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54103636-a738-4f34-878c-c19e23945b75 admin admin] PATH_INFO: `/v3/projects/af203f2a6e1b46f88c2da83f1d224897/users/0e81138fb66c448cb56375eacd407a6c/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:39:16.444471 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54103636-a738-4f34-878c-c19e23945b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af203f2a6e1b46f88c2da83f1d224897, user_id=0e81138fb66c448cb56375eacd407a6c, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:39:16.447481 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54103636-a738-4f34-878c-c19e23945b75 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:39:16.450737 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:39:16.593948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1067/2133] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:39:16 2022] PUT /identity/v3/projects/af203f2a6e1b46f88c2da83f1d224897/users/0e81138fb66c448cb56375eacd407a6c/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:39:16.599162 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd451d-a552-402f-8f7a-9439273ab01f None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:39:16.599449 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd451d-a552-402f-8f7a-9439273ab01f None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:39:16.599725 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd451d-a552-402f-8f7a-9439273ab01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:39:16.621303 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-33dd451d-a552-402f-8f7a-9439273ab01f None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:39:16.622709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-33dd451d-a552-402f-8f7a-9439273ab01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:39:16.682738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1067/2134] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:39:16.692976 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54103636-a738-4f34-878c-c19e23945b75 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:39:16.694710 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-54103636-a738-4f34-878c-c19e23945b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:39:16.752267 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54103636-a738-4f34-878c-c19e23945b75 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:39:16.756617 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2c2a1-3103-45db-8a5b-1f77ed60fe42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:39:16.757250 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2c2a1-3103-45db-8a5b-1f77ed60fe42 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:39:16.757550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2c2a1-3103-45db-8a5b-1f77ed60fe42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:39:16.757826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2c2a1-3103-45db-8a5b-1f77ed60fe42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:39:16.767930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2c2a1-3103-45db-8a5b-1f77ed60fe42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:39:16.769359 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2c2a1-3103-45db-8a5b-1f77ed60fe42 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:39:16.778696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1068/2135] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:39:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:39:20.153509 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319315b5-c842-4595-9948-043ce5c94ff5 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:39:20.158504 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319315b5-c842-4595-9948-043ce5c94ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:39:20.158504 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319315b5-c842-4595-9948-043ce5c94ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:39:20.165322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:39:20.177198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-319315b5-c842-4595-9948-043ce5c94ff5 None None] MFA Rules not processed for user `e58cdf090af44b508767e821be2f379f`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:39:20.178525 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-319315b5-c842-4595-9948-043ce5c94ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:39:20.255903 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1068/2136] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 19 02:39:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:39:20.419211 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2c2a1-3103-45db-8a5b-1f77ed60fe42 service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:39:20.421507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-79a2c2a1-3103-45db-8a5b-1f77ed60fe42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:39:20.502942 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2c2a1-3103-45db-8a5b-1f77ed60fe42 service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:39:20.508353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea3bb1-037c-41a5-b685-eac6b6caf27c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906e9835f5c4e709915c6553b41aeff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:39:20.508901 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea3bb1-037c-41a5-b685-eac6b6caf27c service swift] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:39:20.509177 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea3bb1-037c-41a5-b685-eac6b6caf27c service swift] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:39:20.509444 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea3bb1-037c-41a5-b685-eac6b6caf27c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:39:20.520284 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea3bb1-037c-41a5-b685-eac6b6caf27c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:39:20.521914 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea3bb1-037c-41a5-b685-eac6b6caf27c service swift] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:39:20.531638 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1069/2137] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 02:39:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:39:22.534224 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd25d28-2d40-4a47-9c83-c51b98633d72 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:39:22.534698 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd25d28-2d40-4a47-9c83-c51b98633d72 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:39:22.534800 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd25d28-2d40-4a47-9c83-c51b98633d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:39:22.569181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-efd25d28-2d40-4a47-9c83-c51b98633d72 None None] MFA Rules not processed for user `0e81138fb66c448cb56375eacd407a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:39:22.570432 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-efd25d28-2d40-4a47-9c83-c51b98633d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:39:22.663414 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1069/2138] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:39:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:39:22.679049 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea3bb1-037c-41a5-b685-eac6b6caf27c service swift] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:39:22.680491 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-65ea3bb1-037c-41a5-b685-eac6b6caf27c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:39:22.776030 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea3bb1-037c-41a5-b685-eac6b6caf27c service swift] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:39:22.782061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75f546-7b20-4824-a98e-fefbe7b0934d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:39:22.782686 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75f546-7b20-4824-a98e-fefbe7b0934d service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:39:22.783009 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75f546-7b20-4824-a98e-fefbe7b0934d service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:39:22.783283 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75f546-7b20-4824-a98e-fefbe7b0934d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:39:22.792273 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75f546-7b20-4824-a98e-fefbe7b0934d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:39:22.794328 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75f546-7b20-4824-a98e-fefbe7b0934d service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:39:22.806045 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1070/2139] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:39:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:39:26.075190 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd25d28-2d40-4a47-9c83-c51b98633d72 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:39:26.076675 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-efd25d28-2d40-4a47-9c83-c51b98633d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:39:26.090794 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d460fe-da2f-4cf6-bb06-27dea23dff3a None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:39:26.092730 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d460fe-da2f-4cf6-bb06-27dea23dff3a None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:39:26.093457 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d460fe-da2f-4cf6-bb06-27dea23dff3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:39:26.137725 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-b3d460fe-da2f-4cf6-bb06-27dea23dff3a None None] MFA Rules not processed for user `0e81138fb66c448cb56375eacd407a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:39:26.139542 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-b3d460fe-da2f-4cf6-bb06-27dea23dff3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:39:26.174892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1071/2140] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:39:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:39:26.182284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd25d28-2d40-4a47-9c83-c51b98633d72 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:39:26.188708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd94cd-c67f-4aa4-ae57-79cd663d45ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66b9bc695b44877a06f17ea6bbeb27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:39:26.189584 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd94cd-c67f-4aa4-ae57-79cd663d45ad service placement] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:39:26.190025 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd94cd-c67f-4aa4-ae57-79cd663d45ad service placement] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:39:26.190446 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd94cd-c67f-4aa4-ae57-79cd663d45ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:39:26.193261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-67cd94cd-c67f-4aa4-ae57-79cd663d45ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:39:26.236311 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd94cd-c67f-4aa4-ae57-79cd663d45ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:39:26.238345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd94cd-c67f-4aa4-ae57-79cd663d45ad service placement] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:39:26.261838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1070/2141] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:39:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:39:30.550525 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d460fe-da2f-4cf6-bb06-27dea23dff3a None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:39:30.552016 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-b3d460fe-da2f-4cf6-bb06-27dea23dff3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:39:30.566463 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d460fe-da2f-4cf6-bb06-27dea23dff3a None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:39:30.572466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697afa11-f458-4ec3-b8c1-bc1f36277743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:39:30.573106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697afa11-f458-4ec3-b8c1-bc1f36277743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:39:30.573380 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697afa11-f458-4ec3-b8c1-bc1f36277743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:39:30.573645 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697afa11-f458-4ec3-b8c1-bc1f36277743 admin admin] PATH_INFO: `/v3/users/e56c6e02cba541888589acd0732bfaa7` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:39:30.574769 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697afa11-f458-4ec3-b8c1-bc1f36277743 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e56c6e02cba541888589acd0732bfaa7)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:39:30.576790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697afa11-f458-4ec3-b8c1-bc1f36277743 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:39:30.579483 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:39:30.784048 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-697afa11-f458-4ec3-b8c1-bc1f36277743 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e56c6e02cba541888589acd0732bfaa7'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:30.784619 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-697afa11-f458-4ec3-b8c1-bc1f36277743 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e56c6e02cba541888589acd0732bfaa7'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:30.874008 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-697afa11-f458-4ec3-b8c1-bc1f36277743 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e56c6e02cba541888589acd0732bfaa7'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:30.882691 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-697afa11-f458-4ec3-b8c1-bc1f36277743 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e56c6e02cba541888589acd0732bfaa7'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:30.883524 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-697afa11-f458-4ec3-b8c1-bc1f36277743 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e56c6e02cba541888589acd0732bfaa7'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:30.905091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1072/2142] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:39:30 2022] DELETE /identity/v3/users/e56c6e02cba541888589acd0732bfaa7 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:39:31.366908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd94cd-c67f-4aa4-ae57-79cd663d45ad service placement] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:39:31.378282 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd94cd-c67f-4aa4-ae57-79cd663d45ad service placement] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:39:31.408533 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:39:31.441894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696083bf-a476-4407-af36-f10e6c6ed6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:39:31.442535 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696083bf-a476-4407-af36-f10e6c6ed6c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:39:31.442832 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696083bf-a476-4407-af36-f10e6c6ed6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:39:31.443120 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696083bf-a476-4407-af36-f10e6c6ed6c4 admin admin] PATH_INFO: `/v3/projects/5d8bb704c20b4acaa4ec593839c9275a` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:39:31.444293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696083bf-a476-4407-af36-f10e6c6ed6c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d8bb704c20b4acaa4ec593839c9275a)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:39:31.446212 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696083bf-a476-4407-af36-f10e6c6ed6c4 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:39:31.609165 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-696083bf-a476-4407-af36-f10e6c6ed6c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d8bb704c20b4acaa4ec593839c9275a', 'request_id': 'req-696083bf-a476-4407-af36-f10e6c6ed6c4'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:31.617019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-696083bf-a476-4407-af36-f10e6c6ed6c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d8bb704c20b4acaa4ec593839c9275a', 'request_id': 'req-696083bf-a476-4407-af36-f10e6c6ed6c4'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:31.725391 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-696083bf-a476-4407-af36-f10e6c6ed6c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d8bb704c20b4acaa4ec593839c9275a', 'request_id': 'req-696083bf-a476-4407-af36-f10e6c6ed6c4'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:31.739254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-696083bf-a476-4407-af36-f10e6c6ed6c4 admin admin] The token cache is being invalidate because project 5d8bb704c20b4acaa4ec593839c9275a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:39:31.739486 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-696083bf-a476-4407-af36-f10e6c6ed6c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:31.740153 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-696083bf-a476-4407-af36-f10e6c6ed6c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:31.741756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1071/2143] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:39:31 2022] DELETE /identity/v3/projects/5d8bb704c20b4acaa4ec593839c9275a => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:39:31.745879 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697afa11-f458-4ec3-b8c1-bc1f36277743 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:39:31.747402 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-697afa11-f458-4ec3-b8c1-bc1f36277743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:39:31.760987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697afa11-f458-4ec3-b8c1-bc1f36277743 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:39:31.826479 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caec78b-d43b-427f-a33a-5d345a34b5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:39:31.827282 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caec78b-d43b-427f-a33a-5d345a34b5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:39:31.827632 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caec78b-d43b-427f-a33a-5d345a34b5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:39:31.827977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caec78b-d43b-427f-a33a-5d345a34b5dd admin admin] PATH_INFO: `/v3/users/48f94027d551424d901af1e818ba3df0` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:39:31.831151 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caec78b-d43b-427f-a33a-5d345a34b5dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=48f94027d551424d901af1e818ba3df0)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:39:31.832977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caec78b-d43b-427f-a33a-5d345a34b5dd admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:39:31.981243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-0caec78b-d43b-427f-a33a-5d345a34b5dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48f94027d551424d901af1e818ba3df0'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:31.981902 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-0caec78b-d43b-427f-a33a-5d345a34b5dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48f94027d551424d901af1e818ba3df0'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:32.028327 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-0caec78b-d43b-427f-a33a-5d345a34b5dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48f94027d551424d901af1e818ba3df0'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:32.042951 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-0caec78b-d43b-427f-a33a-5d345a34b5dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48f94027d551424d901af1e818ba3df0'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:32.043687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-0caec78b-d43b-427f-a33a-5d345a34b5dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48f94027d551424d901af1e818ba3df0'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:32.057903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:39:32.063445 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1073/2144] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:39:31 2022] DELETE /identity/v3/users/48f94027d551424d901af1e818ba3df0 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:39:32.367182 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696083bf-a476-4407-af36-f10e6c6ed6c4 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:39:32.368673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-696083bf-a476-4407-af36-f10e6c6ed6c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:39:32.381971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696083bf-a476-4407-af36-f10e6c6ed6c4 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:39:32.448335 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f059d-f2e4-479f-ba15-7df7bd1cef77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:39:32.448970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f059d-f2e4-479f-ba15-7df7bd1cef77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:39:32.449248 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f059d-f2e4-479f-ba15-7df7bd1cef77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:39:32.449519 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f059d-f2e4-479f-ba15-7df7bd1cef77 admin admin] PATH_INFO: `/v3/projects/dc8953bf829e41dd9b00f1c64d4ac020` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:39:32.450669 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f059d-f2e4-479f-ba15-7df7bd1cef77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc8953bf829e41dd9b00f1c64d4ac020)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:39:32.452619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f059d-f2e4-479f-ba15-7df7bd1cef77 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:39:32.601138 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0e6f059d-f2e4-479f-ba15-7df7bd1cef77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc8953bf829e41dd9b00f1c64d4ac020', 'request_id': 'req-0e6f059d-f2e4-479f-ba15-7df7bd1cef77'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:32.607041 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0e6f059d-f2e4-479f-ba15-7df7bd1cef77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc8953bf829e41dd9b00f1c64d4ac020', 'request_id': 'req-0e6f059d-f2e4-479f-ba15-7df7bd1cef77'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:32.611039 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:39:32.748641 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0e6f059d-f2e4-479f-ba15-7df7bd1cef77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc8953bf829e41dd9b00f1c64d4ac020', 'request_id': 'req-0e6f059d-f2e4-479f-ba15-7df7bd1cef77'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:32.761240 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0e6f059d-f2e4-479f-ba15-7df7bd1cef77 admin admin] The token cache is being invalidate because project dc8953bf829e41dd9b00f1c64d4ac020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:39:32.761544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0e6f059d-f2e4-479f-ba15-7df7bd1cef77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:32.762291 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0e6f059d-f2e4-479f-ba15-7df7bd1cef77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:39:32.763874 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1072/2145] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:39:32 2022] DELETE /identity/v3/projects/dc8953bf829e41dd9b00f1c64d4ac020 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:39:42.325124 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:39:42.891448 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:DELETE=1,keystone:SELECT=4 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:40:13.218868 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb8586-9855-4897-8359-e8ff83315a06 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:40:13.219340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb8586-9855-4897-8359-e8ff83315a06 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:40:13.219447 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb8586-9855-4897-8359-e8ff83315a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:40:13.239961 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-c4fb8586-9855-4897-8359-e8ff83315a06 None None] MFA Rules not processed for user `e58cdf090af44b508767e821be2f379f`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:40:13.241160 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c4fb8586-9855-4897-8359-e8ff83315a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:40:13.297041 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1074/2146] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 02:40:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:40:13.309286 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f059d-f2e4-479f-ba15-7df7bd1cef77 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:40:13.310962 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-0e6f059d-f2e4-479f-ba15-7df7bd1cef77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:40:13.385430 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f059d-f2e4-479f-ba15-7df7bd1cef77 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:40:13.390531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984335f-54fc-45b3-b8d6-bb775fc88010 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906e9835f5c4e709915c6553b41aeff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:40:13.391205 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984335f-54fc-45b3-b8d6-bb775fc88010 service swift] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:40:13.391486 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984335f-54fc-45b3-b8d6-bb775fc88010 service swift] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:40:13.391761 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984335f-54fc-45b3-b8d6-bb775fc88010 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:40:13.402355 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984335f-54fc-45b3-b8d6-bb775fc88010 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:40:13.404006 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984335f-54fc-45b3-b8d6-bb775fc88010 service swift] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:40:13.413197 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1073/2147] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 02:40:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:40:23.290805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=25 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:40:23.409034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=32 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:40:32.612631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccab84-459d-4411-b1be-c1f0f5d8f951 None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:40:32.613136 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccab84-459d-4411-b1be-c1f0f5d8f951 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:40:32.613299 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccab84-459d-4411-b1be-c1f0f5d8f951 None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:40:32.615586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1075/2148] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 19 02:40:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:40:32.621778 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41778d5-e9f1-4b76-95b0-d0f250418c7c None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:40:32.624954 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41778d5-e9f1-4b76-95b0-d0f250418c7c None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:40:32.624954 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41778d5-e9f1-4b76-95b0-d0f250418c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:40:32.677416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-c41778d5-e9f1-4b76-95b0-d0f250418c7c None None] MFA Rules not processed for user `58a78f75a63e4d258a4afbeb748e59f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:40:32.679029 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-c41778d5-e9f1-4b76-95b0-d0f250418c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:40:32.780211 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1074/2149] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 19 02:40:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:40:32.791983 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faccab84-459d-4411-b1be-c1f0f5d8f951 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:40:32.793684 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-faccab84-459d-4411-b1be-c1f0f5d8f951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:40:32.852919 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faccab84-459d-4411-b1be-c1f0f5d8f951 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:40:32.856537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80aa99-2f94-499b-9772-2f10d3ab3c6f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9e8a7a5b8944272a2d1bd2140819ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:40:32.857133 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80aa99-2f94-499b-9772-2f10d3ab3c6f service glance] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:40:32.857410 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80aa99-2f94-499b-9772-2f10d3ab3c6f service glance] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:40:32.857684 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80aa99-2f94-499b-9772-2f10d3ab3c6f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:40:32.868615 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80aa99-2f94-499b-9772-2f10d3ab3c6f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:40:32.870046 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80aa99-2f94-499b-9772-2f10d3ab3c6f service glance] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:40:32.881664 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1076/2150] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:40:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:40:33.085950 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d9fb4-c332-4ca3-b075-9b33a24a679c None None] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:40:33.086269 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d9fb4-c332-4ca3-b075-9b33a24a679c None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:40:33.086542 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d9fb4-c332-4ca3-b075-9b33a24a679c None None] PATH_INFO: `/` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:40:33.087987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1075/2151] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 19 02:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:40:33.092712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd9437-a9fd-42e0-9ee3-97a9e1213c3f None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:40:33.098471 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd9437-a9fd-42e0-9ee3-97a9e1213c3f None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:40:33.098471 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd9437-a9fd-42e0-9ee3-97a9e1213c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:40:33.114317 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-c8dd9437-a9fd-42e0-9ee3-97a9e1213c3f None None] MFA Rules not processed for user `e7e4640bd879468d81ec0281827687ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:40:33.116316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c8dd9437-a9fd-42e0-9ee3-97a9e1213c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:40:33.171428 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1077/2152] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 19 02:40:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:40:33.184393 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d9fb4-c332-4ca3-b075-9b33a24a679c None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:40:33.187412 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-303d9fb4-c332-4ca3-b075-9b33a24a679c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:40:33.201291 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d9fb4-c332-4ca3-b075-9b33a24a679c None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:40:33.204919 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf06e4-5baf-4050-95d8-2a1b5e843e6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:40:33.205514 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf06e4-5baf-4050-95d8-2a1b5e843e6d service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:40:33.205792 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf06e4-5baf-4050-95d8-2a1b5e843e6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:40:33.206063 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf06e4-5baf-4050-95d8-2a1b5e843e6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:40:33.216971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf06e4-5baf-4050-95d8-2a1b5e843e6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:40:33.218672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf06e4-5baf-4050-95d8-2a1b5e843e6d service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:40:33.228990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1076/2153] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:40:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:40:33.313977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8a99e-1d52-4168-b2d9-c8e7ba31a16c None None] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:40:33.314262 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8a99e-1d52-4168-b2d9-c8e7ba31a16c None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:40:33.314534 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8a99e-1d52-4168-b2d9-c8e7ba31a16c None None] PATH_INFO: `/` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:40:33.315925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1078/2154] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 19 02:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 02:40:33.321921 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24a6b0-f22a-45be-bfc5-d8999e253c52 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:40:33.322206 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24a6b0-f22a-45be-bfc5-d8999e253c52 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:40:33.322479 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24a6b0-f22a-45be-bfc5-d8999e253c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:40:33.343350 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-be24a6b0-f22a-45be-bfc5-d8999e253c52 None None] MFA Rules not processed for user `58a78f75a63e4d258a4afbeb748e59f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:40:33.344539 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-be24a6b0-f22a-45be-bfc5-d8999e253c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:40:33.354416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1077/2155] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 19 02:40:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:40:33.365389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8a99e-1d52-4168-b2d9-c8e7ba31a16c None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:40:33.376460 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8a99e-1d52-4168-b2d9-c8e7ba31a16c None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:40:33.380673 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722071c-9fef-4f95-8558-0934c55a5bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:40:33.381355 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722071c-9fef-4f95-8558-0934c55a5bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:40:33.385640 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722071c-9fef-4f95-8558-0934c55a5bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:40:33.385640 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722071c-9fef-4f95-8558-0934c55a5bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:40:33.392209 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722071c-9fef-4f95-8558-0934c55a5bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:40:33.393621 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722071c-9fef-4f95-8558-0934c55a5bd6 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:40:33.404592 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1079/2156] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:40:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:40:35.415633 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24a6b0-f22a-45be-bfc5-d8999e253c52 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:40:35.417048 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-be24a6b0-f22a-45be-bfc5-d8999e253c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:40:35.497010 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:40:35.511263 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24a6b0-f22a-45be-bfc5-d8999e253c52 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:40:35.516295 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1793e17-ad3b-40e6-b617-35ff2141f90d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66b9bc695b44877a06f17ea6bbeb27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:40:35.516894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1793e17-ad3b-40e6-b617-35ff2141f90d service placement] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:40:35.517219 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1793e17-ad3b-40e6-b617-35ff2141f90d service placement] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:40:35.517489 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1793e17-ad3b-40e6-b617-35ff2141f90d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:40:35.519232 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-e1793e17-ad3b-40e6-b617-35ff2141f90d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:40:35.531475 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1793e17-ad3b-40e6-b617-35ff2141f90d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:40:35.533056 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1793e17-ad3b-40e6-b617-35ff2141f90d service placement] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:40:35.544181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1078/2157] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:40:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:40:38.815218 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c07761-2f7a-4ba6-8ce0-e2ecfab53a7a None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:40:38.815748 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c07761-2f7a-4ba6-8ce0-e2ecfab53a7a None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:40:38.816117 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c07761-2f7a-4ba6-8ce0-e2ecfab53a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:40:38.838202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-c5c07761-2f7a-4ba6-8ce0-e2ecfab53a7a None None] MFA Rules not processed for user `e58cdf090af44b508767e821be2f379f`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:40:38.840539 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c5c07761-2f7a-4ba6-8ce0-e2ecfab53a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:40:38.848386 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1080/2158] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 02:40:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:40:38.862470 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1793e17-ad3b-40e6-b617-35ff2141f90d service placement] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:40:38.873812 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1793e17-ad3b-40e6-b617-35ff2141f90d service placement] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:40:38.878799 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eda144-3c00-496a-b603-d1bc81445372 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906e9835f5c4e709915c6553b41aeff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:40:38.879438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eda144-3c00-496a-b603-d1bc81445372 service swift] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:40:38.879717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eda144-3c00-496a-b603-d1bc81445372 service swift] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:40:38.880010 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eda144-3c00-496a-b603-d1bc81445372 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:40:38.888783 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eda144-3c00-496a-b603-d1bc81445372 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:40:38.890288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eda144-3c00-496a-b603-d1bc81445372 service swift] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:40:38.899302 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1079/2159] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 02:40:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:40:48.832846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=58 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:40:48.896468 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=14 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:40:59.955351 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da1f76-a03a-4036-85c0-86d36cf62115 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:40:59.955905 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da1f76-a03a-4036-85c0-86d36cf62115 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:40:59.955905 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da1f76-a03a-4036-85c0-86d36cf62115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:40:59.975883 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-36da1f76-a03a-4036-85c0-86d36cf62115 None None] MFA Rules not processed for user `e58cdf090af44b508767e821be2f379f`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:40:59.977078 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-36da1f76-a03a-4036-85c0-86d36cf62115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:40:59.984342 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1081/2160] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 19 02:40:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:40:59.997504 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eda144-3c00-496a-b603-d1bc81445372 service swift] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:00.008238 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eda144-3c00-496a-b603-d1bc81445372 service swift] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:00.013282 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e0ed6-6874-42da-be2c-a5f9e9a21911 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906e9835f5c4e709915c6553b41aeff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:00.013872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e0ed6-6874-42da-be2c-a5f9e9a21911 service swift] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:00.014148 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e0ed6-6874-42da-be2c-a5f9e9a21911 service swift] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:00.014416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e0ed6-6874-42da-be2c-a5f9e9a21911 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:00.022734 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e0ed6-6874-42da-be2c-a5f9e9a21911 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:00.024353 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e0ed6-6874-42da-be2c-a5f9e9a21911 service swift] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:00.032517 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1080/2161] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 02:40:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:41:00.673606 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da1f76-a03a-4036-85c0-86d36cf62115 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:00.675026 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-36da1f76-a03a-4036-85c0-86d36cf62115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:00.708570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da1f76-a03a-4036-85c0-86d36cf62115 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:00.712295 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a4470-f30d-436b-a12a-2d8dead930ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:00.712884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a4470-f30d-436b-a12a-2d8dead930ce service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:00.713160 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a4470-f30d-436b-a12a-2d8dead930ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:00.713427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a4470-f30d-436b-a12a-2d8dead930ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:00.715153 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-0a9a4470-f30d-436b-a12a-2d8dead930ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:00.778102 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a4470-f30d-436b-a12a-2d8dead930ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:00.779501 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a4470-f30d-436b-a12a-2d8dead930ce service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:00.790417 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1082/2162] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:41:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:41:04.680854 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e0ed6-6874-42da-be2c-a5f9e9a21911 service swift] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:04.682437 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-8c3e0ed6-6874-42da-be2c-a5f9e9a21911 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:04.697249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e0ed6-6874-42da-be2c-a5f9e9a21911 service swift] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:04.702192 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5270c17-6f03-44ec-9e6c-95376a00a346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:04.704737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5270c17-6f03-44ec-9e6c-95376a00a346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:04.704737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5270c17-6f03-44ec-9e6c-95376a00a346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:04.704737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5270c17-6f03-44ec-9e6c-95376a00a346 admin admin] PATH_INFO: `/v3/users/4e5c1ceb415a47fb81c7226508f011ce` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:04.704737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5270c17-6f03-44ec-9e6c-95376a00a346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e5c1ceb415a47fb81c7226508f011ce)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:04.706547 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5270c17-6f03-44ec-9e6c-95376a00a346 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:04.909601 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-f5270c17-6f03-44ec-9e6c-95376a00a346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e5c1ceb415a47fb81c7226508f011ce'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:04.910250 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-f5270c17-6f03-44ec-9e6c-95376a00a346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e5c1ceb415a47fb81c7226508f011ce'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:04.987052 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-f5270c17-6f03-44ec-9e6c-95376a00a346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e5c1ceb415a47fb81c7226508f011ce'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:04.999507 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-f5270c17-6f03-44ec-9e6c-95376a00a346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e5c1ceb415a47fb81c7226508f011ce'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:05.002882 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-f5270c17-6f03-44ec-9e6c-95376a00a346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e5c1ceb415a47fb81c7226508f011ce'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:05.012504 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1081/2163] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:41:04 2022] DELETE /identity/v3/users/4e5c1ceb415a47fb81c7226508f011ce => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:05.240621 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a4470-f30d-436b-a12a-2d8dead930ce service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:05.251291 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a4470-f30d-436b-a12a-2d8dead930ce service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:05.309041 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac9211-abf5-4b3d-815f-ce09f1fcc380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:05.309673 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac9211-abf5-4b3d-815f-ce09f1fcc380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:05.309950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac9211-abf5-4b3d-815f-ce09f1fcc380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:05.310224 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac9211-abf5-4b3d-815f-ce09f1fcc380 admin admin] PATH_INFO: `/v3/projects/df05142293ce4544b0a1a042139bcff1` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:05.311357 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac9211-abf5-4b3d-815f-ce09f1fcc380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df05142293ce4544b0a1a042139bcff1)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:05.313310 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac9211-abf5-4b3d-815f-ce09f1fcc380 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:05.422169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-34ac9211-abf5-4b3d-815f-ce09f1fcc380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df05142293ce4544b0a1a042139bcff1', 'request_id': 'req-34ac9211-abf5-4b3d-815f-ce09f1fcc380'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:05.428112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-34ac9211-abf5-4b3d-815f-ce09f1fcc380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df05142293ce4544b0a1a042139bcff1', 'request_id': 'req-34ac9211-abf5-4b3d-815f-ce09f1fcc380'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:05.434537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-34ac9211-abf5-4b3d-815f-ce09f1fcc380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df05142293ce4544b0a1a042139bcff1', 'request_id': 'req-34ac9211-abf5-4b3d-815f-ce09f1fcc380'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:05.502401 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:05.507641 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-34ac9211-abf5-4b3d-815f-ce09f1fcc380 admin admin] The token cache is being invalidate because project df05142293ce4544b0a1a042139bcff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:41:05.507929 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-34ac9211-abf5-4b3d-815f-ce09f1fcc380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:05.508561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-34ac9211-abf5-4b3d-815f-ce09f1fcc380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:05.510076 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1083/2164] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:41:05 2022] DELETE /identity/v3/projects/df05142293ce4544b0a1a042139bcff1 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:05.515200 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7c82c-972a-4b05-9ec6-6a13b38d58d4 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:05.515780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7c82c-972a-4b05-9ec6-6a13b38d58d4 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:05.515780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7c82c-972a-4b05-9ec6-6a13b38d58d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:05.554582 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-f3a7c82c-972a-4b05-9ec6-6a13b38d58d4 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:05.555808 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-f3a7c82c-972a-4b05-9ec6-6a13b38d58d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:05.616873 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1082/2165] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:41:05.625303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edd13e-0137-43fb-8a58-8e23763d9fb7 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:05.625584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edd13e-0137-43fb-8a58-8e23763d9fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:05.625854 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edd13e-0137-43fb-8a58-8e23763d9fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:05.646751 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-81edd13e-0137-43fb-8a58-8e23763d9fb7 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:05.647969 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-81edd13e-0137-43fb-8a58-8e23763d9fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:05.655939 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1084/2166] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:41:05.660159 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7c82c-972a-4b05-9ec6-6a13b38d58d4 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:05.670082 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7c82c-972a-4b05-9ec6-6a13b38d58d4 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:05.674759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a4794-df1c-42b9-b04d-7adc3c438238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:05.675317 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a4794-df1c-42b9-b04d-7adc3c438238 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:05.675594 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a4794-df1c-42b9-b04d-7adc3c438238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:05.675865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a4794-df1c-42b9-b04d-7adc3c438238 admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:05.677034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a4794-df1c-42b9-b04d-7adc3c438238 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:41:05.677373 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a4794-df1c-42b9-b04d-7adc3c438238 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:05.678989 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a4794-df1c-42b9-b04d-7adc3c438238 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:05.690427 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1083/2167] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:41:05.695253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edd13e-0137-43fb-8a58-8e23763d9fb7 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:05.704736 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edd13e-0137-43fb-8a58-8e23763d9fb7 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:05.709631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5bb07-e576-45fb-b5f3-48ae68a95776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:05.710223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5bb07-e576-45fb-b5f3-48ae68a95776 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:05.710499 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5bb07-e576-45fb-b5f3-48ae68a95776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:05.710769 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5bb07-e576-45fb-b5f3-48ae68a95776 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:05.711423 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5bb07-e576-45fb-b5f3-48ae68a95776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:05.713324 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5bb07-e576-45fb-b5f3-48ae68a95776 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:05.806400 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1085/2168] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:41:05 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:41:05.810579 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a4794-df1c-42b9-b04d-7adc3c438238 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:05.821377 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a4794-df1c-42b9-b04d-7adc3c438238 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:05.850471 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:05.878172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf64c9-2a5e-4872-9b11-d8edc59dabb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:05.878775 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf64c9-2a5e-4872-9b11-d8edc59dabb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:05.879081 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf64c9-2a5e-4872-9b11-d8edc59dabb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:05.879354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf64c9-2a5e-4872-9b11-d8edc59dabb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:05.880650 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf64c9-2a5e-4872-9b11-d8edc59dabb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:05.882593 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf64c9-2a5e-4872-9b11-d8edc59dabb3 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:05.987696 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1084/2169] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:41:05 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:41:05.992083 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5bb07-e576-45fb-b5f3-48ae68a95776 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:06.002337 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5bb07-e576-45fb-b5f3-48ae68a95776 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:06.006976 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff995c-91bd-4af9-bcdc-219cce01a3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:06.007563 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff995c-91bd-4af9-bcdc-219cce01a3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:06.007838 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff995c-91bd-4af9-bcdc-219cce01a3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:06.008100 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff995c-91bd-4af9-bcdc-219cce01a3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:06.008737 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff995c-91bd-4af9-bcdc-219cce01a3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:06.010315 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff995c-91bd-4af9-bcdc-219cce01a3c4 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:06.020078 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1086/2170] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:41:06.024026 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf64c9-2a5e-4872-9b11-d8edc59dabb3 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:06.034195 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf64c9-2a5e-4872-9b11-d8edc59dabb3 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:06.039636 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8ba7a-361a-4b5b-9dd8-e0e6bcd489b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:06.040226 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8ba7a-361a-4b5b-9dd8-e0e6bcd489b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:06.040506 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8ba7a-361a-4b5b-9dd8-e0e6bcd489b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:06.040776 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8ba7a-361a-4b5b-9dd8-e0e6bcd489b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:06.041419 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8ba7a-361a-4b5b-9dd8-e0e6bcd489b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:06.043151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8ba7a-361a-4b5b-9dd8-e0e6bcd489b4 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:06.054363 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1085/2171] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:41:06.058313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff995c-91bd-4af9-bcdc-219cce01a3c4 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:06.068366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff995c-91bd-4af9-bcdc-219cce01a3c4 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:06.072957 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd112fb-fa82-461b-8081-189b8e52ee75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:06.073696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd112fb-fa82-461b-8081-189b8e52ee75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:06.073976 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd112fb-fa82-461b-8081-189b8e52ee75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:06.074515 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd112fb-fa82-461b-8081-189b8e52ee75 admin admin] PATH_INFO: `/v3/projects/1cd325f15c2c477b837476526818d7e4/users/dc5d4f057ffb483ab27336ea8f10ad16/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:06.090087 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd112fb-fa82-461b-8081-189b8e52ee75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cd325f15c2c477b837476526818d7e4, user_id=dc5d4f057ffb483ab27336ea8f10ad16, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:06.092844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd112fb-fa82-461b-8081-189b8e52ee75 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:06.192885 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1087/2172] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:41:06 2022] PUT /identity/v3/projects/1cd325f15c2c477b837476526818d7e4/users/dc5d4f057ffb483ab27336ea8f10ad16/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:06.203446 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d965a62-b865-4df2-9ac4-3e7413b2bad0 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:06.203732 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d965a62-b865-4df2-9ac4-3e7413b2bad0 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:06.204010 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d965a62-b865-4df2-9ac4-3e7413b2bad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:06.233646 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-4d965a62-b865-4df2-9ac4-3e7413b2bad0 None None] MFA Rules not processed for user `dc5d4f057ffb483ab27336ea8f10ad16`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:06.234869 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-4d965a62-b865-4df2-9ac4-3e7413b2bad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:06.299591 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1086/2173] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:41:06.304723 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd112fb-fa82-461b-8081-189b8e52ee75 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:06.365453 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd112fb-fa82-461b-8081-189b8e52ee75 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:06.370096 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c5b17-d5a4-45b6-a34a-74e6a2dd12ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:06.370687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c5b17-d5a4-45b6-a34a-74e6a2dd12ad admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:06.370992 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c5b17-d5a4-45b6-a34a-74e6a2dd12ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:06.371262 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c5b17-d5a4-45b6-a34a-74e6a2dd12ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:06.371934 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c5b17-d5a4-45b6-a34a-74e6a2dd12ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:06.373826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c5b17-d5a4-45b6-a34a-74e6a2dd12ad admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:06.468170 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1088/2174] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:41:06 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:41:06.472318 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d965a62-b865-4df2-9ac4-3e7413b2bad0 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:06.484122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d965a62-b865-4df2-9ac4-3e7413b2bad0 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:06.542175 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb5877-c6b8-4121-a9bb-c7f1c62668a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:06.542782 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb5877-c6b8-4121-a9bb-c7f1c62668a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:06.543094 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb5877-c6b8-4121-a9bb-c7f1c62668a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:06.543367 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb5877-c6b8-4121-a9bb-c7f1c62668a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:06.543994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb5877-c6b8-4121-a9bb-c7f1c62668a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:06.545942 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb5877-c6b8-4121-a9bb-c7f1c62668a7 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:06.657315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1087/2175] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:41:06 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:41:06.661692 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c5b17-d5a4-45b6-a34a-74e6a2dd12ad admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:06.672197 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c5b17-d5a4-45b6-a34a-74e6a2dd12ad admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:06.676849 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b484699-2307-48c9-834d-77f34b18bd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:06.677469 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b484699-2307-48c9-834d-77f34b18bd0b admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:06.677786 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b484699-2307-48c9-834d-77f34b18bd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:06.678064 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b484699-2307-48c9-834d-77f34b18bd0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:06.678703 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b484699-2307-48c9-834d-77f34b18bd0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:06.680349 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b484699-2307-48c9-834d-77f34b18bd0b admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:06.693747 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1089/2176] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:41:06.697424 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb5877-c6b8-4121-a9bb-c7f1c62668a7 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:06.708380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb5877-c6b8-4121-a9bb-c7f1c62668a7 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:06.713145 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c94ee6-aefd-43d6-a633-91ddddbfacd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:06.713736 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c94ee6-aefd-43d6-a633-91ddddbfacd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:06.714016 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c94ee6-aefd-43d6-a633-91ddddbfacd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:06.714292 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c94ee6-aefd-43d6-a633-91ddddbfacd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:06.715076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c94ee6-aefd-43d6-a633-91ddddbfacd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:06.716676 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c94ee6-aefd-43d6-a633-91ddddbfacd5 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:06.727385 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1088/2177] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:41:06.737915 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b484699-2307-48c9-834d-77f34b18bd0b admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:06.748353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b484699-2307-48c9-834d-77f34b18bd0b admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:06.753000 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347f5cd-6d13-4f06-ae62-578cb908f894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:06.753644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347f5cd-6d13-4f06-ae62-578cb908f894 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:06.753923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347f5cd-6d13-4f06-ae62-578cb908f894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:06.754201 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347f5cd-6d13-4f06-ae62-578cb908f894 admin admin] PATH_INFO: `/v3/projects/8d82fa648d8c48598fad32c70a856806/users/16a4fe059ccc4c2788c9e67b53919a8a/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:06.769222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347f5cd-6d13-4f06-ae62-578cb908f894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d82fa648d8c48598fad32c70a856806, user_id=16a4fe059ccc4c2788c9e67b53919a8a, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:06.772636 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347f5cd-6d13-4f06-ae62-578cb908f894 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:06.833842 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1090/2178] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:41:06 2022] PUT /identity/v3/projects/8d82fa648d8c48598fad32c70a856806/users/16a4fe059ccc4c2788c9e67b53919a8a/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:06.843857 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddc654-aeab-47a6-87e1-acdd093a13bc None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:06.844138 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddc654-aeab-47a6-87e1-acdd093a13bc None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:06.844412 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddc654-aeab-47a6-87e1-acdd093a13bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:06.873079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-d4ddc654-aeab-47a6-87e1-acdd093a13bc None None] MFA Rules not processed for user `16a4fe059ccc4c2788c9e67b53919a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:06.874279 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-d4ddc654-aeab-47a6-87e1-acdd093a13bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:06.879266 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:06.938698 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1089/2179] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:41:06.943641 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347f5cd-6d13-4f06-ae62-578cb908f894 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:06.989070 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:07.005291 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347f5cd-6d13-4f06-ae62-578cb908f894 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:07.009917 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99717868-3761-42d7-bd68-474223bad414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:07.010513 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99717868-3761-42d7-bd68-474223bad414 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:07.010789 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99717868-3761-42d7-bd68-474223bad414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:07.011093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99717868-3761-42d7-bd68-474223bad414 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:07.011727 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99717868-3761-42d7-bd68-474223bad414 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:07.013639 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99717868-3761-42d7-bd68-474223bad414 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:07.120474 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1091/2180] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:41:06 2022] POST /identity/v3/projects => generated 387 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:41:07.124480 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddc654-aeab-47a6-87e1-acdd093a13bc None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:07.136249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddc654-aeab-47a6-87e1-acdd093a13bc None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:07.191782 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7452818-69bb-489f-b9d8-711b6ee266e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:07.192987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7452818-69bb-489f-b9d8-711b6ee266e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:07.193261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7452818-69bb-489f-b9d8-711b6ee266e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:07.193527 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7452818-69bb-489f-b9d8-711b6ee266e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:07.194157 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7452818-69bb-489f-b9d8-711b6ee266e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:07.196088 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7452818-69bb-489f-b9d8-711b6ee266e3 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:07.320399 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1090/2181] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:41:07 2022] POST /identity/v3/users => generated 300 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:41:07.324643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99717868-3761-42d7-bd68-474223bad414 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:07.335842 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99717868-3761-42d7-bd68-474223bad414 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:07.340542 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e0259-d3c6-4da4-9979-0ca9da9bcb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:07.341156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e0259-d3c6-4da4-9979-0ca9da9bcb9f admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:07.341440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e0259-d3c6-4da4-9979-0ca9da9bcb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:07.341713 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e0259-d3c6-4da4-9979-0ca9da9bcb9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:07.342357 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e0259-d3c6-4da4-9979-0ca9da9bcb9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:07.343989 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e0259-d3c6-4da4-9979-0ca9da9bcb9f admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:07.353832 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1092/2182] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:41:07.357869 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7452818-69bb-489f-b9d8-711b6ee266e3 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:07.368542 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7452818-69bb-489f-b9d8-711b6ee266e3 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:07.373159 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fc5a9-2d47-483c-8e08-75e7f69b652f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:07.373743 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fc5a9-2d47-483c-8e08-75e7f69b652f admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:07.374022 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fc5a9-2d47-483c-8e08-75e7f69b652f admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:07.374296 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fc5a9-2d47-483c-8e08-75e7f69b652f admin admin] PATH_INFO: `/v3/projects/0c4ad00340ab454a848a5916424b6ddc/users/57d106611ae24eacb63a2f39493b787f/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:07.389855 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fc5a9-2d47-483c-8e08-75e7f69b652f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c4ad00340ab454a848a5916424b6ddc, user_id=57d106611ae24eacb63a2f39493b787f, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:07.392557 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fc5a9-2d47-483c-8e08-75e7f69b652f admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:07.461320 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1091/2183] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:41:07 2022] PUT /identity/v3/projects/0c4ad00340ab454a848a5916424b6ddc/users/57d106611ae24eacb63a2f39493b787f/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:07.465213 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e0259-d3c6-4da4-9979-0ca9da9bcb9f admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:07.476169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e0259-d3c6-4da4-9979-0ca9da9bcb9f admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:07.532368 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452db5b-9099-4901-a3a3-f754d8d46bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:07.532978 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452db5b-9099-4901-a3a3-f754d8d46bac admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:07.533259 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452db5b-9099-4901-a3a3-f754d8d46bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:07.533530 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452db5b-9099-4901-a3a3-f754d8d46bac admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:07.534165 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452db5b-9099-4901-a3a3-f754d8d46bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:07.535796 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452db5b-9099-4901-a3a3-f754d8d46bac admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:07.545861 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1093/2184] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:41:07.549997 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fc5a9-2d47-483c-8e08-75e7f69b652f admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:07.560872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fc5a9-2d47-483c-8e08-75e7f69b652f admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:07.565464 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992d262-bbc4-4d66-b246-fed02f43b602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:07.566103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992d262-bbc4-4d66-b246-fed02f43b602 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:07.566389 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992d262-bbc4-4d66-b246-fed02f43b602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:07.566663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992d262-bbc4-4d66-b246-fed02f43b602 admin admin] PATH_INFO: `/v3/projects/0c4ad00340ab454a848a5916424b6ddc/users/57d106611ae24eacb63a2f39493b787f/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:07.568763 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992d262-bbc4-4d66-b246-fed02f43b602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c4ad00340ab454a848a5916424b6ddc, user_id=57d106611ae24eacb63a2f39493b787f, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:07.571452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992d262-bbc4-4d66-b246-fed02f43b602 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:07.581770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1092/2185] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:41:07 2022] PUT /identity/v3/projects/0c4ad00340ab454a848a5916424b6ddc/users/57d106611ae24eacb63a2f39493b787f/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:07.592792 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e904bf-387e-4973-8b6c-0d85a12f0d44 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:07.593080 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e904bf-387e-4973-8b6c-0d85a12f0d44 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:07.593377 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e904bf-387e-4973-8b6c-0d85a12f0d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:07.622412 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-08e904bf-387e-4973-8b6c-0d85a12f0d44 None None] MFA Rules not processed for user `57d106611ae24eacb63a2f39493b787f`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:07.631217 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-08e904bf-387e-4973-8b6c-0d85a12f0d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:07.693281 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1094/2186] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:41:07.704387 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992d262-bbc4-4d66-b246-fed02f43b602 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:07.706107 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-4992d262-bbc4-4d66-b246-fed02f43b602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:07.772251 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:07.784892 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992d262-bbc4-4d66-b246-fed02f43b602 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:07.789236 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a4824-1ad7-427e-b2ce-85d4d8633e9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:07.789823 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a4824-1ad7-427e-b2ce-85d4d8633e9d service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:07.790099 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a4824-1ad7-427e-b2ce-85d4d8633e9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:07.790366 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a4824-1ad7-427e-b2ce-85d4d8633e9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:07.799188 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a4824-1ad7-427e-b2ce-85d4d8633e9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:07.800593 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a4824-1ad7-427e-b2ce-85d4d8633e9d service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:07.811067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1093/2187] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:41:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:41:08.943621 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e904bf-387e-4973-8b6c-0d85a12f0d44 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:08.945040 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-08e904bf-387e-4973-8b6c-0d85a12f0d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:08.957136 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e904bf-387e-4973-8b6c-0d85a12f0d44 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:08.960675 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59c448-1809-4803-ae49-70fc05bc7d42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:08.961267 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59c448-1809-4803-ae49-70fc05bc7d42 service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:08.961544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59c448-1809-4803-ae49-70fc05bc7d42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:08.961813 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59c448-1809-4803-ae49-70fc05bc7d42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:09.000697 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:09.018854 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59c448-1809-4803-ae49-70fc05bc7d42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:09.020996 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59c448-1809-4803-ae49-70fc05bc7d42 service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:09.029898 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1095/2188] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:41:08 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:41:14.997773 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a4824-1ad7-427e-b2ce-85d4d8633e9d service cinder] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:15.006709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a4824-1ad7-427e-b2ce-85d4d8633e9d service cinder] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:15.011375 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72517a-a0a5-4123-844c-ed213963866e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:15.011967 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72517a-a0a5-4123-844c-ed213963866e service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:15.012267 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72517a-a0a5-4123-844c-ed213963866e service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:15.012517 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72517a-a0a5-4123-844c-ed213963866e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:15.070764 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72517a-a0a5-4123-844c-ed213963866e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:15.072407 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72517a-a0a5-4123-844c-ed213963866e service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:15.081597 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1094/2189] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:41:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:41:18.218069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d368958-26c1-4951-a813-14892b4f2da3 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:18.218467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d368958-26c1-4951-a813-14892b4f2da3 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:18.218639 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d368958-26c1-4951-a813-14892b4f2da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:18.241539 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-6d368958-26c1-4951-a813-14892b4f2da3 None None] MFA Rules not processed for user `0e81138fb66c448cb56375eacd407a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:18.242868 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-6d368958-26c1-4951-a813-14892b4f2da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:18.299851 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1096/2190] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:41:19.211008 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72517a-a0a5-4123-844c-ed213963866e service cinder] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:19.279753 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72517a-a0a5-4123-844c-ed213963866e service cinder] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:19.284271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c98a8-1800-4e68-994b-d13f535be243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:19.284886 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c98a8-1800-4e68-994b-d13f535be243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:19.285165 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c98a8-1800-4e68-994b-d13f535be243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:19.285441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c98a8-1800-4e68-994b-d13f535be243 admin admin] PATH_INFO: `/v3/users/dc5d4f057ffb483ab27336ea8f10ad16` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:19.286558 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c98a8-1800-4e68-994b-d13f535be243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc5d4f057ffb483ab27336ea8f10ad16)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:19.288522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c98a8-1800-4e68-994b-d13f535be243 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:19.492989 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e66c98a8-1800-4e68-994b-d13f535be243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc5d4f057ffb483ab27336ea8f10ad16'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:19.493828 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e66c98a8-1800-4e68-994b-d13f535be243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc5d4f057ffb483ab27336ea8f10ad16'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:19.581469 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e66c98a8-1800-4e68-994b-d13f535be243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc5d4f057ffb483ab27336ea8f10ad16'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:19.595550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e66c98a8-1800-4e68-994b-d13f535be243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc5d4f057ffb483ab27336ea8f10ad16'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:19.596220 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e66c98a8-1800-4e68-994b-d13f535be243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc5d4f057ffb483ab27336ea8f10ad16'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:19.604996 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:19.609096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1095/2191] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:41:19 2022] DELETE /identity/v3/users/dc5d4f057ffb483ab27336ea8f10ad16 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:19.613488 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705da681-6478-4a55-beef-3aa27fe8f46a None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:19.613971 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705da681-6478-4a55-beef-3aa27fe8f46a None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:19.614069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705da681-6478-4a55-beef-3aa27fe8f46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:19.633126 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-705da681-6478-4a55-beef-3aa27fe8f46a None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:19.634794 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-705da681-6478-4a55-beef-3aa27fe8f46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:19.695523 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1097/2192] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:41:19.706525 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c98a8-1800-4e68-994b-d13f535be243 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:19.708062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-e66c98a8-1800-4e68-994b-d13f535be243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:19.766664 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c98a8-1800-4e68-994b-d13f535be243 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:19.770367 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac5621-9383-4c2d-a7ee-4db4d919effd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:19.771004 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac5621-9383-4c2d-a7ee-4db4d919effd service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:19.771285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac5621-9383-4c2d-a7ee-4db4d919effd service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:19.771562 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac5621-9383-4c2d-a7ee-4db4d919effd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:19.781466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac5621-9383-4c2d-a7ee-4db4d919effd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:19.782934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac5621-9383-4c2d-a7ee-4db4d919effd service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:19.793132 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1096/2193] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:41:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:41:20.263950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705da681-6478-4a55-beef-3aa27fe8f46a None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:20.265362 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-705da681-6478-4a55-beef-3aa27fe8f46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:20.280264 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705da681-6478-4a55-beef-3aa27fe8f46a None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:20.285238 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdbbb6-86a4-4a30-ba0a-b7464d74b4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:20.285870 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdbbb6-86a4-4a30-ba0a-b7464d74b4f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:20.286145 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdbbb6-86a4-4a30-ba0a-b7464d74b4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:20.286405 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdbbb6-86a4-4a30-ba0a-b7464d74b4f7 admin admin] PATH_INFO: `/v3/projects/1cd325f15c2c477b837476526818d7e4` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:20.287604 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdbbb6-86a4-4a30-ba0a-b7464d74b4f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cd325f15c2c477b837476526818d7e4)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:20.289444 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdbbb6-86a4-4a30-ba0a-b7464d74b4f7 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:20.421761 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-bcbdbbb6-86a4-4a30-ba0a-b7464d74b4f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cd325f15c2c477b837476526818d7e4', 'request_id': 'req-bcbdbbb6-86a4-4a30-ba0a-b7464d74b4f7'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:20.427512 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-bcbdbbb6-86a4-4a30-ba0a-b7464d74b4f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cd325f15c2c477b837476526818d7e4', 'request_id': 'req-bcbdbbb6-86a4-4a30-ba0a-b7464d74b4f7'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:20.434112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-bcbdbbb6-86a4-4a30-ba0a-b7464d74b4f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cd325f15c2c477b837476526818d7e4', 'request_id': 'req-bcbdbbb6-86a4-4a30-ba0a-b7464d74b4f7'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:20.547632 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-bcbdbbb6-86a4-4a30-ba0a-b7464d74b4f7 admin admin] The token cache is being invalidate because project 1cd325f15c2c477b837476526818d7e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:41:20.547882 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-bcbdbbb6-86a4-4a30-ba0a-b7464d74b4f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:20.548437 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-bcbdbbb6-86a4-4a30-ba0a-b7464d74b4f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:20.550185 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1098/2194] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:41:20 2022] DELETE /identity/v3/projects/1cd325f15c2c477b837476526818d7e4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:20.554242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac5621-9383-4c2d-a7ee-4db4d919effd service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:20.564943 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac5621-9383-4c2d-a7ee-4db4d919effd service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:20.624198 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208be84f-e17a-478a-9992-6bbeb2201e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:20.624927 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208be84f-e17a-478a-9992-6bbeb2201e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:20.625210 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208be84f-e17a-478a-9992-6bbeb2201e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:20.625484 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208be84f-e17a-478a-9992-6bbeb2201e35 admin admin] PATH_INFO: `/v3/users/16a4fe059ccc4c2788c9e67b53919a8a` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:20.626615 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208be84f-e17a-478a-9992-6bbeb2201e35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16a4fe059ccc4c2788c9e67b53919a8a)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:20.628651 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208be84f-e17a-478a-9992-6bbeb2201e35 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:20.814878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-208be84f-e17a-478a-9992-6bbeb2201e35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16a4fe059ccc4c2788c9e67b53919a8a'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:20.815550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-208be84f-e17a-478a-9992-6bbeb2201e35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16a4fe059ccc4c2788c9e67b53919a8a'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:20.885237 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-208be84f-e17a-478a-9992-6bbeb2201e35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16a4fe059ccc4c2788c9e67b53919a8a'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:20.898182 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-208be84f-e17a-478a-9992-6bbeb2201e35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16a4fe059ccc4c2788c9e67b53919a8a'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:20.898862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-208be84f-e17a-478a-9992-6bbeb2201e35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16a4fe059ccc4c2788c9e67b53919a8a'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:20.911142 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1097/2195] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:41:20 2022] DELETE /identity/v3/users/16a4fe059ccc4c2788c9e67b53919a8a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:21.467474 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdbbb6-86a4-4a30-ba0a-b7464d74b4f7 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:21.469020 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-bcbdbbb6-86a4-4a30-ba0a-b7464d74b4f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:21.482463 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdbbb6-86a4-4a30-ba0a-b7464d74b4f7 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:21.486070 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:21.546354 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96968d1-23bf-4b9c-93f4-f010380ababb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:21.547052 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96968d1-23bf-4b9c-93f4-f010380ababb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:21.547333 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96968d1-23bf-4b9c-93f4-f010380ababb admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:21.547722 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96968d1-23bf-4b9c-93f4-f010380ababb admin admin] PATH_INFO: `/v3/projects/8d82fa648d8c48598fad32c70a856806` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:21.548824 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96968d1-23bf-4b9c-93f4-f010380ababb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d82fa648d8c48598fad32c70a856806)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:21.550756 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96968d1-23bf-4b9c-93f4-f010380ababb admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:21.679506 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a96968d1-23bf-4b9c-93f4-f010380ababb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d82fa648d8c48598fad32c70a856806', 'request_id': 'req-a96968d1-23bf-4b9c-93f4-f010380ababb'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:21.685874 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a96968d1-23bf-4b9c-93f4-f010380ababb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d82fa648d8c48598fad32c70a856806', 'request_id': 'req-a96968d1-23bf-4b9c-93f4-f010380ababb'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:21.692717 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a96968d1-23bf-4b9c-93f4-f010380ababb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d82fa648d8c48598fad32c70a856806', 'request_id': 'req-a96968d1-23bf-4b9c-93f4-f010380ababb'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:21.817112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a96968d1-23bf-4b9c-93f4-f010380ababb admin admin] The token cache is being invalidate because project 8d82fa648d8c48598fad32c70a856806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:41:21.817531 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a96968d1-23bf-4b9c-93f4-f010380ababb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:21.818270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a96968d1-23bf-4b9c-93f4-f010380ababb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:21.820020 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1099/2196] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:41:21 2022] DELETE /identity/v3/projects/8d82fa648d8c48598fad32c70a856806 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:21.824840 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208be84f-e17a-478a-9992-6bbeb2201e35 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:21.826273 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-208be84f-e17a-478a-9992-6bbeb2201e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:21.840748 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208be84f-e17a-478a-9992-6bbeb2201e35 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:21.861628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:21.901805 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34baad6b-723b-4924-967d-e8aa8adbc935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:21.902507 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baad6b-723b-4924-967d-e8aa8adbc935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:21.902790 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baad6b-723b-4924-967d-e8aa8adbc935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:21.903098 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baad6b-723b-4924-967d-e8aa8adbc935 admin admin] PATH_INFO: `/v3/users/57d106611ae24eacb63a2f39493b787f` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:21.904249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34baad6b-723b-4924-967d-e8aa8adbc935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57d106611ae24eacb63a2f39493b787f)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:21.906249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34baad6b-723b-4924-967d-e8aa8adbc935 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:22.058566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-34baad6b-723b-4924-967d-e8aa8adbc935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57d106611ae24eacb63a2f39493b787f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:22.059260 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-34baad6b-723b-4924-967d-e8aa8adbc935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57d106611ae24eacb63a2f39493b787f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:22.123779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-34baad6b-723b-4924-967d-e8aa8adbc935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57d106611ae24eacb63a2f39493b787f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:22.140572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-34baad6b-723b-4924-967d-e8aa8adbc935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57d106611ae24eacb63a2f39493b787f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:22.141387 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-34baad6b-723b-4924-967d-e8aa8adbc935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57d106611ae24eacb63a2f39493b787f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:22.159418 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1098/2197] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:41:21 2022] DELETE /identity/v3/users/57d106611ae24eacb63a2f39493b787f => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:22.583862 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96968d1-23bf-4b9c-93f4-f010380ababb admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:22.585454 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-a96968d1-23bf-4b9c-93f4-f010380ababb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:22.608245 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96968d1-23bf-4b9c-93f4-f010380ababb admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:22.682738 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78b56d-a3b0-4bf2-b34e-d72aa08ef32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:22.683457 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78b56d-a3b0-4bf2-b34e-d72aa08ef32f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:22.683740 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78b56d-a3b0-4bf2-b34e-d72aa08ef32f admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:22.684029 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78b56d-a3b0-4bf2-b34e-d72aa08ef32f admin admin] PATH_INFO: `/v3/projects/0c4ad00340ab454a848a5916424b6ddc` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:22.685227 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78b56d-a3b0-4bf2-b34e-d72aa08ef32f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c4ad00340ab454a848a5916424b6ddc)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:22.687245 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78b56d-a3b0-4bf2-b34e-d72aa08ef32f admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:22.833941 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:22.842599 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2c78b56d-a3b0-4bf2-b34e-d72aa08ef32f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c4ad00340ab454a848a5916424b6ddc', 'request_id': 'req-2c78b56d-a3b0-4bf2-b34e-d72aa08ef32f'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:22.849048 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2c78b56d-a3b0-4bf2-b34e-d72aa08ef32f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c4ad00340ab454a848a5916424b6ddc', 'request_id': 'req-2c78b56d-a3b0-4bf2-b34e-d72aa08ef32f'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:22.856556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2c78b56d-a3b0-4bf2-b34e-d72aa08ef32f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c4ad00340ab454a848a5916424b6ddc', 'request_id': 'req-2c78b56d-a3b0-4bf2-b34e-d72aa08ef32f'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:22.947389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2c78b56d-a3b0-4bf2-b34e-d72aa08ef32f admin admin] The token cache is being invalidate because project 0c4ad00340ab454a848a5916424b6ddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:41:22.947685 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2c78b56d-a3b0-4bf2-b34e-d72aa08ef32f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:22.948313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-2c78b56d-a3b0-4bf2-b34e-d72aa08ef32f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:22.954742 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1100/2198] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:41:22 2022] DELETE /identity/v3/projects/0c4ad00340ab454a848a5916424b6ddc => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:22.956913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2e6f0-392d-4e71-8031-53e48ba53876 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:22.957412 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2e6f0-392d-4e71-8031-53e48ba53876 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:22.957576 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2e6f0-392d-4e71-8031-53e48ba53876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:22.979489 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-3ee2e6f0-392d-4e71-8031-53e48ba53876 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:22.980930 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-3ee2e6f0-392d-4e71-8031-53e48ba53876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:23.041665 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1099/2199] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:41:23.050373 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250796ef-414c-44be-a5f8-942892e1d386 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:23.055183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250796ef-414c-44be-a5f8-942892e1d386 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:23.055183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250796ef-414c-44be-a5f8-942892e1d386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:23.071855 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-250796ef-414c-44be-a5f8-942892e1d386 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:23.073065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-250796ef-414c-44be-a5f8-942892e1d386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:23.081624 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1101/2200] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:41:23.086372 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2e6f0-392d-4e71-8031-53e48ba53876 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:23.097434 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2e6f0-392d-4e71-8031-53e48ba53876 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:23.102690 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a368a-dc9c-4031-8e30-7e8b9645d0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:23.104017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a368a-dc9c-4031-8e30-7e8b9645d0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:23.104294 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a368a-dc9c-4031-8e30-7e8b9645d0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:23.104564 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a368a-dc9c-4031-8e30-7e8b9645d0a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:23.105221 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a368a-dc9c-4031-8e30-7e8b9645d0a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:41:23.105522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a368a-dc9c-4031-8e30-7e8b9645d0a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:23.107159 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a368a-dc9c-4031-8e30-7e8b9645d0a9 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:23.123891 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1100/2201] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:41:23.125072 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250796ef-414c-44be-a5f8-942892e1d386 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:23.135184 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250796ef-414c-44be-a5f8-942892e1d386 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:23.139994 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f5db9-43e7-4b1c-9844-744cc42ce301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:23.140654 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f5db9-43e7-4b1c-9844-744cc42ce301 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:23.141383 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f5db9-43e7-4b1c-9844-744cc42ce301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:23.141383 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f5db9-43e7-4b1c-9844-744cc42ce301 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:23.141970 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f5db9-43e7-4b1c-9844-744cc42ce301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:23.143975 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f5db9-43e7-4b1c-9844-744cc42ce301 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:23.243622 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1102/2202] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:41:23 2022] POST /identity/v3/projects => generated 393 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:41:23.247792 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a368a-dc9c-4031-8e30-7e8b9645d0a9 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:23.254566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a368a-dc9c-4031-8e30-7e8b9645d0a9 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:23.282145 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:23.314512 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c4c79-1a23-473d-9adc-b08fa874d849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:23.315144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c4c79-1a23-473d-9adc-b08fa874d849 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:23.315421 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c4c79-1a23-473d-9adc-b08fa874d849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:23.315692 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c4c79-1a23-473d-9adc-b08fa874d849 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:23.316357 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c4c79-1a23-473d-9adc-b08fa874d849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:23.318279 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c4c79-1a23-473d-9adc-b08fa874d849 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:23.400255 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1101/2203] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:41:23 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:41:23.404401 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f5db9-43e7-4b1c-9844-744cc42ce301 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:23.416555 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f5db9-43e7-4b1c-9844-744cc42ce301 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:23.422470 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7cf54-c4f3-4dc3-b986-ad212b396fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:23.423138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7cf54-c4f3-4dc3-b986-ad212b396fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:23.423401 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7cf54-c4f3-4dc3-b986-ad212b396fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:23.423673 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7cf54-c4f3-4dc3-b986-ad212b396fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:23.424790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7cf54-c4f3-4dc3-b986-ad212b396fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:23.426559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7cf54-c4f3-4dc3-b986-ad212b396fe3 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:23.439514 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1103/2204] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:41:23.444005 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c4c79-1a23-473d-9adc-b08fa874d849 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:23.461667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c4c79-1a23-473d-9adc-b08fa874d849 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:23.467666 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d63847-7c55-4c26-be83-ba5df233026c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:23.468330 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d63847-7c55-4c26-be83-ba5df233026c admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:23.468613 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d63847-7c55-4c26-be83-ba5df233026c admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:23.468909 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d63847-7c55-4c26-be83-ba5df233026c admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:23.470403 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d63847-7c55-4c26-be83-ba5df233026c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:23.472459 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d63847-7c55-4c26-be83-ba5df233026c admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:23.484359 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1102/2205] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:41:23.488214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7cf54-c4f3-4dc3-b986-ad212b396fe3 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:23.500347 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7cf54-c4f3-4dc3-b986-ad212b396fe3 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:23.505176 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5046fe-e416-4517-bace-e7e7a1564aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:23.505862 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5046fe-e416-4517-bace-e7e7a1564aa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:23.508218 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5046fe-e416-4517-bace-e7e7a1564aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:23.508218 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5046fe-e416-4517-bace-e7e7a1564aa8 admin admin] PATH_INFO: `/v3/projects/957cff55f9324526adfaa8ec9ee38b90/users/452e5260c2aa4f9aac00341ae9c2e0bf/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:23.522539 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5046fe-e416-4517-bace-e7e7a1564aa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=957cff55f9324526adfaa8ec9ee38b90, user_id=452e5260c2aa4f9aac00341ae9c2e0bf, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:23.525857 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5046fe-e416-4517-bace-e7e7a1564aa8 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:23.639990 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1104/2206] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:41:23 2022] PUT /identity/v3/projects/957cff55f9324526adfaa8ec9ee38b90/users/452e5260c2aa4f9aac00341ae9c2e0bf/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:23.652547 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abe1eb-9b86-4155-affa-da88c15d4696 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:23.652759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abe1eb-9b86-4155-affa-da88c15d4696 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:23.653038 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abe1eb-9b86-4155-affa-da88c15d4696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:23.681878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-87abe1eb-9b86-4155-affa-da88c15d4696 None None] MFA Rules not processed for user `452e5260c2aa4f9aac00341ae9c2e0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:23.683189 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-87abe1eb-9b86-4155-affa-da88c15d4696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:23.751077 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1103/2207] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:41:23.755772 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5046fe-e416-4517-bace-e7e7a1564aa8 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:23.823133 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5046fe-e416-4517-bace-e7e7a1564aa8 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:23.828172 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b2d8b-e463-4d13-af22-2c370695cf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:23.830904 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b2d8b-e463-4d13-af22-2c370695cf31 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:23.830904 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b2d8b-e463-4d13-af22-2c370695cf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:23.830904 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b2d8b-e463-4d13-af22-2c370695cf31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:23.830904 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b2d8b-e463-4d13-af22-2c370695cf31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:23.831901 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b2d8b-e463-4d13-af22-2c370695cf31 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:23.926539 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1105/2208] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:41:23 2022] POST /identity/v3/projects => generated 391 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:41:23.930662 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abe1eb-9b86-4155-affa-da88c15d4696 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:23.942863 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abe1eb-9b86-4155-affa-da88c15d4696 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:24.005342 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f706fc-7560-4732-b51c-ca507a9b415b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:24.005962 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f706fc-7560-4732-b51c-ca507a9b415b admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:24.006245 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f706fc-7560-4732-b51c-ca507a9b415b admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:24.006519 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f706fc-7560-4732-b51c-ca507a9b415b admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:24.007320 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f706fc-7560-4732-b51c-ca507a9b415b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:24.009650 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f706fc-7560-4732-b51c-ca507a9b415b admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:24.125708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1104/2209] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:41:23 2022] POST /identity/v3/users => generated 302 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:41:24.129762 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b2d8b-e463-4d13-af22-2c370695cf31 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:24.140606 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b2d8b-e463-4d13-af22-2c370695cf31 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:24.145361 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153b4c9-4e86-4d47-91c2-4dc496510293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:24.146054 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153b4c9-4e86-4d47-91c2-4dc496510293 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:24.146418 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153b4c9-4e86-4d47-91c2-4dc496510293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:24.147114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153b4c9-4e86-4d47-91c2-4dc496510293 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:24.147515 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153b4c9-4e86-4d47-91c2-4dc496510293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:24.149338 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153b4c9-4e86-4d47-91c2-4dc496510293 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:24.162167 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1106/2210] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:41:24.166772 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f706fc-7560-4732-b51c-ca507a9b415b admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:24.177361 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f706fc-7560-4732-b51c-ca507a9b415b admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:24.183057 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b3e3f-e13b-4ee5-95a7-9d2ff1424bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:24.183784 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b3e3f-e13b-4ee5-95a7-9d2ff1424bfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:24.184068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b3e3f-e13b-4ee5-95a7-9d2ff1424bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:24.184342 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b3e3f-e13b-4ee5-95a7-9d2ff1424bfa admin admin] PATH_INFO: `/v3/projects/d2c236ba82a84474afe1f622efa223b0/users/81dd3a470c084395892f94aa45b80be5/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:24.199321 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b3e3f-e13b-4ee5-95a7-9d2ff1424bfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c236ba82a84474afe1f622efa223b0, user_id=81dd3a470c084395892f94aa45b80be5, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:24.202251 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b3e3f-e13b-4ee5-95a7-9d2ff1424bfa admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:24.274238 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1105/2211] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:41:24 2022] PUT /identity/v3/projects/d2c236ba82a84474afe1f622efa223b0/users/81dd3a470c084395892f94aa45b80be5/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:41:24.279068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153b4c9-4e86-4d47-91c2-4dc496510293 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:24.289619 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153b4c9-4e86-4d47-91c2-4dc496510293 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:24.324043 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:24.348091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b81f20-9e61-411f-b9b4-c3cf5631b97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:24.348697 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b81f20-9e61-411f-b9b4-c3cf5631b97e admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:24.348974 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b81f20-9e61-411f-b9b4-c3cf5631b97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:24.349270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b81f20-9e61-411f-b9b4-c3cf5631b97e admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:24.349907 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b81f20-9e61-411f-b9b4-c3cf5631b97e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:24.351553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b81f20-9e61-411f-b9b4-c3cf5631b97e admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:24.362408 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1107/2212] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:41:24.366624 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b3e3f-e13b-4ee5-95a7-9d2ff1424bfa admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:24.372831 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:24.378375 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b3e3f-e13b-4ee5-95a7-9d2ff1424bfa admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:24.384361 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1429ca7-0911-4c4c-a551-037a47dca1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:24.384361 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1429ca7-0911-4c4c-a551-037a47dca1cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:24.384361 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1429ca7-0911-4c4c-a551-037a47dca1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:24.384361 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1429ca7-0911-4c4c-a551-037a47dca1cc admin admin] PATH_INFO: `/v3/projects/d2c236ba82a84474afe1f622efa223b0/users/81dd3a470c084395892f94aa45b80be5/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:24.386115 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1429ca7-0911-4c4c-a551-037a47dca1cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c236ba82a84474afe1f622efa223b0, user_id=81dd3a470c084395892f94aa45b80be5, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:24.388795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1429ca7-0911-4c4c-a551-037a47dca1cc admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:24.399143 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1106/2213] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:41:24 2022] PUT /identity/v3/projects/d2c236ba82a84474afe1f622efa223b0/users/81dd3a470c084395892f94aa45b80be5/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:24.410048 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba137066-ed43-4a5a-9e5b-d3b733b4b66c None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:24.410427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba137066-ed43-4a5a-9e5b-d3b733b4b66c None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:24.410756 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba137066-ed43-4a5a-9e5b-d3b733b4b66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:24.444515 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-ba137066-ed43-4a5a-9e5b-d3b733b4b66c None None] MFA Rules not processed for user `81dd3a470c084395892f94aa45b80be5`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:24.444515 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ba137066-ed43-4a5a-9e5b-d3b733b4b66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:24.509748 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1108/2214] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:24 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:41:24.520684 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1429ca7-0911-4c4c-a551-037a47dca1cc admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:24.522546 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-f1429ca7-0911-4c4c-a551-037a47dca1cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:24.582580 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1429ca7-0911-4c4c-a551-037a47dca1cc admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:24.586277 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da04a3-cae5-4f3d-9d75-55e664240bb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:24.587571 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da04a3-cae5-4f3d-9d75-55e664240bb9 service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:24.587571 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da04a3-cae5-4f3d-9d75-55e664240bb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:24.588158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da04a3-cae5-4f3d-9d75-55e664240bb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:24.596877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da04a3-cae5-4f3d-9d75-55e664240bb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:24.598298 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da04a3-cae5-4f3d-9d75-55e664240bb9 service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:24.608359 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1107/2215] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:41:24 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:41:24.666415 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba137066-ed43-4a5a-9e5b-d3b733b4b66c None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:24.667874 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ba137066-ed43-4a5a-9e5b-d3b733b4b66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:24.682017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba137066-ed43-4a5a-9e5b-d3b733b4b66c None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:24.686631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252b9be-1703-4f20-9d27-2e7423e5bd2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:24.687328 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252b9be-1703-4f20-9d27-2e7423e5bd2e service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:24.687678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252b9be-1703-4f20-9d27-2e7423e5bd2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:24.687990 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252b9be-1703-4f20-9d27-2e7423e5bd2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:24.750270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252b9be-1703-4f20-9d27-2e7423e5bd2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:24.751702 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252b9be-1703-4f20-9d27-2e7423e5bd2e service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:24.761587 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1109/2216] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:41:24 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:41:30.682763 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da04a3-cae5-4f3d-9d75-55e664240bb9 service cinder] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:30.745571 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da04a3-cae5-4f3d-9d75-55e664240bb9 service cinder] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:30.750096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b624884-e595-4f8f-a550-0c9be96c6cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:30.750719 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b624884-e595-4f8f-a550-0c9be96c6cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:30.751027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b624884-e595-4f8f-a550-0c9be96c6cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:30.751299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b624884-e595-4f8f-a550-0c9be96c6cf0 admin admin] PATH_INFO: `/v3/users/452e5260c2aa4f9aac00341ae9c2e0bf` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:30.752509 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b624884-e595-4f8f-a550-0c9be96c6cf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=452e5260c2aa4f9aac00341ae9c2e0bf)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:30.754420 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b624884-e595-4f8f-a550-0c9be96c6cf0 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:31.002000 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-9b624884-e595-4f8f-a550-0c9be96c6cf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '452e5260c2aa4f9aac00341ae9c2e0bf'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:31.002582 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-9b624884-e595-4f8f-a550-0c9be96c6cf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '452e5260c2aa4f9aac00341ae9c2e0bf'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:31.083415 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-9b624884-e595-4f8f-a550-0c9be96c6cf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '452e5260c2aa4f9aac00341ae9c2e0bf'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:31.102732 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-9b624884-e595-4f8f-a550-0c9be96c6cf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '452e5260c2aa4f9aac00341ae9c2e0bf'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:31.102732 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-9b624884-e595-4f8f-a550-0c9be96c6cf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '452e5260c2aa4f9aac00341ae9c2e0bf'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:31.113438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1108/2217] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:41:30 2022] DELETE /identity/v3/users/452e5260c2aa4f9aac00341ae9c2e0bf => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:31.117821 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebec0bf-a982-4e80-a363-f6062958affd None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:31.118309 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebec0bf-a982-4e80-a363-f6062958affd None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:31.118431 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebec0bf-a982-4e80-a363-f6062958affd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:31.137758 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-cebec0bf-a982-4e80-a363-f6062958affd None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:31.138983 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-cebec0bf-a982-4e80-a363-f6062958affd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:31.191942 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:31.201832 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1110/2218] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:41:31.217528 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b624884-e595-4f8f-a550-0c9be96c6cf0 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:31.223207 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-9b624884-e595-4f8f-a550-0c9be96c6cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:31.238568 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:31.283679 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b624884-e595-4f8f-a550-0c9be96c6cf0 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:31.287196 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68855d86-2f90-48e3-a96c-6600d27f8769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:31.287798 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68855d86-2f90-48e3-a96c-6600d27f8769 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:31.288078 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68855d86-2f90-48e3-a96c-6600d27f8769 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:31.288350 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68855d86-2f90-48e3-a96c-6600d27f8769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:31.298341 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68855d86-2f90-48e3-a96c-6600d27f8769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:31.308845 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68855d86-2f90-48e3-a96c-6600d27f8769 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:31.309407 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1109/2219] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:41:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:41:31.743370 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebec0bf-a982-4e80-a363-f6062958affd None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:31.745532 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-cebec0bf-a982-4e80-a363-f6062958affd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:31.760595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebec0bf-a982-4e80-a363-f6062958affd None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:31.766023 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec79ad7-c067-4b49-b6f9-a9327fde598e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:31.766928 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec79ad7-c067-4b49-b6f9-a9327fde598e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:31.767223 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec79ad7-c067-4b49-b6f9-a9327fde598e admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:31.767587 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec79ad7-c067-4b49-b6f9-a9327fde598e admin admin] PATH_INFO: `/v3/projects/957cff55f9324526adfaa8ec9ee38b90` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:31.769158 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec79ad7-c067-4b49-b6f9-a9327fde598e admin admin] RBAC: Authorizing `identity:delete_project(project_id=957cff55f9324526adfaa8ec9ee38b90)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:31.771341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec79ad7-c067-4b49-b6f9-a9327fde598e admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:31.902649 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-eec79ad7-c067-4b49-b6f9-a9327fde598e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '957cff55f9324526adfaa8ec9ee38b90', 'request_id': 'req-eec79ad7-c067-4b49-b6f9-a9327fde598e'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:31.908111 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-eec79ad7-c067-4b49-b6f9-a9327fde598e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '957cff55f9324526adfaa8ec9ee38b90', 'request_id': 'req-eec79ad7-c067-4b49-b6f9-a9327fde598e'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:31.915370 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-eec79ad7-c067-4b49-b6f9-a9327fde598e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '957cff55f9324526adfaa8ec9ee38b90', 'request_id': 'req-eec79ad7-c067-4b49-b6f9-a9327fde598e'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:31.991550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-eec79ad7-c067-4b49-b6f9-a9327fde598e admin admin] The token cache is being invalidate because project 957cff55f9324526adfaa8ec9ee38b90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:41:31.991836 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-eec79ad7-c067-4b49-b6f9-a9327fde598e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:31.992452 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-eec79ad7-c067-4b49-b6f9-a9327fde598e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:31.994514 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1111/2220] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:41:31 2022] DELETE /identity/v3/projects/957cff55f9324526adfaa8ec9ee38b90 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:31.998760 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68855d86-2f90-48e3-a96c-6600d27f8769 service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:32.008693 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68855d86-2f90-48e3-a96c-6600d27f8769 service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:32.064863 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63135c7-6903-4f3b-85cd-8519b490daf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:32.065511 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63135c7-6903-4f3b-85cd-8519b490daf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:32.065863 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63135c7-6903-4f3b-85cd-8519b490daf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:32.066112 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63135c7-6903-4f3b-85cd-8519b490daf4 admin admin] PATH_INFO: `/v3/users/81dd3a470c084395892f94aa45b80be5` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:32.067293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63135c7-6903-4f3b-85cd-8519b490daf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81dd3a470c084395892f94aa45b80be5)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:32.069254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63135c7-6903-4f3b-85cd-8519b490daf4 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:32.254164 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d63135c7-6903-4f3b-85cd-8519b490daf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81dd3a470c084395892f94aa45b80be5'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:32.254838 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d63135c7-6903-4f3b-85cd-8519b490daf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81dd3a470c084395892f94aa45b80be5'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:32.359069 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d63135c7-6903-4f3b-85cd-8519b490daf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81dd3a470c084395892f94aa45b80be5'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:32.373380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d63135c7-6903-4f3b-85cd-8519b490daf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81dd3a470c084395892f94aa45b80be5'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:32.374125 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d63135c7-6903-4f3b-85cd-8519b490daf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81dd3a470c084395892f94aa45b80be5'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:32.387509 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1110/2221] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:41:31 2022] DELETE /identity/v3/users/81dd3a470c084395892f94aa45b80be5 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:32.904162 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec79ad7-c067-4b49-b6f9-a9327fde598e admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:32.907761 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-eec79ad7-c067-4b49-b6f9-a9327fde598e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:32.920935 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec79ad7-c067-4b49-b6f9-a9327fde598e admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:32.984330 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0c1f4-7af6-4aae-9960-5756ca5c5399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:32.985388 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0c1f4-7af6-4aae-9960-5756ca5c5399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:32.985388 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0c1f4-7af6-4aae-9960-5756ca5c5399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:32.985620 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0c1f4-7af6-4aae-9960-5756ca5c5399 admin admin] PATH_INFO: `/v3/projects/d2c236ba82a84474afe1f622efa223b0` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:32.986728 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0c1f4-7af6-4aae-9960-5756ca5c5399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c236ba82a84474afe1f622efa223b0)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:32.988669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0c1f4-7af6-4aae-9960-5756ca5c5399 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:33.130463 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-bac0c1f4-7af6-4aae-9960-5756ca5c5399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c236ba82a84474afe1f622efa223b0', 'request_id': 'req-bac0c1f4-7af6-4aae-9960-5756ca5c5399'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:33.136461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-bac0c1f4-7af6-4aae-9960-5756ca5c5399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c236ba82a84474afe1f622efa223b0', 'request_id': 'req-bac0c1f4-7af6-4aae-9960-5756ca5c5399'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:33.142678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-bac0c1f4-7af6-4aae-9960-5756ca5c5399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c236ba82a84474afe1f622efa223b0', 'request_id': 'req-bac0c1f4-7af6-4aae-9960-5756ca5c5399'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:33.226145 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-bac0c1f4-7af6-4aae-9960-5756ca5c5399 admin admin] The token cache is being invalidate because project d2c236ba82a84474afe1f622efa223b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:41:33.226145 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-bac0c1f4-7af6-4aae-9960-5756ca5c5399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:33.226145 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-bac0c1f4-7af6-4aae-9960-5756ca5c5399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:33.227202 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1112/2222] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:41:32 2022] DELETE /identity/v3/projects/d2c236ba82a84474afe1f622efa223b0 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:33.232199 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75428dc-1e49-4e3f-8e53-20d860471649 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:33.232739 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75428dc-1e49-4e3f-8e53-20d860471649 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:33.232982 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75428dc-1e49-4e3f-8e53-20d860471649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:33.254830 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-e75428dc-1e49-4e3f-8e53-20d860471649 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:33.256134 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-e75428dc-1e49-4e3f-8e53-20d860471649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:33.286144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:33.317993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1111/2223] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:41:33.327715 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92dced-783b-40b3-bed9-d002c6fd6e43 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:33.327999 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92dced-783b-40b3-bed9-d002c6fd6e43 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:33.328283 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92dced-783b-40b3-bed9-d002c6fd6e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:33.348693 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-1b92dced-783b-40b3-bed9-d002c6fd6e43 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:33.351162 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-1b92dced-783b-40b3-bed9-d002c6fd6e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:33.358763 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1113/2224] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:41:33.362860 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75428dc-1e49-4e3f-8e53-20d860471649 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:33.373828 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75428dc-1e49-4e3f-8e53-20d860471649 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:33.379743 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c3e86-c972-4e8e-8d06-abcb896f82e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:33.379743 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c3e86-c972-4e8e-8d06-abcb896f82e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:33.379743 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c3e86-c972-4e8e-8d06-abcb896f82e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:33.379743 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c3e86-c972-4e8e-8d06-abcb896f82e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:33.380160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c3e86-c972-4e8e-8d06-abcb896f82e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:41:33.380462 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c3e86-c972-4e8e-8d06-abcb896f82e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:33.382174 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c3e86-c972-4e8e-8d06-abcb896f82e2 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:33.395789 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1112/2225] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:41:33.400148 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92dced-783b-40b3-bed9-d002c6fd6e43 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:33.405838 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:33.409762 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92dced-783b-40b3-bed9-d002c6fd6e43 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:33.414782 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd0155-26c9-4d5b-9ec6-0ce5261a2757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:33.415420 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd0155-26c9-4d5b-9ec6-0ce5261a2757 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:33.415696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd0155-26c9-4d5b-9ec6-0ce5261a2757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:33.416060 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd0155-26c9-4d5b-9ec6-0ce5261a2757 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:33.416832 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd0155-26c9-4d5b-9ec6-0ce5261a2757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:33.418751 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd0155-26c9-4d5b-9ec6-0ce5261a2757 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:33.512699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1114/2226] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:41:33 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:41:33.513821 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c3e86-c972-4e8e-8d06-abcb896f82e2 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:33.524153 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c3e86-c972-4e8e-8d06-abcb896f82e2 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:33.586250 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b60a6-516c-4b56-9558-07955a2688c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:33.587498 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b60a6-516c-4b56-9558-07955a2688c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:33.587498 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b60a6-516c-4b56-9558-07955a2688c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:33.587717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b60a6-516c-4b56-9558-07955a2688c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:33.588387 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b60a6-516c-4b56-9558-07955a2688c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:33.590376 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b60a6-516c-4b56-9558-07955a2688c0 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:33.608014 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd0155-26c9-4d5b-9ec6-0ce5261a2757 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:33.609894 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-05bd0155-26c9-4d5b-9ec6-0ce5261a2757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:33.675091 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1113/2227] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:41:33 2022] POST /identity/v3/users => generated 283 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:41:33.679255 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b60a6-516c-4b56-9558-07955a2688c0 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:33.691104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b60a6-516c-4b56-9558-07955a2688c0 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:33.691497 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd0155-26c9-4d5b-9ec6-0ce5261a2757 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:33.696331 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7788f-87f8-4b31-8097-148431eec4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:33.699995 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7788f-87f8-4b31-8097-148431eec4bd admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:33.699995 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7788f-87f8-4b31-8097-148431eec4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:33.699995 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7788f-87f8-4b31-8097-148431eec4bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:33.699995 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7788f-87f8-4b31-8097-148431eec4bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:33.700489 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afdab1-eb88-4566-a3f1-b3fe10252f8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:33.700489 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afdab1-eb88-4566-a3f1-b3fe10252f8d service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:33.700489 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afdab1-eb88-4566-a3f1-b3fe10252f8d service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:33.700489 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afdab1-eb88-4566-a3f1-b3fe10252f8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:33.700794 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7788f-87f8-4b31-8097-148431eec4bd admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:33.702890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-57afdab1-eb88-4566-a3f1-b3fe10252f8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:33.712064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1114/2228] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:41:33.716512 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7788f-87f8-4b31-8097-148431eec4bd admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:33.717022 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afdab1-eb88-4566-a3f1-b3fe10252f8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:33.718779 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afdab1-eb88-4566-a3f1-b3fe10252f8d service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:33.729399 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7788f-87f8-4b31-8097-148431eec4bd admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:33.732581 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1115/2229] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:41:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:41:33.735362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b8b2d-9a52-462b-8def-d6f805dc8b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:33.735974 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b8b2d-9a52-462b-8def-d6f805dc8b0e admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:33.736308 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b8b2d-9a52-462b-8def-d6f805dc8b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:33.736585 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b8b2d-9a52-462b-8def-d6f805dc8b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:33.737236 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b8b2d-9a52-462b-8def-d6f805dc8b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:33.739278 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b8b2d-9a52-462b-8def-d6f805dc8b0e admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:33.754086 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1115/2230] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:41:33.756458 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afdab1-eb88-4566-a3f1-b3fe10252f8d service nova] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:33.770624 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afdab1-eb88-4566-a3f1-b3fe10252f8d service nova] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:33.776251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94daf1e-39fa-4cc4-9af3-5420bb703178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:33.777039 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94daf1e-39fa-4cc4-9af3-5420bb703178 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:33.777318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94daf1e-39fa-4cc4-9af3-5420bb703178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:33.777585 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94daf1e-39fa-4cc4-9af3-5420bb703178 admin admin] PATH_INFO: `/v3/projects/2629706c48154048912c3a7931f73162/users/712890a53730411490d84ea7e74108ef/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:33.793947 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94daf1e-39fa-4cc4-9af3-5420bb703178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2629706c48154048912c3a7931f73162, user_id=712890a53730411490d84ea7e74108ef, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:33.796818 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94daf1e-39fa-4cc4-9af3-5420bb703178 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:33.895657 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1116/2231] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:41:33 2022] PUT /identity/v3/projects/2629706c48154048912c3a7931f73162/users/712890a53730411490d84ea7e74108ef/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:33.897795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dbe6d-5ce6-4032-8233-e710205eb389 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:33.898153 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dbe6d-5ce6-4032-8233-e710205eb389 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:33.898507 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dbe6d-5ce6-4032-8233-e710205eb389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:33.934205 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-948dbe6d-5ce6-4032-8233-e710205eb389 None None] MFA Rules not processed for user `712890a53730411490d84ea7e74108ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:33.935530 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-948dbe6d-5ce6-4032-8233-e710205eb389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:34.007168 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1116/2232] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:41:34.012529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94daf1e-39fa-4cc4-9af3-5420bb703178 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:34.087282 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94daf1e-39fa-4cc4-9af3-5420bb703178 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:34.092914 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccccbc5-210e-4bad-a047-898eb419e4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:34.093526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccccbc5-210e-4bad-a047-898eb419e4cc admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:34.093944 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccccbc5-210e-4bad-a047-898eb419e4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:34.094226 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccccbc5-210e-4bad-a047-898eb419e4cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:34.094965 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccccbc5-210e-4bad-a047-898eb419e4cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:34.096904 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccccbc5-210e-4bad-a047-898eb419e4cc admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:34.186632 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1117/2233] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:41:34 2022] POST /identity/v3/projects => generated 365 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:41:34.190622 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948dbe6d-5ce6-4032-8233-e710205eb389 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:34.203441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948dbe6d-5ce6-4032-8233-e710205eb389 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:34.230032 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:34.281529 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fba534-40b2-4729-8926-d9daddcd9395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:34.282234 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fba534-40b2-4729-8926-d9daddcd9395 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:34.282432 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fba534-40b2-4729-8926-d9daddcd9395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:34.282708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fba534-40b2-4729-8926-d9daddcd9395 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:34.283380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fba534-40b2-4729-8926-d9daddcd9395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:34.285320 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fba534-40b2-4729-8926-d9daddcd9395 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:34.377341 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1117/2234] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:41:34 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:41:34.381330 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccccbc5-210e-4bad-a047-898eb419e4cc admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:34.392055 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccccbc5-210e-4bad-a047-898eb419e4cc admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:34.396801 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5a764-64f4-41a0-a974-29d539a1a2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:34.397406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5a764-64f4-41a0-a974-29d539a1a2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:34.397678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5a764-64f4-41a0-a974-29d539a1a2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:34.397943 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5a764-64f4-41a0-a974-29d539a1a2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:34.398598 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5a764-64f4-41a0-a974-29d539a1a2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:34.400397 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5a764-64f4-41a0-a974-29d539a1a2c6 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:34.415486 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1118/2235] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:41:34.420749 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fba534-40b2-4729-8926-d9daddcd9395 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:34.430896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fba534-40b2-4729-8926-d9daddcd9395 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:34.436153 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03177f-f22c-47bc-a8cc-98b15d1acdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:34.436793 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03177f-f22c-47bc-a8cc-98b15d1acdc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:34.437071 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03177f-f22c-47bc-a8cc-98b15d1acdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:34.437342 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03177f-f22c-47bc-a8cc-98b15d1acdc1 admin admin] PATH_INFO: `/v3/projects/32a7aa014a304c9696783fd92e43fa9e/users/39bd59eb88024f688f1c6bdca3373ced/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:34.455044 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03177f-f22c-47bc-a8cc-98b15d1acdc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a7aa014a304c9696783fd92e43fa9e, user_id=39bd59eb88024f688f1c6bdca3373ced, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:34.456414 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03177f-f22c-47bc-a8cc-98b15d1acdc1 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:34.565486 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1118/2236] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:41:34 2022] PUT /identity/v3/projects/32a7aa014a304c9696783fd92e43fa9e/users/39bd59eb88024f688f1c6bdca3373ced/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:34.569262 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5a764-64f4-41a0-a974-29d539a1a2c6 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:34.580093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5a764-64f4-41a0-a974-29d539a1a2c6 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:34.593071 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:34.638656 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61d2d1-e9c1-498a-8c46-f256473898d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:34.639303 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61d2d1-e9c1-498a-8c46-f256473898d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:34.639579 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61d2d1-e9c1-498a-8c46-f256473898d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:34.639849 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61d2d1-e9c1-498a-8c46-f256473898d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:34.640486 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61d2d1-e9c1-498a-8c46-f256473898d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:34.642106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61d2d1-e9c1-498a-8c46-f256473898d5 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:34.652162 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1119/2237] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:41:34.656255 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03177f-f22c-47bc-a8cc-98b15d1acdc1 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:34.667698 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03177f-f22c-47bc-a8cc-98b15d1acdc1 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:34.672399 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f96ce3-0a53-4271-b1ac-08c6e3e2072f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:34.673047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f96ce3-0a53-4271-b1ac-08c6e3e2072f admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:34.676136 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f96ce3-0a53-4271-b1ac-08c6e3e2072f admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:34.676136 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f96ce3-0a53-4271-b1ac-08c6e3e2072f admin admin] PATH_INFO: `/v3/projects/32a7aa014a304c9696783fd92e43fa9e/users/39bd59eb88024f688f1c6bdca3373ced/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:34.676136 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f96ce3-0a53-4271-b1ac-08c6e3e2072f admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a7aa014a304c9696783fd92e43fa9e, user_id=39bd59eb88024f688f1c6bdca3373ced, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:34.678162 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f96ce3-0a53-4271-b1ac-08c6e3e2072f admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:34.689414 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1119/2238] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:41:34 2022] PUT /identity/v3/projects/32a7aa014a304c9696783fd92e43fa9e/users/39bd59eb88024f688f1c6bdca3373ced/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:34.699486 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82024c-2c72-487e-9d34-32cfd0587a5e None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:34.700029 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82024c-2c72-487e-9d34-32cfd0587a5e None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:34.700302 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82024c-2c72-487e-9d34-32cfd0587a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:34.727793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-bb82024c-2c72-487e-9d34-32cfd0587a5e None None] MFA Rules not processed for user `39bd59eb88024f688f1c6bdca3373ced`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:34.736557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-bb82024c-2c72-487e-9d34-32cfd0587a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:34.797018 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1120/2239] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:41:34.808812 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f96ce3-0a53-4271-b1ac-08c6e3e2072f admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:34.810592 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-b2f96ce3-0a53-4271-b1ac-08c6e3e2072f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:34.870335 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f96ce3-0a53-4271-b1ac-08c6e3e2072f admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:34.886209 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e03ed2-02fb-4286-9549-2f9da19db0ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:34.886209 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e03ed2-02fb-4286-9549-2f9da19db0ca service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:34.886209 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e03ed2-02fb-4286-9549-2f9da19db0ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:34.886209 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e03ed2-02fb-4286-9549-2f9da19db0ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:34.886570 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e03ed2-02fb-4286-9549-2f9da19db0ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:34.886570 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e03ed2-02fb-4286-9549-2f9da19db0ca service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:34.896127 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1120/2240] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:41:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:41:35.174655 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82024c-2c72-487e-9d34-32cfd0587a5e None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:35.184558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82024c-2c72-487e-9d34-32cfd0587a5e None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:35.188205 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81831717-c704-41a8-bdf2-d4024205fdd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:35.188792 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81831717-c704-41a8-bdf2-d4024205fdd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:35.189066 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81831717-c704-41a8-bdf2-d4024205fdd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:35.189334 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81831717-c704-41a8-bdf2-d4024205fdd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:35.249678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81831717-c704-41a8-bdf2-d4024205fdd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:35.251163 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81831717-c704-41a8-bdf2-d4024205fdd1 service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:35.261213 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1121/2241] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:41:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:41:41.625904 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e03ed2-02fb-4286-9549-2f9da19db0ca service cinder] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:41.689318 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e03ed2-02fb-4286-9549-2f9da19db0ca service cinder] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:41.694145 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf679315-da13-41cf-995c-4ebff9f17e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:41.694883 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf679315-da13-41cf-995c-4ebff9f17e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:41.695168 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf679315-da13-41cf-995c-4ebff9f17e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:41.695444 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf679315-da13-41cf-995c-4ebff9f17e59 admin admin] PATH_INFO: `/v3/users/712890a53730411490d84ea7e74108ef` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:41.696581 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf679315-da13-41cf-995c-4ebff9f17e59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=712890a53730411490d84ea7e74108ef)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:41.698863 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf679315-da13-41cf-995c-4ebff9f17e59 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:41.714951 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:41.898757 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-cf679315-da13-41cf-995c-4ebff9f17e59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '712890a53730411490d84ea7e74108ef'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:41.899486 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-cf679315-da13-41cf-995c-4ebff9f17e59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '712890a53730411490d84ea7e74108ef'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:41.969947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-cf679315-da13-41cf-995c-4ebff9f17e59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '712890a53730411490d84ea7e74108ef'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:41.982746 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-cf679315-da13-41cf-995c-4ebff9f17e59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '712890a53730411490d84ea7e74108ef'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:41.983432 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-cf679315-da13-41cf-995c-4ebff9f17e59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '712890a53730411490d84ea7e74108ef'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:41.996156 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1121/2242] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:41:41 2022] DELETE /identity/v3/users/712890a53730411490d84ea7e74108ef => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:42.000715 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae8c73-3665-4f16-82b5-63612b7a652c None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:42.002680 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae8c73-3665-4f16-82b5-63612b7a652c None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:42.002680 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae8c73-3665-4f16-82b5-63612b7a652c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:42.021173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-28ae8c73-3665-4f16-82b5-63612b7a652c None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:42.022372 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-28ae8c73-3665-4f16-82b5-63612b7a652c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:42.055567 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=100 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:42.082727 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1122/2243] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:41:42.093103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf679315-da13-41cf-995c-4ebff9f17e59 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:42.094729 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-cf679315-da13-41cf-995c-4ebff9f17e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:42.152453 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf679315-da13-41cf-995c-4ebff9f17e59 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:42.156096 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb90a7d-d232-466f-90d1-62812264456f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:42.156725 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb90a7d-d232-466f-90d1-62812264456f service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:42.157006 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb90a7d-d232-466f-90d1-62812264456f service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:42.157280 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb90a7d-d232-466f-90d1-62812264456f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:42.166428 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb90a7d-d232-466f-90d1-62812264456f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:42.167895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb90a7d-d232-466f-90d1-62812264456f service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:42.177347 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1122/2244] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:41:42.675343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae8c73-3665-4f16-82b5-63612b7a652c None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:42.676781 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-28ae8c73-3665-4f16-82b5-63612b7a652c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:42.697054 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae8c73-3665-4f16-82b5-63612b7a652c None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:42.703574 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420445d8-dcfd-4b3b-9c8c-88f8803e1854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:42.704280 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420445d8-dcfd-4b3b-9c8c-88f8803e1854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:42.704478 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420445d8-dcfd-4b3b-9c8c-88f8803e1854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:42.704751 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420445d8-dcfd-4b3b-9c8c-88f8803e1854 admin admin] PATH_INFO: `/v3/projects/2629706c48154048912c3a7931f73162` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:42.706025 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420445d8-dcfd-4b3b-9c8c-88f8803e1854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2629706c48154048912c3a7931f73162)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:42.707904 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420445d8-dcfd-4b3b-9c8c-88f8803e1854 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:42.839252 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-420445d8-dcfd-4b3b-9c8c-88f8803e1854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2629706c48154048912c3a7931f73162', 'request_id': 'req-420445d8-dcfd-4b3b-9c8c-88f8803e1854'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:42.845050 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-420445d8-dcfd-4b3b-9c8c-88f8803e1854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2629706c48154048912c3a7931f73162', 'request_id': 'req-420445d8-dcfd-4b3b-9c8c-88f8803e1854'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:42.851445 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-420445d8-dcfd-4b3b-9c8c-88f8803e1854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2629706c48154048912c3a7931f73162', 'request_id': 'req-420445d8-dcfd-4b3b-9c8c-88f8803e1854'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:42.941100 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-420445d8-dcfd-4b3b-9c8c-88f8803e1854 admin admin] The token cache is being invalidate because project 2629706c48154048912c3a7931f73162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:41:42.941324 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-420445d8-dcfd-4b3b-9c8c-88f8803e1854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:42.941949 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-420445d8-dcfd-4b3b-9c8c-88f8803e1854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:42.943514 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1123/2245] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:41:42 2022] DELETE /identity/v3/projects/2629706c48154048912c3a7931f73162 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:42.947445 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb90a7d-d232-466f-90d1-62812264456f service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:42.957817 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb90a7d-d232-466f-90d1-62812264456f service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:43.015319 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e7fe3-9272-4b15-9228-8b9c1b7deb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:43.016054 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e7fe3-9272-4b15-9228-8b9c1b7deb40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:43.016337 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e7fe3-9272-4b15-9228-8b9c1b7deb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:43.016610 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e7fe3-9272-4b15-9228-8b9c1b7deb40 admin admin] PATH_INFO: `/v3/users/39bd59eb88024f688f1c6bdca3373ced` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:43.017725 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e7fe3-9272-4b15-9228-8b9c1b7deb40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39bd59eb88024f688f1c6bdca3373ced)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:43.019674 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e7fe3-9272-4b15-9228-8b9c1b7deb40 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:43.187132 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:43.198413 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-359e7fe3-9272-4b15-9228-8b9c1b7deb40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39bd59eb88024f688f1c6bdca3373ced'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:43.198413 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-359e7fe3-9272-4b15-9228-8b9c1b7deb40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39bd59eb88024f688f1c6bdca3373ced'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:43.254703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-359e7fe3-9272-4b15-9228-8b9c1b7deb40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39bd59eb88024f688f1c6bdca3373ced'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:43.267921 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-359e7fe3-9272-4b15-9228-8b9c1b7deb40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39bd59eb88024f688f1c6bdca3373ced'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:43.268631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-359e7fe3-9272-4b15-9228-8b9c1b7deb40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39bd59eb88024f688f1c6bdca3373ced'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:43.281624 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1123/2246] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:41:42 2022] DELETE /identity/v3/users/39bd59eb88024f688f1c6bdca3373ced => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:43.683027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420445d8-dcfd-4b3b-9c8c-88f8803e1854 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:43.685712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-420445d8-dcfd-4b3b-9c8c-88f8803e1854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:43.704629 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420445d8-dcfd-4b3b-9c8c-88f8803e1854 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:43.772190 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ae7c6-c212-40b8-9f6c-20ac26043837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:43.772747 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae7c6-c212-40b8-9f6c-20ac26043837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:43.773020 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae7c6-c212-40b8-9f6c-20ac26043837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:43.773296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae7c6-c212-40b8-9f6c-20ac26043837 admin admin] PATH_INFO: `/v3/projects/32a7aa014a304c9696783fd92e43fa9e` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:43.774398 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ae7c6-c212-40b8-9f6c-20ac26043837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32a7aa014a304c9696783fd92e43fa9e)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:43.776496 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ae7c6-c212-40b8-9f6c-20ac26043837 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:43.867785 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-cf3ae7c6-c212-40b8-9f6c-20ac26043837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32a7aa014a304c9696783fd92e43fa9e', 'request_id': 'req-cf3ae7c6-c212-40b8-9f6c-20ac26043837'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:43.873924 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-cf3ae7c6-c212-40b8-9f6c-20ac26043837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32a7aa014a304c9696783fd92e43fa9e', 'request_id': 'req-cf3ae7c6-c212-40b8-9f6c-20ac26043837'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:43.880292 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-cf3ae7c6-c212-40b8-9f6c-20ac26043837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32a7aa014a304c9696783fd92e43fa9e', 'request_id': 'req-cf3ae7c6-c212-40b8-9f6c-20ac26043837'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:43.881940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:43.969266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-cf3ae7c6-c212-40b8-9f6c-20ac26043837 admin admin] The token cache is being invalidate because project 32a7aa014a304c9696783fd92e43fa9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:41:43.969578 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-cf3ae7c6-c212-40b8-9f6c-20ac26043837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:43.970320 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-cf3ae7c6-c212-40b8-9f6c-20ac26043837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:43.971871 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1124/2247] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:41:43 2022] DELETE /identity/v3/projects/32a7aa014a304c9696783fd92e43fa9e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:43.977621 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3624927-7c31-48c5-b53a-85efe1291716 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:43.977621 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3624927-7c31-48c5-b53a-85efe1291716 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:43.977621 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3624927-7c31-48c5-b53a-85efe1291716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:43.997496 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-e3624927-7c31-48c5-b53a-85efe1291716 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:43.999340 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-e3624927-7c31-48c5-b53a-85efe1291716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:44.058324 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1124/2248] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:41:44.067957 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44539824-7dd9-4e68-a61a-a510e5ffe11f None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:44.068236 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44539824-7dd9-4e68-a61a-a510e5ffe11f None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:44.068504 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44539824-7dd9-4e68-a61a-a510e5ffe11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:44.088559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-44539824-7dd9-4e68-a61a-a510e5ffe11f None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:44.089759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-44539824-7dd9-4e68-a61a-a510e5ffe11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:44.097743 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1125/2249] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:41:44.107081 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3624927-7c31-48c5-b53a-85efe1291716 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:44.117393 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3624927-7c31-48c5-b53a-85efe1291716 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:44.121910 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8acfa9-6c2f-4f6f-ab26-122dc56d0604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:44.122497 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8acfa9-6c2f-4f6f-ab26-122dc56d0604 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:44.122770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8acfa9-6c2f-4f6f-ab26-122dc56d0604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:44.123606 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8acfa9-6c2f-4f6f-ab26-122dc56d0604 admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:44.124262 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8acfa9-6c2f-4f6f-ab26-122dc56d0604 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:41:44.124560 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8acfa9-6c2f-4f6f-ab26-122dc56d0604 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:44.126183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8acfa9-6c2f-4f6f-ab26-122dc56d0604 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:44.137600 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1125/2250] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:41:44.142462 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44539824-7dd9-4e68-a61a-a510e5ffe11f None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:44.151651 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44539824-7dd9-4e68-a61a-a510e5ffe11f None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:44.156744 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218f639-2427-424a-abf3-8772b85bd76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:44.157326 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218f639-2427-424a-abf3-8772b85bd76c admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:44.157627 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218f639-2427-424a-abf3-8772b85bd76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:44.157890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218f639-2427-424a-abf3-8772b85bd76c admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:44.158507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218f639-2427-424a-abf3-8772b85bd76c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:44.160448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218f639-2427-424a-abf3-8772b85bd76c admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:44.240901 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1126/2251] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:41:44 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:41:44.244862 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8acfa9-6c2f-4f6f-ab26-122dc56d0604 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:44.255829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8acfa9-6c2f-4f6f-ab26-122dc56d0604 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:44.315317 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10763111-9c68-4105-bdbd-a1d24be55ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:44.315317 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10763111-9c68-4105-bdbd-a1d24be55ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:44.315317 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10763111-9c68-4105-bdbd-a1d24be55ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:44.315317 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10763111-9c68-4105-bdbd-a1d24be55ae5 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:44.315731 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10763111-9c68-4105-bdbd-a1d24be55ae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:44.317366 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10763111-9c68-4105-bdbd-a1d24be55ae5 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:44.432703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1126/2252] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:41:44 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:41:44.436878 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218f639-2427-424a-abf3-8772b85bd76c admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:44.447221 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218f639-2427-424a-abf3-8772b85bd76c admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:44.452566 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43653dc-aee2-4686-90fa-d628cc519ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:44.453186 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43653dc-aee2-4686-90fa-d628cc519ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:44.453463 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43653dc-aee2-4686-90fa-d628cc519ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:44.453733 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43653dc-aee2-4686-90fa-d628cc519ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:44.454469 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43653dc-aee2-4686-90fa-d628cc519ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:44.456118 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43653dc-aee2-4686-90fa-d628cc519ed0 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:44.466078 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1127/2253] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:41:44.470613 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10763111-9c68-4105-bdbd-a1d24be55ae5 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:44.480718 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10763111-9c68-4105-bdbd-a1d24be55ae5 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:44.486299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bbcc6-c870-4501-9bf9-a82dfdc41442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:44.486916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bbcc6-c870-4501-9bf9-a82dfdc41442 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:44.487195 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bbcc6-c870-4501-9bf9-a82dfdc41442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:44.487464 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bbcc6-c870-4501-9bf9-a82dfdc41442 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:44.488102 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bbcc6-c870-4501-9bf9-a82dfdc41442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:44.489721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bbcc6-c870-4501-9bf9-a82dfdc41442 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:44.501293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1127/2254] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:41:44.505332 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43653dc-aee2-4686-90fa-d628cc519ed0 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:44.515371 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43653dc-aee2-4686-90fa-d628cc519ed0 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:44.519992 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d2b86-f42d-4a22-943f-89575f77c1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:44.520630 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d2b86-f42d-4a22-943f-89575f77c1f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:44.520910 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d2b86-f42d-4a22-943f-89575f77c1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:44.521179 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d2b86-f42d-4a22-943f-89575f77c1f9 admin admin] PATH_INFO: `/v3/projects/635b22f5ddf34abd938454b9236c4abb/users/072ac7e81c2c414b9ab4b0e32bd4d159/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:44.536252 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d2b86-f42d-4a22-943f-89575f77c1f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=635b22f5ddf34abd938454b9236c4abb, user_id=072ac7e81c2c414b9ab4b0e32bd4d159, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:44.538972 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d2b86-f42d-4a22-943f-89575f77c1f9 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:44.633034 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1128/2255] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:41:44 2022] PUT /identity/v3/projects/635b22f5ddf34abd938454b9236c4abb/users/072ac7e81c2c414b9ab4b0e32bd4d159/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:44.643813 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50570c-bea1-4cf6-81a4-e1643cd664fd None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:44.644207 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50570c-bea1-4cf6-81a4-e1643cd664fd None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:44.644537 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50570c-bea1-4cf6-81a4-e1643cd664fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:44.673779 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-0f50570c-bea1-4cf6-81a4-e1643cd664fd None None] MFA Rules not processed for user `072ac7e81c2c414b9ab4b0e32bd4d159`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:44.675045 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-0f50570c-bea1-4cf6-81a4-e1643cd664fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:44.683092 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:44.744065 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1128/2256] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:41:44.748621 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d2b86-f42d-4a22-943f-89575f77c1f9 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:44.811732 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d2b86-f42d-4a22-943f-89575f77c1f9 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:44.816662 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1291092-b804-4e89-8acc-9d9f90c77dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:44.817315 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1291092-b804-4e89-8acc-9d9f90c77dfc admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:44.817639 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1291092-b804-4e89-8acc-9d9f90c77dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:44.817914 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1291092-b804-4e89-8acc-9d9f90c77dfc admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:44.818537 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1291092-b804-4e89-8acc-9d9f90c77dfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:44.820589 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1291092-b804-4e89-8acc-9d9f90c77dfc admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:44.910298 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1129/2257] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:41:44 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:41:44.913651 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50570c-bea1-4cf6-81a4-e1643cd664fd None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:44.924467 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50570c-bea1-4cf6-81a4-e1643cd664fd None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:44.980732 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbbe5a-a2d1-4123-9264-4672ddbf7492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:44.981545 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbbe5a-a2d1-4123-9264-4672ddbf7492 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:44.981651 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbbe5a-a2d1-4123-9264-4672ddbf7492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:44.981853 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbbe5a-a2d1-4123-9264-4672ddbf7492 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:44.982522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fbbe5a-a2d1-4123-9264-4672ddbf7492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:44.984456 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fbbe5a-a2d1-4123-9264-4672ddbf7492 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:45.061348 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1129/2258] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:41:44 2022] POST /identity/v3/users => generated 300 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:41:45.065461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1291092-b804-4e89-8acc-9d9f90c77dfc admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:45.076804 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1291092-b804-4e89-8acc-9d9f90c77dfc admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:45.081696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3396bf1-cfc9-494a-be7b-b84198d228b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:45.082284 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3396bf1-cfc9-494a-be7b-b84198d228b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:45.082563 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3396bf1-cfc9-494a-be7b-b84198d228b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:45.082927 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3396bf1-cfc9-494a-be7b-b84198d228b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:45.083565 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3396bf1-cfc9-494a-be7b-b84198d228b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:45.085160 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3396bf1-cfc9-494a-be7b-b84198d228b2 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:45.096759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1130/2259] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:41:45.100945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbbe5a-a2d1-4123-9264-4672ddbf7492 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:45.111317 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbbe5a-a2d1-4123-9264-4672ddbf7492 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:45.115936 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f65483-2bf3-45a8-856c-681b1b5dfc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:45.116580 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f65483-2bf3-45a8-856c-681b1b5dfc0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:45.116858 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f65483-2bf3-45a8-856c-681b1b5dfc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:45.117133 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f65483-2bf3-45a8-856c-681b1b5dfc0f admin admin] PATH_INFO: `/v3/projects/3ffa7d9022094d3ba242c6f42f168709/users/15edce2fc5cc474d8e850ab616f87446/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:45.132671 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f65483-2bf3-45a8-856c-681b1b5dfc0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ffa7d9022094d3ba242c6f42f168709, user_id=15edce2fc5cc474d8e850ab616f87446, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:45.135414 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f65483-2bf3-45a8-856c-681b1b5dfc0f admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:45.233467 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1130/2260] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:41:45 2022] PUT /identity/v3/projects/3ffa7d9022094d3ba242c6f42f168709/users/15edce2fc5cc474d8e850ab616f87446/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:41:45.237630 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3396bf1-cfc9-494a-be7b-b84198d228b2 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:45.248433 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3396bf1-cfc9-494a-be7b-b84198d228b2 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:45.305582 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d7fa9-123d-42a0-b2e7-67d643ba020a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:45.306180 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d7fa9-123d-42a0-b2e7-67d643ba020a admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:45.306453 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d7fa9-123d-42a0-b2e7-67d643ba020a admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:45.306718 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d7fa9-123d-42a0-b2e7-67d643ba020a admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:45.307376 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d7fa9-123d-42a0-b2e7-67d643ba020a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:45.308957 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d7fa9-123d-42a0-b2e7-67d643ba020a admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:45.311568 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:45.319712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1131/2261] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:41:45.323740 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f65483-2bf3-45a8-856c-681b1b5dfc0f admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:45.335262 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f65483-2bf3-45a8-856c-681b1b5dfc0f admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:45.339833 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374c433-6002-4da7-963b-538227cce869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:45.340465 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374c433-6002-4da7-963b-538227cce869 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:45.340740 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374c433-6002-4da7-963b-538227cce869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:45.341014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374c433-6002-4da7-963b-538227cce869 admin admin] PATH_INFO: `/v3/projects/3ffa7d9022094d3ba242c6f42f168709/users/15edce2fc5cc474d8e850ab616f87446/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:45.343437 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374c433-6002-4da7-963b-538227cce869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ffa7d9022094d3ba242c6f42f168709, user_id=15edce2fc5cc474d8e850ab616f87446, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:45.346073 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374c433-6002-4da7-963b-538227cce869 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:45.356205 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1131/2262] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:41:45 2022] PUT /identity/v3/projects/3ffa7d9022094d3ba242c6f42f168709/users/15edce2fc5cc474d8e850ab616f87446/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:45.366731 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450c17f-4fd1-48c6-b052-2776e4d78ca7 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:45.367039 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450c17f-4fd1-48c6-b052-2776e4d78ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:45.367311 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450c17f-4fd1-48c6-b052-2776e4d78ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:45.396896 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-9450c17f-4fd1-48c6-b052-2776e4d78ca7 None None] MFA Rules not processed for user `15edce2fc5cc474d8e850ab616f87446`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:45.398102 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-9450c17f-4fd1-48c6-b052-2776e4d78ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:45.465717 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1132/2263] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:45 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:41:45.476255 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374c433-6002-4da7-963b-538227cce869 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:45.477925 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-1374c433-6002-4da7-963b-538227cce869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:45.536151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374c433-6002-4da7-963b-538227cce869 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:45.539741 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1cdb0-8883-4c6c-aae3-99522c868e24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:45.540331 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1cdb0-8883-4c6c-aae3-99522c868e24 service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:45.540604 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1cdb0-8883-4c6c-aae3-99522c868e24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:45.540874 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1cdb0-8883-4c6c-aae3-99522c868e24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:45.550645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1cdb0-8883-4c6c-aae3-99522c868e24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:45.552085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1cdb0-8883-4c6c-aae3-99522c868e24 service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:45.561908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1132/2264] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:41:45 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:41:46.790541 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450c17f-4fd1-48c6-b052-2776e4d78ca7 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:46.852679 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450c17f-4fd1-48c6-b052-2776e4d78ca7 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:46.857318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd0ba4-1443-4274-b1fd-34525f279fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:46.857937 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd0ba4-1443-4274-b1fd-34525f279fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:46.858209 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd0ba4-1443-4274-b1fd-34525f279fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:46.858473 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd0ba4-1443-4274-b1fd-34525f279fef admin admin] PATH_INFO: `/v3/users/072ac7e81c2c414b9ab4b0e32bd4d159` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:46.859711 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd0ba4-1443-4274-b1fd-34525f279fef admin admin] RBAC: Authorizing `identity:delete_user(user_id=072ac7e81c2c414b9ab4b0e32bd4d159)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:46.861817 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd0ba4-1443-4274-b1fd-34525f279fef admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:47.029821 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-bccd0ba4-1443-4274-b1fd-34525f279fef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '072ac7e81c2c414b9ab4b0e32bd4d159'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:47.030474 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-bccd0ba4-1443-4274-b1fd-34525f279fef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '072ac7e81c2c414b9ab4b0e32bd4d159'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:47.089746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-bccd0ba4-1443-4274-b1fd-34525f279fef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '072ac7e81c2c414b9ab4b0e32bd4d159'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:47.098041 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-bccd0ba4-1443-4274-b1fd-34525f279fef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '072ac7e81c2c414b9ab4b0e32bd4d159'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:47.098690 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-bccd0ba4-1443-4274-b1fd-34525f279fef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '072ac7e81c2c414b9ab4b0e32bd4d159'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:47.116454 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1133/2265] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:41:46 2022] DELETE /identity/v3/users/072ac7e81c2c414b9ab4b0e32bd4d159 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:47.120728 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a2a09-f1ac-47ef-a34e-a6f6200b17b5 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:47.121219 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a2a09-f1ac-47ef-a34e-a6f6200b17b5 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:47.121330 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a2a09-f1ac-47ef-a34e-a6f6200b17b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:47.129943 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:47.141853 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-dc5a2a09-f1ac-47ef-a34e-a6f6200b17b5 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:47.143113 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-dc5a2a09-f1ac-47ef-a34e-a6f6200b17b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:47.204854 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1133/2266] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:41:47.214769 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd0ba4-1443-4274-b1fd-34525f279fef admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:47.216536 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-bccd0ba4-1443-4274-b1fd-34525f279fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:47.222474 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:47.275712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd0ba4-1443-4274-b1fd-34525f279fef admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:47.279478 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d35534-c1e2-4150-865c-d5f6055242eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:47.280077 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d35534-c1e2-4150-865c-d5f6055242eb service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:47.280353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d35534-c1e2-4150-865c-d5f6055242eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:47.280623 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d35534-c1e2-4150-865c-d5f6055242eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:47.290790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d35534-c1e2-4150-865c-d5f6055242eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:47.293893 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d35534-c1e2-4150-865c-d5f6055242eb service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:47.301862 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1134/2267] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:41:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:41:47.692157 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a2a09-f1ac-47ef-a34e-a6f6200b17b5 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:47.693627 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-dc5a2a09-f1ac-47ef-a34e-a6f6200b17b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:47.708859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a2a09-f1ac-47ef-a34e-a6f6200b17b5 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:47.714189 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd76e9-c594-464b-ba92-8c8e6dca5ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:47.718277 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd76e9-c594-464b-ba92-8c8e6dca5ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:47.718277 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd76e9-c594-464b-ba92-8c8e6dca5ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:47.718277 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd76e9-c594-464b-ba92-8c8e6dca5ea0 admin admin] PATH_INFO: `/v3/projects/635b22f5ddf34abd938454b9236c4abb` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:47.718277 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd76e9-c594-464b-ba92-8c8e6dca5ea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=635b22f5ddf34abd938454b9236c4abb)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:47.719139 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd76e9-c594-464b-ba92-8c8e6dca5ea0 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:47.805260 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-17bd76e9-c594-464b-ba92-8c8e6dca5ea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '635b22f5ddf34abd938454b9236c4abb', 'request_id': 'req-17bd76e9-c594-464b-ba92-8c8e6dca5ea0'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:47.810832 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-17bd76e9-c594-464b-ba92-8c8e6dca5ea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '635b22f5ddf34abd938454b9236c4abb', 'request_id': 'req-17bd76e9-c594-464b-ba92-8c8e6dca5ea0'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:47.861515 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-17bd76e9-c594-464b-ba92-8c8e6dca5ea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '635b22f5ddf34abd938454b9236c4abb', 'request_id': 'req-17bd76e9-c594-464b-ba92-8c8e6dca5ea0'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:47.872878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-17bd76e9-c594-464b-ba92-8c8e6dca5ea0 admin admin] The token cache is being invalidate because project 635b22f5ddf34abd938454b9236c4abb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:41:47.873167 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-17bd76e9-c594-464b-ba92-8c8e6dca5ea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:47.873794 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-17bd76e9-c594-464b-ba92-8c8e6dca5ea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:47.876127 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1134/2268] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:41:47 2022] DELETE /identity/v3/projects/635b22f5ddf34abd938454b9236c4abb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:47.880198 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d35534-c1e2-4150-865c-d5f6055242eb service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:47.889886 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d35534-c1e2-4150-865c-d5f6055242eb service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:47.946547 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd6b0e-d9db-49e2-8245-66247a878747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:47.947149 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd6b0e-d9db-49e2-8245-66247a878747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:47.947430 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd6b0e-d9db-49e2-8245-66247a878747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:47.947701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd6b0e-d9db-49e2-8245-66247a878747 admin admin] PATH_INFO: `/v3/users/15edce2fc5cc474d8e850ab616f87446` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:47.948812 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd6b0e-d9db-49e2-8245-66247a878747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15edce2fc5cc474d8e850ab616f87446)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:47.951060 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd6b0e-d9db-49e2-8245-66247a878747 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:48.104221 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-05bd6b0e-d9db-49e2-8245-66247a878747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15edce2fc5cc474d8e850ab616f87446'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:48.104865 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-05bd6b0e-d9db-49e2-8245-66247a878747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15edce2fc5cc474d8e850ab616f87446'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:48.175720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-05bd6b0e-d9db-49e2-8245-66247a878747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15edce2fc5cc474d8e850ab616f87446'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:48.183208 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-05bd6b0e-d9db-49e2-8245-66247a878747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15edce2fc5cc474d8e850ab616f87446'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:48.183915 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-05bd6b0e-d9db-49e2-8245-66247a878747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15edce2fc5cc474d8e850ab616f87446'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:48.201776 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1135/2269] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:41:47 2022] DELETE /identity/v3/users/15edce2fc5cc474d8e850ab616f87446 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:48.640353 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd76e9-c594-464b-ba92-8c8e6dca5ea0 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:48.641797 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-17bd76e9-c594-464b-ba92-8c8e6dca5ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:48.657039 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd76e9-c594-464b-ba92-8c8e6dca5ea0 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:48.717602 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaabe7f-0f60-4150-838d-c0feeb53d577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:48.718220 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaabe7f-0f60-4150-838d-c0feeb53d577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:48.718497 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaabe7f-0f60-4150-838d-c0feeb53d577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:48.718772 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaabe7f-0f60-4150-838d-c0feeb53d577 admin admin] PATH_INFO: `/v3/projects/3ffa7d9022094d3ba242c6f42f168709` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:48.719936 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaabe7f-0f60-4150-838d-c0feeb53d577 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ffa7d9022094d3ba242c6f42f168709)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:48.721854 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaabe7f-0f60-4150-838d-c0feeb53d577 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:48.820666 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:48.834398 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-fdaabe7f-0f60-4150-838d-c0feeb53d577 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ffa7d9022094d3ba242c6f42f168709', 'request_id': 'req-fdaabe7f-0f60-4150-838d-c0feeb53d577'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:48.839854 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-fdaabe7f-0f60-4150-838d-c0feeb53d577 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ffa7d9022094d3ba242c6f42f168709', 'request_id': 'req-fdaabe7f-0f60-4150-838d-c0feeb53d577'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:48.901294 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-fdaabe7f-0f60-4150-838d-c0feeb53d577 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ffa7d9022094d3ba242c6f42f168709', 'request_id': 'req-fdaabe7f-0f60-4150-838d-c0feeb53d577'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:48.913260 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-fdaabe7f-0f60-4150-838d-c0feeb53d577 admin admin] The token cache is being invalidate because project 3ffa7d9022094d3ba242c6f42f168709 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:41:48.913550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-fdaabe7f-0f60-4150-838d-c0feeb53d577 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:48.914180 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-fdaabe7f-0f60-4150-838d-c0feeb53d577 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:48.915704 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1135/2270] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:41:48 2022] DELETE /identity/v3/projects/3ffa7d9022094d3ba242c6f42f168709 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:48.920490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5a109-f276-4694-be87-2df65ffd0df1 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:48.920996 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5a109-f276-4694-be87-2df65ffd0df1 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:48.921101 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5a109-f276-4694-be87-2df65ffd0df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:48.942207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-03b5a109-f276-4694-be87-2df65ffd0df1 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:48.943463 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-03b5a109-f276-4694-be87-2df65ffd0df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:48.962383 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:49.004126 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1136/2271] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:41:49.012864 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574c22c-dd03-46ee-baa2-005e3c6a9fdd None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:49.013151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574c22c-dd03-46ee-baa2-005e3c6a9fdd None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:49.013429 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574c22c-dd03-46ee-baa2-005e3c6a9fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:49.034260 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-0574c22c-dd03-46ee-baa2-005e3c6a9fdd None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:49.035501 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-0574c22c-dd03-46ee-baa2-005e3c6a9fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:49.043406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1136/2272] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:41:49.048354 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5a109-f276-4694-be87-2df65ffd0df1 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:49.058453 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5a109-f276-4694-be87-2df65ffd0df1 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:49.063225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfdba4-057e-47ed-9bba-297576364bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:49.063821 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfdba4-057e-47ed-9bba-297576364bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:49.064098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfdba4-057e-47ed-9bba-297576364bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:49.064365 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfdba4-057e-47ed-9bba-297576364bc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:49.065010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfdba4-057e-47ed-9bba-297576364bc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:41:49.065312 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfdba4-057e-47ed-9bba-297576364bc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:49.066977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfdba4-057e-47ed-9bba-297576364bc3 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:49.078736 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1137/2273] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:41:49.083219 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574c22c-dd03-46ee-baa2-005e3c6a9fdd None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:49.092311 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574c22c-dd03-46ee-baa2-005e3c6a9fdd None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:49.097974 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103e9ff-07d1-4db8-8b5f-7f99afc62017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:49.098794 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103e9ff-07d1-4db8-8b5f-7f99afc62017 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:49.099224 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103e9ff-07d1-4db8-8b5f-7f99afc62017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:49.099385 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103e9ff-07d1-4db8-8b5f-7f99afc62017 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:49.100016 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103e9ff-07d1-4db8-8b5f-7f99afc62017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:49.101917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103e9ff-07d1-4db8-8b5f-7f99afc62017 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:49.194454 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1137/2274] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:41:49 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:41:49.198657 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfdba4-057e-47ed-9bba-297576364bc3 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:49.209575 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfdba4-057e-47ed-9bba-297576364bc3 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:49.270174 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97b863-34f3-4805-b910-94248e16a493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:49.270805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97b863-34f3-4805-b910-94248e16a493 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:49.271118 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97b863-34f3-4805-b910-94248e16a493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:49.271389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97b863-34f3-4805-b910-94248e16a493 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:49.272028 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97b863-34f3-4805-b910-94248e16a493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:49.273952 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97b863-34f3-4805-b910-94248e16a493 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:49.474412 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1138/2275] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:41:49 2022] POST /identity/v3/users => generated 287 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:41:49.478509 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103e9ff-07d1-4db8-8b5f-7f99afc62017 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:49.489334 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103e9ff-07d1-4db8-8b5f-7f99afc62017 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:49.494007 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c02a04-2fd9-4fd3-a49d-a0a7c0476cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:49.494607 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c02a04-2fd9-4fd3-a49d-a0a7c0476cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:49.494913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c02a04-2fd9-4fd3-a49d-a0a7c0476cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:49.495207 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c02a04-2fd9-4fd3-a49d-a0a7c0476cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:49.495852 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c02a04-2fd9-4fd3-a49d-a0a7c0476cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:49.497454 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c02a04-2fd9-4fd3-a49d-a0a7c0476cd4 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:49.508009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1138/2276] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:41:49.513431 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97b863-34f3-4805-b910-94248e16a493 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:49.524427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97b863-34f3-4805-b910-94248e16a493 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:49.528894 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf518617-c5bf-4ae3-93e8-1769ba3785ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:49.529473 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf518617-c5bf-4ae3-93e8-1769ba3785ab admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:49.529747 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf518617-c5bf-4ae3-93e8-1769ba3785ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:49.530015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf518617-c5bf-4ae3-93e8-1769ba3785ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:49.530646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf518617-c5bf-4ae3-93e8-1769ba3785ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:49.533527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf518617-c5bf-4ae3-93e8-1769ba3785ab admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:49.543919 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1139/2277] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:41:49.548092 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c02a04-2fd9-4fd3-a49d-a0a7c0476cd4 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:49.557787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c02a04-2fd9-4fd3-a49d-a0a7c0476cd4 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:49.562237 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e2cfb-55af-40d3-a20e-a500c64b7125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:49.563397 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e2cfb-55af-40d3-a20e-a500c64b7125 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:49.563664 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e2cfb-55af-40d3-a20e-a500c64b7125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:49.563931 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e2cfb-55af-40d3-a20e-a500c64b7125 admin admin] PATH_INFO: `/v3/projects/aed06339ca614686ae1b0a7a712cee23/users/5926904e54dc438fbe9f35a45dd488dc/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:49.579049 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e2cfb-55af-40d3-a20e-a500c64b7125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aed06339ca614686ae1b0a7a712cee23, user_id=5926904e54dc438fbe9f35a45dd488dc, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:49.581703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e2cfb-55af-40d3-a20e-a500c64b7125 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:49.655805 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1139/2278] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:41:49 2022] PUT /identity/v3/projects/aed06339ca614686ae1b0a7a712cee23/users/5926904e54dc438fbe9f35a45dd488dc/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:41:49.666147 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de4b16-d136-4a40-b3e5-a8621be787a7 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:49.666420 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de4b16-d136-4a40-b3e5-a8621be787a7 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:49.666688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de4b16-d136-4a40-b3e5-a8621be787a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:49.694824 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-47de4b16-d136-4a40-b3e5-a8621be787a7 None None] MFA Rules not processed for user `5926904e54dc438fbe9f35a45dd488dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:49.696050 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-47de4b16-d136-4a40-b3e5-a8621be787a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:49.764961 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1140/2279] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:41:49.777061 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e2cfb-55af-40d3-a20e-a500c64b7125 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:49.778697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-1e8e2cfb-55af-40d3-a20e-a500c64b7125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:49.840714 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e2cfb-55af-40d3-a20e-a500c64b7125 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:49.845721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994a42d-ea6f-4e0e-8821-edd154688ed2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:49.846682 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994a42d-ea6f-4e0e-8821-edd154688ed2 service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:49.847183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994a42d-ea6f-4e0e-8821-edd154688ed2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:49.847627 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994a42d-ea6f-4e0e-8821-edd154688ed2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:49.858019 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b994a42d-ea6f-4e0e-8821-edd154688ed2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:49.859579 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b994a42d-ea6f-4e0e-8821-edd154688ed2 service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:49.870541 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1140/2280] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:41:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:41:49.894101 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de4b16-d136-4a40-b3e5-a8621be787a7 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:49.915961 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:49.960940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de4b16-d136-4a40-b3e5-a8621be787a7 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:49.965715 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d8099-f863-49c4-82c7-e12af8848b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:49.966553 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d8099-f863-49c4-82c7-e12af8848b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:49.966851 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d8099-f863-49c4-82c7-e12af8848b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:49.967127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d8099-f863-49c4-82c7-e12af8848b2a admin admin] PATH_INFO: `/v3/users/5926904e54dc438fbe9f35a45dd488dc` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:49.968293 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d8099-f863-49c4-82c7-e12af8848b2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5926904e54dc438fbe9f35a45dd488dc)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:49.970635 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d8099-f863-49c4-82c7-e12af8848b2a admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:50.122421 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-4b1d8099-f863-49c4-82c7-e12af8848b2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5926904e54dc438fbe9f35a45dd488dc'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:50.123099 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-4b1d8099-f863-49c4-82c7-e12af8848b2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5926904e54dc438fbe9f35a45dd488dc'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:50.181804 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-4b1d8099-f863-49c4-82c7-e12af8848b2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5926904e54dc438fbe9f35a45dd488dc'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:50.193063 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-4b1d8099-f863-49c4-82c7-e12af8848b2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5926904e54dc438fbe9f35a45dd488dc'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:50.193758 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-4b1d8099-f863-49c4-82c7-e12af8848b2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5926904e54dc438fbe9f35a45dd488dc'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:50.212635 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1141/2281] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:41:49 2022] DELETE /identity/v3/users/5926904e54dc438fbe9f35a45dd488dc => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:50.222618 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81965b67-f270-4ddc-9eba-d149a10ebf45 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:50.222618 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81965b67-f270-4ddc-9eba-d149a10ebf45 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:50.222618 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81965b67-f270-4ddc-9eba-d149a10ebf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:50.239330 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-81965b67-f270-4ddc-9eba-d149a10ebf45 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:50.240596 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-81965b67-f270-4ddc-9eba-d149a10ebf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:50.291645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:50.307872 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1141/2282] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:41:50.318380 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d8099-f863-49c4-82c7-e12af8848b2a admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:50.319892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-4b1d8099-f863-49c4-82c7-e12af8848b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:50.381063 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d8099-f863-49c4-82c7-e12af8848b2a admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:50.384718 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a7700-8065-4b8d-8a9e-d2911faf0f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:50.385330 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a7700-8065-4b8d-8a9e-d2911faf0f92 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:50.385629 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a7700-8065-4b8d-8a9e-d2911faf0f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:50.385910 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a7700-8065-4b8d-8a9e-d2911faf0f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:50.395515 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a7700-8065-4b8d-8a9e-d2911faf0f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:50.397016 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a7700-8065-4b8d-8a9e-d2911faf0f92 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:50.407595 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1142/2283] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:41:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:41:50.829620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81965b67-f270-4ddc-9eba-d149a10ebf45 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:50.831197 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-81965b67-f270-4ddc-9eba-d149a10ebf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:50.847447 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81965b67-f270-4ddc-9eba-d149a10ebf45 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:50.852357 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b916f1-7ffb-4f68-b0ae-f347a663b17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:50.853003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b916f1-7ffb-4f68-b0ae-f347a663b17f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:50.853280 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b916f1-7ffb-4f68-b0ae-f347a663b17f admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:50.853550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b916f1-7ffb-4f68-b0ae-f347a663b17f admin admin] PATH_INFO: `/v3/projects/aed06339ca614686ae1b0a7a712cee23` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:50.854929 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b916f1-7ffb-4f68-b0ae-f347a663b17f admin admin] RBAC: Authorizing `identity:delete_project(project_id=aed06339ca614686ae1b0a7a712cee23)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:50.856936 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b916f1-7ffb-4f68-b0ae-f347a663b17f admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:50.984201 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-48b916f1-7ffb-4f68-b0ae-f347a663b17f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aed06339ca614686ae1b0a7a712cee23', 'request_id': 'req-48b916f1-7ffb-4f68-b0ae-f347a663b17f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:50.991298 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-48b916f1-7ffb-4f68-b0ae-f347a663b17f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aed06339ca614686ae1b0a7a712cee23', 'request_id': 'req-48b916f1-7ffb-4f68-b0ae-f347a663b17f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:51.084766 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-48b916f1-7ffb-4f68-b0ae-f347a663b17f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aed06339ca614686ae1b0a7a712cee23', 'request_id': 'req-48b916f1-7ffb-4f68-b0ae-f347a663b17f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:51.097607 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-48b916f1-7ffb-4f68-b0ae-f347a663b17f admin admin] The token cache is being invalidate because project aed06339ca614686ae1b0a7a712cee23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:41:51.097846 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-48b916f1-7ffb-4f68-b0ae-f347a663b17f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:51.098611 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-48b916f1-7ffb-4f68-b0ae-f347a663b17f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:41:51.100123 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1142/2284] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:41:50 2022] DELETE /identity/v3/projects/aed06339ca614686ae1b0a7a712cee23 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:51.104925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7d37d-eb11-4e01-bf07-29deef48b8f8 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:51.105394 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7d37d-eb11-4e01-bf07-29deef48b8f8 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:51.105496 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7d37d-eb11-4e01-bf07-29deef48b8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:51.125960 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-efe7d37d-eb11-4e01-bf07-29deef48b8f8 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:51.127276 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-efe7d37d-eb11-4e01-bf07-29deef48b8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:51.165824 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:41:51.185536 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1143/2285] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:41:51.193953 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d68212-a230-4c9b-af52-a9244a77d8e7 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:51.194238 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d68212-a230-4c9b-af52-a9244a77d8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:51.194517 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d68212-a230-4c9b-af52-a9244a77d8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:51.216056 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-98d68212-a230-4c9b-af52-a9244a77d8e7 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:51.217282 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-98d68212-a230-4c9b-af52-a9244a77d8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:51.226939 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1143/2286] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:41:51.231389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7d37d-eb11-4e01-bf07-29deef48b8f8 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:51.241251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7d37d-eb11-4e01-bf07-29deef48b8f8 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:51.245721 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15926f1c-25b7-4dd2-80c0-6e56fb7b95b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:51.246311 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15926f1c-25b7-4dd2-80c0-6e56fb7b95b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:51.246591 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15926f1c-25b7-4dd2-80c0-6e56fb7b95b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:51.246891 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15926f1c-25b7-4dd2-80c0-6e56fb7b95b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:51.247529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15926f1c-25b7-4dd2-80c0-6e56fb7b95b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:41:51.247824 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15926f1c-25b7-4dd2-80c0-6e56fb7b95b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:51.249419 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15926f1c-25b7-4dd2-80c0-6e56fb7b95b8 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:51.261427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1144/2287] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:41:51.267105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d68212-a230-4c9b-af52-a9244a77d8e7 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:51.276527 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d68212-a230-4c9b-af52-a9244a77d8e7 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:51.281339 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e9b44-cb4b-4230-a969-bcbfa29b14c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:51.282451 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e9b44-cb4b-4230-a969-bcbfa29b14c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:51.282725 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e9b44-cb4b-4230-a969-bcbfa29b14c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:51.285380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e9b44-cb4b-4230-a969-bcbfa29b14c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:51.285380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e9b44-cb4b-4230-a969-bcbfa29b14c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:51.285576 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e9b44-cb4b-4230-a969-bcbfa29b14c0 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:51.370757 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1144/2288] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:41:51 2022] POST /identity/v3/projects => generated 363 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:41:51.374926 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15926f1c-25b7-4dd2-80c0-6e56fb7b95b8 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:51.385264 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15926f1c-25b7-4dd2-80c0-6e56fb7b95b8 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:51.440615 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f14a3e-8d11-4d77-8f6e-4e2224a71895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:51.441216 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f14a3e-8d11-4d77-8f6e-4e2224a71895 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:51.441492 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f14a3e-8d11-4d77-8f6e-4e2224a71895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:51.441758 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f14a3e-8d11-4d77-8f6e-4e2224a71895 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:51.442383 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f14a3e-8d11-4d77-8f6e-4e2224a71895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:51.444331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f14a3e-8d11-4d77-8f6e-4e2224a71895 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:51.548006 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1145/2289] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:41:51 2022] POST /identity/v3/users => generated 282 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:41:51.551851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e9b44-cb4b-4230-a969-bcbfa29b14c0 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:51.562098 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e9b44-cb4b-4230-a969-bcbfa29b14c0 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:51.567361 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d6d34-1723-4a32-a1f2-c992e0ec77c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:51.567941 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d6d34-1723-4a32-a1f2-c992e0ec77c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:51.568216 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d6d34-1723-4a32-a1f2-c992e0ec77c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:51.568485 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d6d34-1723-4a32-a1f2-c992e0ec77c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:51.569136 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d6d34-1723-4a32-a1f2-c992e0ec77c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:51.570698 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d6d34-1723-4a32-a1f2-c992e0ec77c6 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:51.580627 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1145/2290] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:41:51.584447 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f14a3e-8d11-4d77-8f6e-4e2224a71895 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:51.594420 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f14a3e-8d11-4d77-8f6e-4e2224a71895 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:51.599131 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d370ef4-e784-4749-8155-66772d096a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:51.599752 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d370ef4-e784-4749-8155-66772d096a3d admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:51.600030 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d370ef4-e784-4749-8155-66772d096a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:51.600302 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d370ef4-e784-4749-8155-66772d096a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:51.600940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d370ef4-e784-4749-8155-66772d096a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:51.602559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d370ef4-e784-4749-8155-66772d096a3d admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:51.613560 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1146/2291] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:41:51.617635 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d6d34-1723-4a32-a1f2-c992e0ec77c6 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:51.628468 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d6d34-1723-4a32-a1f2-c992e0ec77c6 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:51.633113 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd9ce9-0095-46f3-b0f0-ad97e0c04151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:51.633748 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd9ce9-0095-46f3-b0f0-ad97e0c04151 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:51.634023 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd9ce9-0095-46f3-b0f0-ad97e0c04151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:51.634296 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd9ce9-0095-46f3-b0f0-ad97e0c04151 admin admin] PATH_INFO: `/v3/projects/9cc1e7df4c9d40a2bd01ad2e9238a88a/users/a1105769308f424a8d6a8ee0641768db/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:51.648843 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd9ce9-0095-46f3-b0f0-ad97e0c04151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc1e7df4c9d40a2bd01ad2e9238a88a, user_id=a1105769308f424a8d6a8ee0641768db, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:51.651542 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd9ce9-0095-46f3-b0f0-ad97e0c04151 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:51.724103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1146/2292] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:41:51 2022] PUT /identity/v3/projects/9cc1e7df4c9d40a2bd01ad2e9238a88a/users/a1105769308f424a8d6a8ee0641768db/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:41:51.795842 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd776b3-82a4-4c56-a203-7b2a784309af None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:51.796127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd776b3-82a4-4c56-a203-7b2a784309af None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:51.796474 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd776b3-82a4-4c56-a203-7b2a784309af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:51.825476 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-ebd776b3-82a4-4c56-a203-7b2a784309af None None] MFA Rules not processed for user `a1105769308f424a8d6a8ee0641768db`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:41:51.826666 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ebd776b3-82a4-4c56-a203-7b2a784309af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:51.892041 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1147/2293] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:41:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:41:51.903649 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd9ce9-0095-46f3-b0f0-ad97e0c04151 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:41:51.905378 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-16dd9ce9-0095-46f3-b0f0-ad97e0c04151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:41:51.963015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd9ce9-0095-46f3-b0f0-ad97e0c04151 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:41:51.966643 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e771c-cd4e-402c-92d4-32377ef74d10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:41:51.967271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e771c-cd4e-402c-92d4-32377ef74d10 service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:41:51.967550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e771c-cd4e-402c-92d4-32377ef74d10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:41:51.967824 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e771c-cd4e-402c-92d4-32377ef74d10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:41:51.976645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e771c-cd4e-402c-92d4-32377ef74d10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:41:51.978068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e771c-cd4e-402c-92d4-32377ef74d10 service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:41:51.987554 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1147/2294] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:41:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:42:01.888967 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=80,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:01.982875 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:07.141270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd776b3-82a4-4c56-a203-7b2a784309af None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:07.142754 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ebd776b3-82a4-4c56-a203-7b2a784309af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:07.199189 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd776b3-82a4-4c56-a203-7b2a784309af None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:07.203673 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78704cb-164f-4872-bd8b-615a03680bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:07.204279 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78704cb-164f-4872-bd8b-615a03680bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:07.204562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78704cb-164f-4872-bd8b-615a03680bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:07.204825 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78704cb-164f-4872-bd8b-615a03680bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:07.206543 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c78704cb-164f-4872-bd8b-615a03680bd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:07.272523 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78704cb-164f-4872-bd8b-615a03680bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:07.273871 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78704cb-164f-4872-bd8b-615a03680bd6 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:07.283501 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1148/2295] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:42:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:42:10.897850 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e771c-cd4e-402c-92d4-32377ef74d10 service cinder] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:10.899670 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-282e771c-cd4e-402c-92d4-32377ef74d10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:10.916327 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e771c-cd4e-402c-92d4-32377ef74d10 service cinder] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:10.920900 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d7152-5749-4715-88f5-73d2404e3294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:10.921520 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d7152-5749-4715-88f5-73d2404e3294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:10.921801 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d7152-5749-4715-88f5-73d2404e3294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:10.922064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d7152-5749-4715-88f5-73d2404e3294 admin admin] PATH_INFO: `/v3/users/5eabc00f209a48f88e8e2ca28dd3e8df` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:10.923322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d7152-5749-4715-88f5-73d2404e3294 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eabc00f209a48f88e8e2ca28dd3e8df)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:10.925229 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d7152-5749-4715-88f5-73d2404e3294 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:11.152718 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-ac3d7152-5749-4715-88f5-73d2404e3294 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eabc00f209a48f88e8e2ca28dd3e8df'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:11.153394 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-ac3d7152-5749-4715-88f5-73d2404e3294 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eabc00f209a48f88e8e2ca28dd3e8df'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:11.227505 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-ac3d7152-5749-4715-88f5-73d2404e3294 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eabc00f209a48f88e8e2ca28dd3e8df'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:11.243311 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-ac3d7152-5749-4715-88f5-73d2404e3294 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eabc00f209a48f88e8e2ca28dd3e8df'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:11.244260 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-ac3d7152-5749-4715-88f5-73d2404e3294 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eabc00f209a48f88e8e2ca28dd3e8df'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:11.257877 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1148/2296] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:42:10 2022] DELETE /identity/v3/users/5eabc00f209a48f88e8e2ca28dd3e8df => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:11.595984 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78704cb-164f-4872-bd8b-615a03680bd6 service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:11.607865 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78704cb-164f-4872-bd8b-615a03680bd6 service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:11.671623 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf17e92-ccf7-4c85-94bc-d0b74e094b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:11.673017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf17e92-ccf7-4c85-94bc-d0b74e094b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:11.673350 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf17e92-ccf7-4c85-94bc-d0b74e094b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:11.673625 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf17e92-ccf7-4c85-94bc-d0b74e094b3c admin admin] PATH_INFO: `/v3/projects/e840ffd2c4ab4157aff7dcb9725818cb` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:11.674841 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf17e92-ccf7-4c85-94bc-d0b74e094b3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e840ffd2c4ab4157aff7dcb9725818cb)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:11.677182 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf17e92-ccf7-4c85-94bc-d0b74e094b3c admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:11.851542 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-7bf17e92-ccf7-4c85-94bc-d0b74e094b3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e840ffd2c4ab4157aff7dcb9725818cb', 'request_id': 'req-7bf17e92-ccf7-4c85-94bc-d0b74e094b3c'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:11.853639 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:11.858586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-7bf17e92-ccf7-4c85-94bc-d0b74e094b3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e840ffd2c4ab4157aff7dcb9725818cb', 'request_id': 'req-7bf17e92-ccf7-4c85-94bc-d0b74e094b3c'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:11.865130 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-7bf17e92-ccf7-4c85-94bc-d0b74e094b3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e840ffd2c4ab4157aff7dcb9725818cb', 'request_id': 'req-7bf17e92-ccf7-4c85-94bc-d0b74e094b3c'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:11.953674 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-7bf17e92-ccf7-4c85-94bc-d0b74e094b3c admin admin] The token cache is being invalidate because project e840ffd2c4ab4157aff7dcb9725818cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:42:11.953965 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-7bf17e92-ccf7-4c85-94bc-d0b74e094b3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:11.954591 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-7bf17e92-ccf7-4c85-94bc-d0b74e094b3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:11.956121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1149/2297] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:42:11 2022] DELETE /identity/v3/projects/e840ffd2c4ab4157aff7dcb9725818cb => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:11.961530 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e9e13-2393-41d6-aa03-060d06a7766c None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:11.962056 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e9e13-2393-41d6-aa03-060d06a7766c None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:11.962196 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e9e13-2393-41d6-aa03-060d06a7766c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:11.984510 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-7f3e9e13-2393-41d6-aa03-060d06a7766c None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:11.985909 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-7f3e9e13-2393-41d6-aa03-060d06a7766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:12.045459 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1149/2298] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:42:12.053413 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2c635-e65e-477a-9ab9-9f45aa776c8a None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:12.053697 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2c635-e65e-477a-9ab9-9f45aa776c8a None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:12.053973 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2c635-e65e-477a-9ab9-9f45aa776c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:12.075000 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-56a2c635-e65e-477a-9ab9-9f45aa776c8a None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:12.076468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-56a2c635-e65e-477a-9ab9-9f45aa776c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:12.085144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1150/2299] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:12.089400 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e9e13-2393-41d6-aa03-060d06a7766c None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:12.099699 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e9e13-2393-41d6-aa03-060d06a7766c None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:12.104355 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62eec95-4ef7-490a-a546-59f7a4598342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:12.104897 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62eec95-4ef7-490a-a546-59f7a4598342 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:12.105173 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62eec95-4ef7-490a-a546-59f7a4598342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:12.105446 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62eec95-4ef7-490a-a546-59f7a4598342 admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:12.106104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62eec95-4ef7-490a-a546-59f7a4598342 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:42:12.106404 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62eec95-4ef7-490a-a546-59f7a4598342 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:12.108030 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62eec95-4ef7-490a-a546-59f7a4598342 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:12.120013 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1150/2300] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:42:12.124559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2c635-e65e-477a-9ab9-9f45aa776c8a None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:12.135131 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2c635-e65e-477a-9ab9-9f45aa776c8a None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:12.139889 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1ba26-8761-4418-a7ff-dbaa23a7308f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:12.141238 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1ba26-8761-4418-a7ff-dbaa23a7308f admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:12.141520 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1ba26-8761-4418-a7ff-dbaa23a7308f admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:12.141879 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1ba26-8761-4418-a7ff-dbaa23a7308f admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:12.142519 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1ba26-8761-4418-a7ff-dbaa23a7308f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:12.144475 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1ba26-8761-4418-a7ff-dbaa23a7308f admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:12.239253 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1151/2301] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:42:12 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:42:12.243505 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62eec95-4ef7-490a-a546-59f7a4598342 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:12.254312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62eec95-4ef7-490a-a546-59f7a4598342 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:12.311953 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920bfd7-48dc-4714-9376-8031105ae1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:12.313073 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920bfd7-48dc-4714-9376-8031105ae1a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:12.313388 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920bfd7-48dc-4714-9376-8031105ae1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:12.313662 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920bfd7-48dc-4714-9376-8031105ae1a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:12.314288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920bfd7-48dc-4714-9376-8031105ae1a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:12.316292 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920bfd7-48dc-4714-9376-8031105ae1a4 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:12.324665 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:12.422303 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1151/2302] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:42:12 2022] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:42:12.426184 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1ba26-8761-4418-a7ff-dbaa23a7308f admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:12.436557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1ba26-8761-4418-a7ff-dbaa23a7308f admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:12.444283 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d3c57-ede8-4315-992a-8be6e9a2cfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:12.447861 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d3c57-ede8-4315-992a-8be6e9a2cfb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:12.447861 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d3c57-ede8-4315-992a-8be6e9a2cfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:12.447861 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d3c57-ede8-4315-992a-8be6e9a2cfb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:12.447861 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d3c57-ede8-4315-992a-8be6e9a2cfb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:12.448406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d3c57-ede8-4315-992a-8be6e9a2cfb6 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:12.460311 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1152/2303] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:12.464572 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920bfd7-48dc-4714-9376-8031105ae1a4 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:12.474886 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920bfd7-48dc-4714-9376-8031105ae1a4 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:12.479914 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b962544-ab04-446d-91a7-083a8d57a3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:12.480624 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b962544-ab04-446d-91a7-083a8d57a3ea admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:12.481039 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b962544-ab04-446d-91a7-083a8d57a3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:12.481312 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b962544-ab04-446d-91a7-083a8d57a3ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:12.482576 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b962544-ab04-446d-91a7-083a8d57a3ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:12.483844 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b962544-ab04-446d-91a7-083a8d57a3ea admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:12.495627 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1152/2304] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:12.501020 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d3c57-ede8-4315-992a-8be6e9a2cfb6 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:12.510974 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d3c57-ede8-4315-992a-8be6e9a2cfb6 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:12.515991 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35388e9-2f96-4fd1-99dd-2f7f7093720c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:12.516702 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35388e9-2f96-4fd1-99dd-2f7f7093720c admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:12.516903 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35388e9-2f96-4fd1-99dd-2f7f7093720c admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:12.517151 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35388e9-2f96-4fd1-99dd-2f7f7093720c admin admin] PATH_INFO: `/v3/projects/fbf121a6d756497095e926024bdde85a/users/f671a14177f04a36abb8b51b01bce1de/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:12.532717 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35388e9-2f96-4fd1-99dd-2f7f7093720c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf121a6d756497095e926024bdde85a, user_id=f671a14177f04a36abb8b51b01bce1de, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:12.535454 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35388e9-2f96-4fd1-99dd-2f7f7093720c admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:12.639068 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1153/2305] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:42:12 2022] PUT /identity/v3/projects/fbf121a6d756497095e926024bdde85a/users/f671a14177f04a36abb8b51b01bce1de/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:12.650830 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b5a6f-aca4-4dab-ae72-379596538e2a None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:12.651120 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b5a6f-aca4-4dab-ae72-379596538e2a None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:12.651396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b5a6f-aca4-4dab-ae72-379596538e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:12.680241 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-4e4b5a6f-aca4-4dab-ae72-379596538e2a None None] MFA Rules not processed for user `f671a14177f04a36abb8b51b01bce1de`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:12.681366 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-4e4b5a6f-aca4-4dab-ae72-379596538e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:12.752820 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1153/2306] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:12.758000 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35388e9-2f96-4fd1-99dd-2f7f7093720c admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:12.820828 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35388e9-2f96-4fd1-99dd-2f7f7093720c admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:12.826017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2dd33-f180-4234-962e-37d8c72c106f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:12.826639 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2dd33-f180-4234-962e-37d8c72c106f admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:12.826941 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2dd33-f180-4234-962e-37d8c72c106f admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:12.827213 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2dd33-f180-4234-962e-37d8c72c106f admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:12.827931 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2dd33-f180-4234-962e-37d8c72c106f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:12.829931 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2dd33-f180-4234-962e-37d8c72c106f admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:12.927758 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1154/2307] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:42:12 2022] POST /identity/v3/projects => generated 363 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:42:12.932270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b5a6f-aca4-4dab-ae72-379596538e2a None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:12.943164 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b5a6f-aca4-4dab-ae72-379596538e2a None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:13.003725 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a71653-3959-4921-98df-7f65c0ae19c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:13.004436 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a71653-3959-4921-98df-7f65c0ae19c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:13.004627 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a71653-3959-4921-98df-7f65c0ae19c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:13.004899 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a71653-3959-4921-98df-7f65c0ae19c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:13.005544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a71653-3959-4921-98df-7f65c0ae19c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:13.007526 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a71653-3959-4921-98df-7f65c0ae19c9 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:13.130414 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1154/2308] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:42:12 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:42:13.134737 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2dd33-f180-4234-962e-37d8c72c106f admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:13.145338 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2dd33-f180-4234-962e-37d8c72c106f admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:13.150207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a25da-4a68-48c1-86b1-643d0702eaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:13.150846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a25da-4a68-48c1-86b1-643d0702eaf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:13.151129 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a25da-4a68-48c1-86b1-643d0702eaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:13.151457 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a25da-4a68-48c1-86b1-643d0702eaf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:13.152110 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a25da-4a68-48c1-86b1-643d0702eaf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:13.153730 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a25da-4a68-48c1-86b1-643d0702eaf4 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:13.165407 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1155/2309] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:13.169720 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a71653-3959-4921-98df-7f65c0ae19c9 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:13.181341 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a71653-3959-4921-98df-7f65c0ae19c9 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:13.186003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171622fa-cf8e-4e12-9c13-ca89d84aeeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:13.186673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171622fa-cf8e-4e12-9c13-ca89d84aeeb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:13.187024 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171622fa-cf8e-4e12-9c13-ca89d84aeeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:13.187527 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171622fa-cf8e-4e12-9c13-ca89d84aeeb4 admin admin] PATH_INFO: `/v3/projects/1e80d3d2a6ad48378908ce3799dc50f5/users/b18fb9e3b002487da2380840109c7e44/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:13.204685 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171622fa-cf8e-4e12-9c13-ca89d84aeeb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e80d3d2a6ad48378908ce3799dc50f5, user_id=b18fb9e3b002487da2380840109c7e44, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:13.207390 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171622fa-cf8e-4e12-9c13-ca89d84aeeb4 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:13.307613 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1155/2310] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:42:13 2022] PUT /identity/v3/projects/1e80d3d2a6ad48378908ce3799dc50f5/users/b18fb9e3b002487da2380840109c7e44/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:13.315500 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a25da-4a68-48c1-86b1-643d0702eaf4 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:13.325836 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a25da-4a68-48c1-86b1-643d0702eaf4 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:13.373723 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:13.383613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda7248-f3eb-4b5a-89e8-861636b508d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:13.384248 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda7248-f3eb-4b5a-89e8-861636b508d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:13.384525 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda7248-f3eb-4b5a-89e8-861636b508d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:13.384796 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda7248-f3eb-4b5a-89e8-861636b508d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:13.385445 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda7248-f3eb-4b5a-89e8-861636b508d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:13.387127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda7248-f3eb-4b5a-89e8-861636b508d0 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:13.398724 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1156/2311] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:13.402583 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171622fa-cf8e-4e12-9c13-ca89d84aeeb4 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:13.414254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171622fa-cf8e-4e12-9c13-ca89d84aeeb4 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:13.418898 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4182a-1a3c-4693-bfbf-87ca722d713a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:13.419556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4182a-1a3c-4693-bfbf-87ca722d713a admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:13.419936 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4182a-1a3c-4693-bfbf-87ca722d713a admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:13.420252 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4182a-1a3c-4693-bfbf-87ca722d713a admin admin] PATH_INFO: `/v3/projects/1e80d3d2a6ad48378908ce3799dc50f5/users/b18fb9e3b002487da2380840109c7e44/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:13.422876 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4182a-1a3c-4693-bfbf-87ca722d713a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e80d3d2a6ad48378908ce3799dc50f5, user_id=b18fb9e3b002487da2380840109c7e44, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:13.425591 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4182a-1a3c-4693-bfbf-87ca722d713a admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:13.436571 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1156/2312] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:42:13 2022] PUT /identity/v3/projects/1e80d3d2a6ad48378908ce3799dc50f5/users/b18fb9e3b002487da2380840109c7e44/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:13.447292 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f34cb-b6bb-4250-b693-efb6290595d0 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:13.447576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f34cb-b6bb-4250-b693-efb6290595d0 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:13.447849 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f34cb-b6bb-4250-b693-efb6290595d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:13.478620 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-534f34cb-b6bb-4250-b693-efb6290595d0 None None] MFA Rules not processed for user `b18fb9e3b002487da2380840109c7e44`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:13.479844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-534f34cb-b6bb-4250-b693-efb6290595d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:13.550806 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1157/2313] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:13.562836 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4182a-1a3c-4693-bfbf-87ca722d713a admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:13.564770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-f5e4182a-1a3c-4693-bfbf-87ca722d713a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:13.588987 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:13.625941 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4182a-1a3c-4693-bfbf-87ca722d713a admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:13.629717 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb813c24-7216-46f0-8abf-8c8a9744aefd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:13.630335 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb813c24-7216-46f0-8abf-8c8a9744aefd service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:13.630613 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb813c24-7216-46f0-8abf-8c8a9744aefd service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:13.630936 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb813c24-7216-46f0-8abf-8c8a9744aefd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:13.640218 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb813c24-7216-46f0-8abf-8c8a9744aefd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:13.642279 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb813c24-7216-46f0-8abf-8c8a9744aefd service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:13.651917 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1157/2314] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:42:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:42:14.529629 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f34cb-b6bb-4250-b693-efb6290595d0 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:14.592981 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f34cb-b6bb-4250-b693-efb6290595d0 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:14.598366 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd03c5-cb34-4870-b524-165c16e69251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:14.599023 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd03c5-cb34-4870-b524-165c16e69251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:14.599298 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd03c5-cb34-4870-b524-165c16e69251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:14.599571 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd03c5-cb34-4870-b524-165c16e69251 admin admin] PATH_INFO: `/v3/users/f671a14177f04a36abb8b51b01bce1de` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:14.600710 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd03c5-cb34-4870-b524-165c16e69251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f671a14177f04a36abb8b51b01bce1de)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:14.602692 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd03c5-cb34-4870-b524-165c16e69251 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:14.761490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-87bd03c5-cb34-4870-b524-165c16e69251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f671a14177f04a36abb8b51b01bce1de'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:14.762143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-87bd03c5-cb34-4870-b524-165c16e69251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f671a14177f04a36abb8b51b01bce1de'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:14.821813 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-87bd03c5-cb34-4870-b524-165c16e69251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f671a14177f04a36abb8b51b01bce1de'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:14.830641 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-87bd03c5-cb34-4870-b524-165c16e69251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f671a14177f04a36abb8b51b01bce1de'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:14.831320 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-87bd03c5-cb34-4870-b524-165c16e69251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f671a14177f04a36abb8b51b01bce1de'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:14.839284 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:14.850052 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1158/2315] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:42:14 2022] DELETE /identity/v3/users/f671a14177f04a36abb8b51b01bce1de => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:14.854476 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910bad0-9e9f-486b-b5cd-719bd28af055 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:14.854974 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910bad0-9e9f-486b-b5cd-719bd28af055 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:14.855098 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910bad0-9e9f-486b-b5cd-719bd28af055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:14.874611 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-8910bad0-9e9f-486b-b5cd-719bd28af055 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:14.875913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-8910bad0-9e9f-486b-b5cd-719bd28af055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:14.936120 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1158/2316] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:14.946592 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd03c5-cb34-4870-b524-165c16e69251 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:14.948139 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-87bd03c5-cb34-4870-b524-165c16e69251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:15.008688 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd03c5-cb34-4870-b524-165c16e69251 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:15.012270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a616ce9-f81f-4975-a1f1-fcd60632b174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:15.012867 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a616ce9-f81f-4975-a1f1-fcd60632b174 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:15.013139 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a616ce9-f81f-4975-a1f1-fcd60632b174 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:15.013406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a616ce9-f81f-4975-a1f1-fcd60632b174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:15.024069 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a616ce9-f81f-4975-a1f1-fcd60632b174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:15.025507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a616ce9-f81f-4975-a1f1-fcd60632b174 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:15.036064 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1159/2317] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:42:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:42:15.474275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910bad0-9e9f-486b-b5cd-719bd28af055 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:15.475732 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-8910bad0-9e9f-486b-b5cd-719bd28af055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:15.489503 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910bad0-9e9f-486b-b5cd-719bd28af055 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:15.494104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e4e2d-1b61-4a73-858c-0ce4a4929b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:15.494866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e4e2d-1b61-4a73-858c-0ce4a4929b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:15.495185 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e4e2d-1b61-4a73-858c-0ce4a4929b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:15.495526 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e4e2d-1b61-4a73-858c-0ce4a4929b14 admin admin] PATH_INFO: `/v3/projects/fbf121a6d756497095e926024bdde85a` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:15.496685 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e4e2d-1b61-4a73-858c-0ce4a4929b14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbf121a6d756497095e926024bdde85a)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:15.498701 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e4e2d-1b61-4a73-858c-0ce4a4929b14 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:15.612324 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-643e4e2d-1b61-4a73-858c-0ce4a4929b14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbf121a6d756497095e926024bdde85a', 'request_id': 'req-643e4e2d-1b61-4a73-858c-0ce4a4929b14'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:15.618062 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-643e4e2d-1b61-4a73-858c-0ce4a4929b14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbf121a6d756497095e926024bdde85a', 'request_id': 'req-643e4e2d-1b61-4a73-858c-0ce4a4929b14'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:15.701981 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-643e4e2d-1b61-4a73-858c-0ce4a4929b14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbf121a6d756497095e926024bdde85a', 'request_id': 'req-643e4e2d-1b61-4a73-858c-0ce4a4929b14'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:15.714715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-643e4e2d-1b61-4a73-858c-0ce4a4929b14 admin admin] The token cache is being invalidate because project fbf121a6d756497095e926024bdde85a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:42:15.715079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-643e4e2d-1b61-4a73-858c-0ce4a4929b14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:15.717919 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-643e4e2d-1b61-4a73-858c-0ce4a4929b14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:15.717919 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1159/2318] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:42:15 2022] DELETE /identity/v3/projects/fbf121a6d756497095e926024bdde85a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:15.721915 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a616ce9-f81f-4975-a1f1-fcd60632b174 service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:15.731902 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a616ce9-f81f-4975-a1f1-fcd60632b174 service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:15.792798 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9bc3a-c6e2-4948-b6c9-4728f877303d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:15.793530 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9bc3a-c6e2-4948-b6c9-4728f877303d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:15.793858 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9bc3a-c6e2-4948-b6c9-4728f877303d admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:15.794178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9bc3a-c6e2-4948-b6c9-4728f877303d admin admin] PATH_INFO: `/v3/users/b18fb9e3b002487da2380840109c7e44` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:15.795431 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9bc3a-c6e2-4948-b6c9-4728f877303d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b18fb9e3b002487da2380840109c7e44)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:15.797422 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9bc3a-c6e2-4948-b6c9-4728f877303d admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:15.983212 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-62f9bc3a-c6e2-4948-b6c9-4728f877303d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b18fb9e3b002487da2380840109c7e44'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:15.983833 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-62f9bc3a-c6e2-4948-b6c9-4728f877303d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b18fb9e3b002487da2380840109c7e44'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:16.061435 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-62f9bc3a-c6e2-4948-b6c9-4728f877303d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b18fb9e3b002487da2380840109c7e44'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:16.069023 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-62f9bc3a-c6e2-4948-b6c9-4728f877303d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b18fb9e3b002487da2380840109c7e44'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:16.069662 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-62f9bc3a-c6e2-4948-b6c9-4728f877303d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b18fb9e3b002487da2380840109c7e44'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:16.087826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1160/2319] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:42:15 2022] DELETE /identity/v3/users/b18fb9e3b002487da2380840109c7e44 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:42:16.554988 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e4e2d-1b61-4a73-858c-0ce4a4929b14 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:16.556878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-643e4e2d-1b61-4a73-858c-0ce4a4929b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:16.571061 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e4e2d-1b61-4a73-858c-0ce4a4929b14 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:16.617160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:16.630782 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f918a-f403-4a60-b196-78a98f0a2f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:16.631445 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f918a-f403-4a60-b196-78a98f0a2f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:16.631721 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f918a-f403-4a60-b196-78a98f0a2f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:16.631993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f918a-f403-4a60-b196-78a98f0a2f66 admin admin] PATH_INFO: `/v3/projects/1e80d3d2a6ad48378908ce3799dc50f5` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:16.633115 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f918a-f403-4a60-b196-78a98f0a2f66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e80d3d2a6ad48378908ce3799dc50f5)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:16.635066 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f918a-f403-4a60-b196-78a98f0a2f66 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:16.754409 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e52f918a-f403-4a60-b196-78a98f0a2f66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e80d3d2a6ad48378908ce3799dc50f5', 'request_id': 'req-e52f918a-f403-4a60-b196-78a98f0a2f66'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:16.760030 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e52f918a-f403-4a60-b196-78a98f0a2f66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e80d3d2a6ad48378908ce3799dc50f5', 'request_id': 'req-e52f918a-f403-4a60-b196-78a98f0a2f66'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:16.861066 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e52f918a-f403-4a60-b196-78a98f0a2f66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e80d3d2a6ad48378908ce3799dc50f5', 'request_id': 'req-e52f918a-f403-4a60-b196-78a98f0a2f66'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:16.872793 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e52f918a-f403-4a60-b196-78a98f0a2f66 admin admin] The token cache is being invalidate because project 1e80d3d2a6ad48378908ce3799dc50f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:42:16.873080 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e52f918a-f403-4a60-b196-78a98f0a2f66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:16.873704 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e52f918a-f403-4a60-b196-78a98f0a2f66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:16.875253 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1160/2320] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:42:16 2022] DELETE /identity/v3/projects/1e80d3d2a6ad48378908ce3799dc50f5 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:16.881841 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff25f2-8b33-4e56-b66b-101daeb1fad3 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:16.882341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff25f2-8b33-4e56-b66b-101daeb1fad3 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:16.882464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff25f2-8b33-4e56-b66b-101daeb1fad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:16.902687 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-28ff25f2-8b33-4e56-b66b-101daeb1fad3 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:16.904017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-28ff25f2-8b33-4e56-b66b-101daeb1fad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:16.912647 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:16.964968 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1161/2321] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:16.972839 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffe765-78a4-4762-8b3f-d4c0d338f4cd None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:16.973122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffe765-78a4-4762-8b3f-d4c0d338f4cd None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:16.973396 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffe765-78a4-4762-8b3f-d4c0d338f4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:16.993760 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-9dffe765-78a4-4762-8b3f-d4c0d338f4cd None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:16.994988 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-9dffe765-78a4-4762-8b3f-d4c0d338f4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:17.004092 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1161/2322] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:17.008208 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff25f2-8b33-4e56-b66b-101daeb1fad3 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:17.017962 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff25f2-8b33-4e56-b66b-101daeb1fad3 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:17.022600 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb054f4b-a1fc-4707-ab19-0826f201e64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:17.023227 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb054f4b-a1fc-4707-ab19-0826f201e64c admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:17.023507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb054f4b-a1fc-4707-ab19-0826f201e64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:17.023778 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb054f4b-a1fc-4707-ab19-0826f201e64c admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:17.024418 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb054f4b-a1fc-4707-ab19-0826f201e64c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:42:17.024723 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb054f4b-a1fc-4707-ab19-0826f201e64c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:17.026318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb054f4b-a1fc-4707-ab19-0826f201e64c admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:17.037695 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1162/2323] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:42:17.041889 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffe765-78a4-4762-8b3f-d4c0d338f4cd None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:17.051893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffe765-78a4-4762-8b3f-d4c0d338f4cd None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:17.056560 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7118c91-d260-4725-85ec-ca176dfd2d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:17.057146 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7118c91-d260-4725-85ec-ca176dfd2d4b admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:17.057424 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7118c91-d260-4725-85ec-ca176dfd2d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:17.057708 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7118c91-d260-4725-85ec-ca176dfd2d4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:17.058362 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7118c91-d260-4725-85ec-ca176dfd2d4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:17.060306 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7118c91-d260-4725-85ec-ca176dfd2d4b admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:17.170172 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1162/2324] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:42:17 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:42:17.174602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb054f4b-a1fc-4707-ab19-0826f201e64c admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:17.184878 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb054f4b-a1fc-4707-ab19-0826f201e64c admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:17.242044 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ef104-2fb9-4cee-86fd-b03769132be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:17.242651 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ef104-2fb9-4cee-86fd-b03769132be7 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:17.242956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ef104-2fb9-4cee-86fd-b03769132be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:17.243226 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ef104-2fb9-4cee-86fd-b03769132be7 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:17.243857 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ef104-2fb9-4cee-86fd-b03769132be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:17.245778 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ef104-2fb9-4cee-86fd-b03769132be7 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:17.329936 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1163/2325] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:42:17 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:42:17.334035 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7118c91-d260-4725-85ec-ca176dfd2d4b admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:17.344307 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7118c91-d260-4725-85ec-ca176dfd2d4b admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:17.349791 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec7004-2096-4ee3-a68b-198cb78a835d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:17.350381 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec7004-2096-4ee3-a68b-198cb78a835d admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:17.350657 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec7004-2096-4ee3-a68b-198cb78a835d admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:17.350985 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec7004-2096-4ee3-a68b-198cb78a835d admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:17.351628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec7004-2096-4ee3-a68b-198cb78a835d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:17.353224 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec7004-2096-4ee3-a68b-198cb78a835d admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:17.364136 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1163/2326] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:42:17.367970 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ef104-2fb9-4cee-86fd-b03769132be7 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:17.378006 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ef104-2fb9-4cee-86fd-b03769132be7 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:17.382659 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9828a8-979b-4648-ab07-551943f0dddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:17.383279 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9828a8-979b-4648-ab07-551943f0dddb admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:17.383559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9828a8-979b-4648-ab07-551943f0dddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:17.383829 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9828a8-979b-4648-ab07-551943f0dddb admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:17.384466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9828a8-979b-4648-ab07-551943f0dddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:17.386051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9828a8-979b-4648-ab07-551943f0dddb admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:17.396616 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1164/2327] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:17.400699 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec7004-2096-4ee3-a68b-198cb78a835d admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:17.411370 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec7004-2096-4ee3-a68b-198cb78a835d admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:17.415904 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227daeb-df99-41ca-afa4-be81e856043a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:17.416535 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227daeb-df99-41ca-afa4-be81e856043a admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:17.416811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227daeb-df99-41ca-afa4-be81e856043a admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:17.417084 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227daeb-df99-41ca-afa4-be81e856043a admin admin] PATH_INFO: `/v3/projects/4eb50366ae9e4568b657c644d8af36f1/users/12ca498f1c9242ce9788bf6bc397692f/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:17.432609 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227daeb-df99-41ca-afa4-be81e856043a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb50366ae9e4568b657c644d8af36f1, user_id=12ca498f1c9242ce9788bf6bc397692f, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:17.435296 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227daeb-df99-41ca-afa4-be81e856043a admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:17.490839 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1164/2328] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:42:17 2022] PUT /identity/v3/projects/4eb50366ae9e4568b657c644d8af36f1/users/12ca498f1c9242ce9788bf6bc397692f/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:17.502919 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111912d-1b6e-4c4e-ad27-a7bc6ddb5a80 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:17.503237 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111912d-1b6e-4c4e-ad27-a7bc6ddb5a80 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:17.503509 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111912d-1b6e-4c4e-ad27-a7bc6ddb5a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:17.539194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-c111912d-1b6e-4c4e-ad27-a7bc6ddb5a80 None None] MFA Rules not processed for user `12ca498f1c9242ce9788bf6bc397692f`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:17.540407 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c111912d-1b6e-4c4e-ad27-a7bc6ddb5a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:17.605781 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1165/2329] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:17.610471 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227daeb-df99-41ca-afa4-be81e856043a admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:17.672824 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227daeb-df99-41ca-afa4-be81e856043a admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:17.678209 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a77ae-a10c-4394-b840-f09c4dde3fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:17.678806 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a77ae-a10c-4394-b840-f09c4dde3fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:17.679139 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a77ae-a10c-4394-b840-f09c4dde3fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:17.679378 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a77ae-a10c-4394-b840-f09c4dde3fc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:17.680028 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a77ae-a10c-4394-b840-f09c4dde3fc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:17.681959 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a77ae-a10c-4394-b840-f09c4dde3fc9 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:17.769683 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:17.777098 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1165/2330] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:42:17 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:42:17.781192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111912d-1b6e-4c4e-ad27-a7bc6ddb5a80 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:17.792919 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111912d-1b6e-4c4e-ad27-a7bc6ddb5a80 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:17.797640 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:17.850353 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d687e13-1421-41bd-91c4-fefc5a33be3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:17.851000 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d687e13-1421-41bd-91c4-fefc5a33be3e admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:17.851276 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d687e13-1421-41bd-91c4-fefc5a33be3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:17.851543 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d687e13-1421-41bd-91c4-fefc5a33be3e admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:17.852172 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d687e13-1421-41bd-91c4-fefc5a33be3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:17.854221 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d687e13-1421-41bd-91c4-fefc5a33be3e admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:17.969767 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1166/2331] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:42:17 2022] POST /identity/v3/users => generated 300 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:42:17.974145 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a77ae-a10c-4394-b840-f09c4dde3fc9 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:17.984203 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a77ae-a10c-4394-b840-f09c4dde3fc9 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:17.989006 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bf70c-3ad9-4030-aaa2-da8c67a5a77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:17.991207 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bf70c-3ad9-4030-aaa2-da8c67a5a77e admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:17.991207 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bf70c-3ad9-4030-aaa2-da8c67a5a77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:17.991207 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bf70c-3ad9-4030-aaa2-da8c67a5a77e admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:17.991207 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bf70c-3ad9-4030-aaa2-da8c67a5a77e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:17.992387 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bf70c-3ad9-4030-aaa2-da8c67a5a77e admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:18.003541 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1166/2332] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:18.007565 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d687e13-1421-41bd-91c4-fefc5a33be3e admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:18.017508 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d687e13-1421-41bd-91c4-fefc5a33be3e admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:18.023149 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a787610-4fb7-4ba9-9ffc-a70e30c74e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:18.023786 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a787610-4fb7-4ba9-9ffc-a70e30c74e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:18.024062 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a787610-4fb7-4ba9-9ffc-a70e30c74e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:18.024331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a787610-4fb7-4ba9-9ffc-a70e30c74e29 admin admin] PATH_INFO: `/v3/projects/fb0b332b5b6d4dd4b46d5a19ef2db3bb/users/832553a9f045470ab102708705e1c705/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:18.039147 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a787610-4fb7-4ba9-9ffc-a70e30c74e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb0b332b5b6d4dd4b46d5a19ef2db3bb, user_id=832553a9f045470ab102708705e1c705, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:18.041830 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a787610-4fb7-4ba9-9ffc-a70e30c74e29 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:18.102007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1167/2333] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:42:18 2022] PUT /identity/v3/projects/fb0b332b5b6d4dd4b46d5a19ef2db3bb/users/832553a9f045470ab102708705e1c705/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:42:18.106014 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bf70c-3ad9-4030-aaa2-da8c67a5a77e admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:18.116169 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bf70c-3ad9-4030-aaa2-da8c67a5a77e admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:18.173673 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a89c7c-742e-44db-bdaf-09508bcd0646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:18.174382 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a89c7c-742e-44db-bdaf-09508bcd0646 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:18.174658 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a89c7c-742e-44db-bdaf-09508bcd0646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:18.174970 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a89c7c-742e-44db-bdaf-09508bcd0646 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:18.175616 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a89c7c-742e-44db-bdaf-09508bcd0646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:18.177221 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a89c7c-742e-44db-bdaf-09508bcd0646 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:18.187100 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1167/2334] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:18.192137 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a787610-4fb7-4ba9-9ffc-a70e30c74e29 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:18.202695 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a787610-4fb7-4ba9-9ffc-a70e30c74e29 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:18.213960 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eeb381-24fd-486c-81d7-5dcd3279f04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:18.214631 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeb381-24fd-486c-81d7-5dcd3279f04e admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:18.214935 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeb381-24fd-486c-81d7-5dcd3279f04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:18.215210 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeb381-24fd-486c-81d7-5dcd3279f04e admin admin] PATH_INFO: `/v3/projects/fb0b332b5b6d4dd4b46d5a19ef2db3bb/users/832553a9f045470ab102708705e1c705/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:18.217200 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eeb381-24fd-486c-81d7-5dcd3279f04e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb0b332b5b6d4dd4b46d5a19ef2db3bb, user_id=832553a9f045470ab102708705e1c705, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:18.219968 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eeb381-24fd-486c-81d7-5dcd3279f04e admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:18.231216 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1168/2335] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:42:18 2022] PUT /identity/v3/projects/fb0b332b5b6d4dd4b46d5a19ef2db3bb/users/832553a9f045470ab102708705e1c705/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:42:18.241544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449459b-fa69-4db4-8139-b924fec4b158 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:18.241833 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449459b-fa69-4db4-8139-b924fec4b158 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:18.242122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449459b-fa69-4db4-8139-b924fec4b158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:18.271632 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-8449459b-fa69-4db4-8139-b924fec4b158 None None] MFA Rules not processed for user `832553a9f045470ab102708705e1c705`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:18.272837 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-8449459b-fa69-4db4-8139-b924fec4b158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:18.340303 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1168/2336] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:18 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:18.352133 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eeb381-24fd-486c-81d7-5dcd3279f04e admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:18.353836 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-36eeb381-24fd-486c-81d7-5dcd3279f04e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:18.411642 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eeb381-24fd-486c-81d7-5dcd3279f04e admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:18.415319 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ebc2e-9d48-452f-ba2b-822f6f33ca35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:18.415914 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ebc2e-9d48-452f-ba2b-822f6f33ca35 service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:18.416191 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ebc2e-9d48-452f-ba2b-822f6f33ca35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:18.416460 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ebc2e-9d48-452f-ba2b-822f6f33ca35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:18.425894 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ebc2e-9d48-452f-ba2b-822f6f33ca35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:18.427355 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ebc2e-9d48-452f-ba2b-822f6f33ca35 service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:18.436811 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1169/2337] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:42:18 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:42:18.501946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449459b-fa69-4db4-8139-b924fec4b158 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:18.566841 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449459b-fa69-4db4-8139-b924fec4b158 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:18.571358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee4192-ea5f-43c7-9dec-3a589e9b223c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:18.571981 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee4192-ea5f-43c7-9dec-3a589e9b223c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:18.572257 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee4192-ea5f-43c7-9dec-3a589e9b223c admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:18.572530 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee4192-ea5f-43c7-9dec-3a589e9b223c admin admin] PATH_INFO: `/v3/users/12ca498f1c9242ce9788bf6bc397692f` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:18.573651 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee4192-ea5f-43c7-9dec-3a589e9b223c admin admin] RBAC: Authorizing `identity:delete_user(user_id=12ca498f1c9242ce9788bf6bc397692f)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:18.575844 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee4192-ea5f-43c7-9dec-3a589e9b223c admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:18.588026 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:18.841037 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-93ee4192-ea5f-43c7-9dec-3a589e9b223c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12ca498f1c9242ce9788bf6bc397692f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:18.841658 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-93ee4192-ea5f-43c7-9dec-3a589e9b223c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12ca498f1c9242ce9788bf6bc397692f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:18.925048 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-93ee4192-ea5f-43c7-9dec-3a589e9b223c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12ca498f1c9242ce9788bf6bc397692f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:18.937589 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-93ee4192-ea5f-43c7-9dec-3a589e9b223c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12ca498f1c9242ce9788bf6bc397692f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:18.938301 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-93ee4192-ea5f-43c7-9dec-3a589e9b223c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12ca498f1c9242ce9788bf6bc397692f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:18.951040 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1169/2338] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:42:18 2022] DELETE /identity/v3/users/12ca498f1c9242ce9788bf6bc397692f => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:18.955751 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e9485-411c-4a1e-8f6e-4c3dff733db7 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:18.955889 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e9485-411c-4a1e-8f6e-4c3dff733db7 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:18.957240 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e9485-411c-4a1e-8f6e-4c3dff733db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:18.975316 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-936e9485-411c-4a1e-8f6e-4c3dff733db7 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:18.976520 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-936e9485-411c-4a1e-8f6e-4c3dff733db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:19.036381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1170/2339] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:19.046502 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee4192-ea5f-43c7-9dec-3a589e9b223c admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:19.047946 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-93ee4192-ea5f-43c7-9dec-3a589e9b223c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:19.104606 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee4192-ea5f-43c7-9dec-3a589e9b223c admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:19.108479 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09511e-6acd-4a8c-b891-9112182d73ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:19.109088 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09511e-6acd-4a8c-b891-9112182d73ba service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:19.109955 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09511e-6acd-4a8c-b891-9112182d73ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:19.109955 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09511e-6acd-4a8c-b891-9112182d73ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:19.120278 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09511e-6acd-4a8c-b891-9112182d73ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:19.121726 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09511e-6acd-4a8c-b891-9112182d73ba service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:19.131137 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1170/2340] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:42:19.557626 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e9485-411c-4a1e-8f6e-4c3dff733db7 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:19.559147 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-936e9485-411c-4a1e-8f6e-4c3dff733db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:19.568566 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:19.572305 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e9485-411c-4a1e-8f6e-4c3dff733db7 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:19.577192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ffc04-51f9-454a-bc99-20cda2d719ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:19.577856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ffc04-51f9-454a-bc99-20cda2d719ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:19.578188 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ffc04-51f9-454a-bc99-20cda2d719ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:19.578388 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ffc04-51f9-454a-bc99-20cda2d719ca admin admin] PATH_INFO: `/v3/projects/4eb50366ae9e4568b657c644d8af36f1` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:19.579533 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ffc04-51f9-454a-bc99-20cda2d719ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eb50366ae9e4568b657c644d8af36f1)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:19.582710 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ffc04-51f9-454a-bc99-20cda2d719ca admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:19.714793 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-ad8ffc04-51f9-454a-bc99-20cda2d719ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eb50366ae9e4568b657c644d8af36f1', 'request_id': 'req-ad8ffc04-51f9-454a-bc99-20cda2d719ca'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:19.720136 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-ad8ffc04-51f9-454a-bc99-20cda2d719ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eb50366ae9e4568b657c644d8af36f1', 'request_id': 'req-ad8ffc04-51f9-454a-bc99-20cda2d719ca'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:19.726671 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-ad8ffc04-51f9-454a-bc99-20cda2d719ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eb50366ae9e4568b657c644d8af36f1', 'request_id': 'req-ad8ffc04-51f9-454a-bc99-20cda2d719ca'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:19.820363 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-ad8ffc04-51f9-454a-bc99-20cda2d719ca admin admin] The token cache is being invalidate because project 4eb50366ae9e4568b657c644d8af36f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:42:19.820646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-ad8ffc04-51f9-454a-bc99-20cda2d719ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:19.821258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-ad8ffc04-51f9-454a-bc99-20cda2d719ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:19.822794 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1171/2341] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:42:19 2022] DELETE /identity/v3/projects/4eb50366ae9e4568b657c644d8af36f1 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:19.827093 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09511e-6acd-4a8c-b891-9112182d73ba service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:19.837369 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09511e-6acd-4a8c-b891-9112182d73ba service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:19.893556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ba346-c64e-4fce-ba07-601afb256aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:19.894200 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ba346-c64e-4fce-ba07-601afb256aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:19.894415 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ba346-c64e-4fce-ba07-601afb256aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:19.894689 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ba346-c64e-4fce-ba07-601afb256aad admin admin] PATH_INFO: `/v3/users/832553a9f045470ab102708705e1c705` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:19.895876 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ba346-c64e-4fce-ba07-601afb256aad admin admin] RBAC: Authorizing `identity:delete_user(user_id=832553a9f045470ab102708705e1c705)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:19.897801 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ba346-c64e-4fce-ba07-601afb256aad admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:20.057073 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:20.069839 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-712ba346-c64e-4fce-ba07-601afb256aad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '832553a9f045470ab102708705e1c705'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:20.070495 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-712ba346-c64e-4fce-ba07-601afb256aad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '832553a9f045470ab102708705e1c705'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:20.146901 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-712ba346-c64e-4fce-ba07-601afb256aad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '832553a9f045470ab102708705e1c705'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:20.159643 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-712ba346-c64e-4fce-ba07-601afb256aad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '832553a9f045470ab102708705e1c705'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:20.160271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-712ba346-c64e-4fce-ba07-601afb256aad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '832553a9f045470ab102708705e1c705'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:20.172184 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1171/2342] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:42:19 2022] DELETE /identity/v3/users/832553a9f045470ab102708705e1c705 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:20.582857 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ffc04-51f9-454a-bc99-20cda2d719ca admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:20.584340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ad8ffc04-51f9-454a-bc99-20cda2d719ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:20.598174 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ffc04-51f9-454a-bc99-20cda2d719ca admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:20.658021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00cc33a-220e-4b62-b3c2-67bfd163b628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:20.658642 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cc33a-220e-4b62-b3c2-67bfd163b628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:20.658951 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cc33a-220e-4b62-b3c2-67bfd163b628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:20.659226 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cc33a-220e-4b62-b3c2-67bfd163b628 admin admin] PATH_INFO: `/v3/projects/fb0b332b5b6d4dd4b46d5a19ef2db3bb` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:20.661215 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00cc33a-220e-4b62-b3c2-67bfd163b628 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb0b332b5b6d4dd4b46d5a19ef2db3bb)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:20.663147 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00cc33a-220e-4b62-b3c2-67bfd163b628 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:20.804582 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b00cc33a-220e-4b62-b3c2-67bfd163b628 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb0b332b5b6d4dd4b46d5a19ef2db3bb', 'request_id': 'req-b00cc33a-220e-4b62-b3c2-67bfd163b628'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:20.810038 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b00cc33a-220e-4b62-b3c2-67bfd163b628 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb0b332b5b6d4dd4b46d5a19ef2db3bb', 'request_id': 'req-b00cc33a-220e-4b62-b3c2-67bfd163b628'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:20.816828 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b00cc33a-220e-4b62-b3c2-67bfd163b628 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb0b332b5b6d4dd4b46d5a19ef2db3bb', 'request_id': 'req-b00cc33a-220e-4b62-b3c2-67bfd163b628'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:20.918349 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b00cc33a-220e-4b62-b3c2-67bfd163b628 admin admin] The token cache is being invalidate because project fb0b332b5b6d4dd4b46d5a19ef2db3bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:42:20.918637 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b00cc33a-220e-4b62-b3c2-67bfd163b628 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:20.919289 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-b00cc33a-220e-4b62-b3c2-67bfd163b628 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:20.920800 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1172/2343] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:42:20 2022] DELETE /identity/v3/projects/fb0b332b5b6d4dd4b46d5a19ef2db3bb => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:42:20.925966 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d389979-eea1-40de-aa41-8131b882a069 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:20.926499 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d389979-eea1-40de-aa41-8131b882a069 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:20.926499 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d389979-eea1-40de-aa41-8131b882a069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:20.946593 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-7d389979-eea1-40de-aa41-8131b882a069 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:20.947895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-7d389979-eea1-40de-aa41-8131b882a069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:21.007893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1172/2344] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:21.015711 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ac06e-fcec-4c9b-a6fa-fcf4a8afeeb3 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:21.016031 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ac06e-fcec-4c9b-a6fa-fcf4a8afeeb3 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:21.016285 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ac06e-fcec-4c9b-a6fa-fcf4a8afeeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:21.037088 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-a36ac06e-fcec-4c9b-a6fa-fcf4a8afeeb3 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:21.038270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-a36ac06e-fcec-4c9b-a6fa-fcf4a8afeeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:21.047474 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1173/2345] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:21.050398 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d389979-eea1-40de-aa41-8131b882a069 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:21.060407 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d389979-eea1-40de-aa41-8131b882a069 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:21.065041 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d50b1d-0e1d-4bf4-ad6c-916e98fc4969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:21.065700 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d50b1d-0e1d-4bf4-ad6c-916e98fc4969 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:21.066600 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d50b1d-0e1d-4bf4-ad6c-916e98fc4969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:21.066914 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d50b1d-0e1d-4bf4-ad6c-916e98fc4969 admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:21.067570 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d50b1d-0e1d-4bf4-ad6c-916e98fc4969 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:42:21.067876 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d50b1d-0e1d-4bf4-ad6c-916e98fc4969 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:21.069475 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d50b1d-0e1d-4bf4-ad6c-916e98fc4969 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:21.081288 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1173/2346] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:42:21.086117 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ac06e-fcec-4c9b-a6fa-fcf4a8afeeb3 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:21.095518 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ac06e-fcec-4c9b-a6fa-fcf4a8afeeb3 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:21.100278 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8eff3-a04c-4f37-b933-56b916530e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:21.100872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8eff3-a04c-4f37-b933-56b916530e3e admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:21.101150 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8eff3-a04c-4f37-b933-56b916530e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:21.101424 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8eff3-a04c-4f37-b933-56b916530e3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:21.102074 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8eff3-a04c-4f37-b933-56b916530e3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:21.104010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8eff3-a04c-4f37-b933-56b916530e3e admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:21.113882 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:21.210852 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1174/2347] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:42:21 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:42:21.214939 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d50b1d-0e1d-4bf4-ad6c-916e98fc4969 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:21.225319 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d50b1d-0e1d-4bf4-ad6c-916e98fc4969 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:21.282599 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035f87d-b983-49ec-932f-d3ddcb5c9b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:21.283144 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035f87d-b983-49ec-932f-d3ddcb5c9b54 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:21.283417 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035f87d-b983-49ec-932f-d3ddcb5c9b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:21.283687 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035f87d-b983-49ec-932f-d3ddcb5c9b54 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:21.284306 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035f87d-b983-49ec-932f-d3ddcb5c9b54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:21.286351 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035f87d-b983-49ec-932f-d3ddcb5c9b54 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:21.381677 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1174/2348] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:42:21 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:42:21.386083 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8eff3-a04c-4f37-b933-56b916530e3e admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:21.396588 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8eff3-a04c-4f37-b933-56b916530e3e admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:21.401188 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91091e0a-4c4a-470c-9fc4-39ed616491cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:21.401779 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91091e0a-4c4a-470c-9fc4-39ed616491cb admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:21.402058 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91091e0a-4c4a-470c-9fc4-39ed616491cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:21.402325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91091e0a-4c4a-470c-9fc4-39ed616491cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:21.403015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91091e0a-4c4a-470c-9fc4-39ed616491cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:21.405078 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91091e0a-4c4a-470c-9fc4-39ed616491cb admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:21.415503 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1175/2349] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:21.419495 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035f87d-b983-49ec-932f-d3ddcb5c9b54 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:21.430397 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035f87d-b983-49ec-932f-d3ddcb5c9b54 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:21.435110 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf409a5e-1003-4c65-934f-19e6f4975643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:21.435699 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf409a5e-1003-4c65-934f-19e6f4975643 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:21.436909 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf409a5e-1003-4c65-934f-19e6f4975643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:21.436909 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf409a5e-1003-4c65-934f-19e6f4975643 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:21.437101 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf409a5e-1003-4c65-934f-19e6f4975643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:21.438701 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf409a5e-1003-4c65-934f-19e6f4975643 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:21.450090 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1175/2350] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:21.454363 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91091e0a-4c4a-470c-9fc4-39ed616491cb admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:21.464305 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91091e0a-4c4a-470c-9fc4-39ed616491cb admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:21.469057 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fe590-3b41-49c7-b7c0-8a2521df25fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:21.469696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fe590-3b41-49c7-b7c0-8a2521df25fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:21.469975 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fe590-3b41-49c7-b7c0-8a2521df25fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:21.470252 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fe590-3b41-49c7-b7c0-8a2521df25fe admin admin] PATH_INFO: `/v3/projects/395a185afeb442b193ce9fbd71d1a986/users/26aff3d4b676452eb38ed773d171c570/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:21.485158 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136fe590-3b41-49c7-b7c0-8a2521df25fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=395a185afeb442b193ce9fbd71d1a986, user_id=26aff3d4b676452eb38ed773d171c570, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:21.488424 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136fe590-3b41-49c7-b7c0-8a2521df25fe admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:21.581401 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1176/2351] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:42:21 2022] PUT /identity/v3/projects/395a185afeb442b193ce9fbd71d1a986/users/26aff3d4b676452eb38ed773d171c570/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:21.592491 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf56c6f-242c-4255-832e-413b51de43be None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:21.597919 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf56c6f-242c-4255-832e-413b51de43be None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:21.597919 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf56c6f-242c-4255-832e-413b51de43be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:21.621470 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-6bf56c6f-242c-4255-832e-413b51de43be None None] MFA Rules not processed for user `26aff3d4b676452eb38ed773d171c570`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:21.622668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-6bf56c6f-242c-4255-832e-413b51de43be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:21.626610 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:21.688414 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1176/2352] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:21.693384 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fe590-3b41-49c7-b7c0-8a2521df25fe admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:21.766568 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fe590-3b41-49c7-b7c0-8a2521df25fe admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:21.772543 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e9a77-a2ca-4c3d-a7f7-7c9d289bb949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:21.773173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e9a77-a2ca-4c3d-a7f7-7c9d289bb949 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:21.773449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e9a77-a2ca-4c3d-a7f7-7c9d289bb949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:21.773820 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e9a77-a2ca-4c3d-a7f7-7c9d289bb949 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:21.774515 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e9a77-a2ca-4c3d-a7f7-7c9d289bb949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:21.776473 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e9a77-a2ca-4c3d-a7f7-7c9d289bb949 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:21.897284 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1177/2353] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:42:21 2022] POST /identity/v3/projects => generated 381 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:42:21.901158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf56c6f-242c-4255-832e-413b51de43be None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:21.912715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf56c6f-242c-4255-832e-413b51de43be None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:21.968280 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217a29f-73ef-4d04-8a77-7130ad1501ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:21.968956 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217a29f-73ef-4d04-8a77-7130ad1501ed admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:21.969138 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217a29f-73ef-4d04-8a77-7130ad1501ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:21.969410 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217a29f-73ef-4d04-8a77-7130ad1501ed admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:21.970041 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217a29f-73ef-4d04-8a77-7130ad1501ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:21.972483 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217a29f-73ef-4d04-8a77-7130ad1501ed admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:22.073077 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1177/2354] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:42:21 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:42:22.077294 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e9a77-a2ca-4c3d-a7f7-7c9d289bb949 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:22.088235 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e9a77-a2ca-4c3d-a7f7-7c9d289bb949 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:22.093011 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8579e-7ae9-40c7-b970-c5b2f3301fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:22.093604 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8579e-7ae9-40c7-b970-c5b2f3301fef admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:22.093930 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8579e-7ae9-40c7-b970-c5b2f3301fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:22.094215 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8579e-7ae9-40c7-b970-c5b2f3301fef admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:22.094869 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8579e-7ae9-40c7-b970-c5b2f3301fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:22.096465 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8579e-7ae9-40c7-b970-c5b2f3301fef admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:22.107538 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1178/2355] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:22.111620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217a29f-73ef-4d04-8a77-7130ad1501ed admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:22.122425 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217a29f-73ef-4d04-8a77-7130ad1501ed admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:22.127130 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f6bc6-f73e-47ed-8c7c-81d5d12fff66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:22.127767 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f6bc6-f73e-47ed-8c7c-81d5d12fff66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:22.128046 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f6bc6-f73e-47ed-8c7c-81d5d12fff66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:22.128345 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f6bc6-f73e-47ed-8c7c-81d5d12fff66 admin admin] PATH_INFO: `/v3/projects/a5f45bffaa734b51be8d9161ae8e8c2e/users/214495838033464b8249fd8c99f0d683/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:22.143140 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f6bc6-f73e-47ed-8c7c-81d5d12fff66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5f45bffaa734b51be8d9161ae8e8c2e, user_id=214495838033464b8249fd8c99f0d683, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:22.146457 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f6bc6-f73e-47ed-8c7c-81d5d12fff66 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:22.220261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1178/2356] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:42:22 2022] PUT /identity/v3/projects/a5f45bffaa734b51be8d9161ae8e8c2e/users/214495838033464b8249fd8c99f0d683/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:22.225284 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8579e-7ae9-40c7-b970-c5b2f3301fef admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:22.235665 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8579e-7ae9-40c7-b970-c5b2f3301fef admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:22.294301 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609fac4-c83d-4026-8a97-d7a1d07b9c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:22.294944 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609fac4-c83d-4026-8a97-d7a1d07b9c48 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:22.295225 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609fac4-c83d-4026-8a97-d7a1d07b9c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:22.295497 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609fac4-c83d-4026-8a97-d7a1d07b9c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:22.296132 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609fac4-c83d-4026-8a97-d7a1d07b9c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:22.297753 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609fac4-c83d-4026-8a97-d7a1d07b9c48 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:22.307650 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1179/2357] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:22.311784 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f6bc6-f73e-47ed-8c7c-81d5d12fff66 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:22.323297 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f6bc6-f73e-47ed-8c7c-81d5d12fff66 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:22.328132 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb6c2a-4bf8-4c8a-ac00-f193b3669484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:22.328769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb6c2a-4bf8-4c8a-ac00-f193b3669484 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:22.329046 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb6c2a-4bf8-4c8a-ac00-f193b3669484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:22.329316 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb6c2a-4bf8-4c8a-ac00-f193b3669484 admin admin] PATH_INFO: `/v3/projects/a5f45bffaa734b51be8d9161ae8e8c2e/users/214495838033464b8249fd8c99f0d683/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:22.331279 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb6c2a-4bf8-4c8a-ac00-f193b3669484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5f45bffaa734b51be8d9161ae8e8c2e, user_id=214495838033464b8249fd8c99f0d683, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:22.334887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb6c2a-4bf8-4c8a-ac00-f193b3669484 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:22.345050 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1179/2358] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:42:22 2022] PUT /identity/v3/projects/a5f45bffaa734b51be8d9161ae8e8c2e/users/214495838033464b8249fd8c99f0d683/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:22.356160 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e4e9f-ca7a-4b2f-a78f-0c57e93fba12 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:22.356449 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e4e9f-ca7a-4b2f-a78f-0c57e93fba12 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:22.356778 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e4e9f-ca7a-4b2f-a78f-0c57e93fba12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:22.384359 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-262e4e9f-ca7a-4b2f-a78f-0c57e93fba12 None None] MFA Rules not processed for user `214495838033464b8249fd8c99f0d683`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:22.385568 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-262e4e9f-ca7a-4b2f-a78f-0c57e93fba12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:22.398059 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:22.453469 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1180/2359] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:22.464682 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb6c2a-4bf8-4c8a-ac00-f193b3669484 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:22.466444 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-ffeb6c2a-4bf8-4c8a-ac00-f193b3669484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:22.525848 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb6c2a-4bf8-4c8a-ac00-f193b3669484 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:22.529440 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6eaf3-af20-4716-9e06-8eaa9f6979c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:22.530076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6eaf3-af20-4716-9e06-8eaa9f6979c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:22.530348 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6eaf3-af20-4716-9e06-8eaa9f6979c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:22.530615 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6eaf3-af20-4716-9e06-8eaa9f6979c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:22.539820 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6eaf3-af20-4716-9e06-8eaa9f6979c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:22.541384 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6eaf3-af20-4716-9e06-8eaa9f6979c0 service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:22.546265 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:22.551118 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1180/2360] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:42:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:42:22.670616 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e4e9f-ca7a-4b2f-a78f-0c57e93fba12 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:22.681140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e4e9f-ca7a-4b2f-a78f-0c57e93fba12 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:22.684872 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc64130-3603-47df-a2f8-85294125b0dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:22.685499 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc64130-3603-47df-a2f8-85294125b0dd service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:22.685774 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc64130-3603-47df-a2f8-85294125b0dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:22.686043 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc64130-3603-47df-a2f8-85294125b0dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:22.744110 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc64130-3603-47df-a2f8-85294125b0dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:22.745513 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc64130-3603-47df-a2f8-85294125b0dd service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:22.755576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1181/2361] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:42:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:42:26.841879 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6eaf3-af20-4716-9e06-8eaa9f6979c0 service cinder] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:26.905467 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6eaf3-af20-4716-9e06-8eaa9f6979c0 service cinder] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:26.910088 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83224c07-157b-45d6-816e-647788d66a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:26.910711 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83224c07-157b-45d6-816e-647788d66a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:26.911016 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83224c07-157b-45d6-816e-647788d66a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:26.911336 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83224c07-157b-45d6-816e-647788d66a8e admin admin] PATH_INFO: `/v3/users/26aff3d4b676452eb38ed773d171c570` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:26.912474 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83224c07-157b-45d6-816e-647788d66a8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=26aff3d4b676452eb38ed773d171c570)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:26.914419 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83224c07-157b-45d6-816e-647788d66a8e admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:27.081672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-83224c07-157b-45d6-816e-647788d66a8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26aff3d4b676452eb38ed773d171c570'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:27.082880 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-83224c07-157b-45d6-816e-647788d66a8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26aff3d4b676452eb38ed773d171c570'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:27.176471 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-83224c07-157b-45d6-816e-647788d66a8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26aff3d4b676452eb38ed773d171c570'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:27.189375 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-83224c07-157b-45d6-816e-647788d66a8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26aff3d4b676452eb38ed773d171c570'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:27.190031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-83224c07-157b-45d6-816e-647788d66a8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26aff3d4b676452eb38ed773d171c570'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:27.202532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1181/2362] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:42:26 2022] DELETE /identity/v3/users/26aff3d4b676452eb38ed773d171c570 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:27.207042 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be61d97-a577-40a4-b727-0bc1b8f2fdd8 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:27.207536 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be61d97-a577-40a4-b727-0bc1b8f2fdd8 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:27.207641 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be61d97-a577-40a4-b727-0bc1b8f2fdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:27.227707 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-0be61d97-a577-40a4-b727-0bc1b8f2fdd8 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:27.228929 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-0be61d97-a577-40a4-b727-0bc1b8f2fdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:27.287791 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1182/2363] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:27.297401 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83224c07-157b-45d6-816e-647788d66a8e admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:27.298835 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-83224c07-157b-45d6-816e-647788d66a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:27.356153 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83224c07-157b-45d6-816e-647788d66a8e admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:27.359800 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9bd06-de14-4445-868b-d3c3a6f4ad29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:27.360402 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9bd06-de14-4445-868b-d3c3a6f4ad29 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:27.360677 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9bd06-de14-4445-868b-d3c3a6f4ad29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:27.360949 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9bd06-de14-4445-868b-d3c3a6f4ad29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:27.370116 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9bd06-de14-4445-868b-d3c3a6f4ad29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:27.371568 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9bd06-de14-4445-868b-d3c3a6f4ad29 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:27.380999 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1182/2364] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:42:27.999852 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be61d97-a577-40a4-b727-0bc1b8f2fdd8 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:28.003315 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-0be61d97-a577-40a4-b727-0bc1b8f2fdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:28.017173 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be61d97-a577-40a4-b727-0bc1b8f2fdd8 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:28.023593 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8747c-bad8-440b-8fc7-e8ebceae372e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:28.026260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8747c-bad8-440b-8fc7-e8ebceae372e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:28.026260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8747c-bad8-440b-8fc7-e8ebceae372e admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:28.026260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8747c-bad8-440b-8fc7-e8ebceae372e admin admin] PATH_INFO: `/v3/projects/395a185afeb442b193ce9fbd71d1a986` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:28.026787 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8747c-bad8-440b-8fc7-e8ebceae372e admin admin] RBAC: Authorizing `identity:delete_project(project_id=395a185afeb442b193ce9fbd71d1a986)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:28.029784 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8747c-bad8-440b-8fc7-e8ebceae372e admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:28.155164 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:28.158841 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-28e8747c-bad8-440b-8fc7-e8ebceae372e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '395a185afeb442b193ce9fbd71d1a986', 'request_id': 'req-28e8747c-bad8-440b-8fc7-e8ebceae372e'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:28.164735 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-28e8747c-bad8-440b-8fc7-e8ebceae372e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '395a185afeb442b193ce9fbd71d1a986', 'request_id': 'req-28e8747c-bad8-440b-8fc7-e8ebceae372e'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:28.171044 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-28e8747c-bad8-440b-8fc7-e8ebceae372e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '395a185afeb442b193ce9fbd71d1a986', 'request_id': 'req-28e8747c-bad8-440b-8fc7-e8ebceae372e'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:28.301355 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-28e8747c-bad8-440b-8fc7-e8ebceae372e admin admin] The token cache is being invalidate because project 395a185afeb442b193ce9fbd71d1a986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:42:28.302117 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-28e8747c-bad8-440b-8fc7-e8ebceae372e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:28.302383 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-28e8747c-bad8-440b-8fc7-e8ebceae372e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:28.303925 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1183/2365] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:42:27 2022] DELETE /identity/v3/projects/395a185afeb442b193ce9fbd71d1a986 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:28.310181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9bd06-de14-4445-868b-d3c3a6f4ad29 service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:28.318411 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9bd06-de14-4445-868b-d3c3a6f4ad29 service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:28.337258 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:28.375004 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76184a-6e41-4d61-9fda-dab74158e11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:28.375624 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76184a-6e41-4d61-9fda-dab74158e11f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:28.375899 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76184a-6e41-4d61-9fda-dab74158e11f admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:28.376171 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76184a-6e41-4d61-9fda-dab74158e11f admin admin] PATH_INFO: `/v3/users/214495838033464b8249fd8c99f0d683` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:28.377281 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76184a-6e41-4d61-9fda-dab74158e11f admin admin] RBAC: Authorizing `identity:delete_user(user_id=214495838033464b8249fd8c99f0d683)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:28.380315 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76184a-6e41-4d61-9fda-dab74158e11f admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:28.595821 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-6a76184a-6e41-4d61-9fda-dab74158e11f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '214495838033464b8249fd8c99f0d683'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:28.596451 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-6a76184a-6e41-4d61-9fda-dab74158e11f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '214495838033464b8249fd8c99f0d683'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:28.707293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-6a76184a-6e41-4d61-9fda-dab74158e11f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '214495838033464b8249fd8c99f0d683'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:28.719990 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-6a76184a-6e41-4d61-9fda-dab74158e11f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '214495838033464b8249fd8c99f0d683'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:28.720702 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-6a76184a-6e41-4d61-9fda-dab74158e11f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '214495838033464b8249fd8c99f0d683'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:28.733649 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1183/2366] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:42:28 2022] DELETE /identity/v3/users/214495838033464b8249fd8c99f0d683 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:29.141268 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8747c-bad8-440b-8fc7-e8ebceae372e admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:29.142758 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-28e8747c-bad8-440b-8fc7-e8ebceae372e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:29.157134 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8747c-bad8-440b-8fc7-e8ebceae372e admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:29.216987 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8aa3c7-e845-437d-86c8-dd692757c983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:29.217628 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aa3c7-e845-437d-86c8-dd692757c983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:29.217938 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aa3c7-e845-437d-86c8-dd692757c983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:29.218241 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aa3c7-e845-437d-86c8-dd692757c983 admin admin] PATH_INFO: `/v3/projects/a5f45bffaa734b51be8d9161ae8e8c2e` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:29.219419 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8aa3c7-e845-437d-86c8-dd692757c983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5f45bffaa734b51be8d9161ae8e8c2e)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:29.221383 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8aa3c7-e845-437d-86c8-dd692757c983 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:29.336398 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-3e8aa3c7-e845-437d-86c8-dd692757c983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5f45bffaa734b51be8d9161ae8e8c2e', 'request_id': 'req-3e8aa3c7-e845-437d-86c8-dd692757c983'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:29.341984 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-3e8aa3c7-e845-437d-86c8-dd692757c983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5f45bffaa734b51be8d9161ae8e8c2e', 'request_id': 'req-3e8aa3c7-e845-437d-86c8-dd692757c983'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:29.348387 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-3e8aa3c7-e845-437d-86c8-dd692757c983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5f45bffaa734b51be8d9161ae8e8c2e', 'request_id': 'req-3e8aa3c7-e845-437d-86c8-dd692757c983'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:29.420548 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-3e8aa3c7-e845-437d-86c8-dd692757c983 admin admin] The token cache is being invalidate because project a5f45bffaa734b51be8d9161ae8e8c2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:42:29.420759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-3e8aa3c7-e845-437d-86c8-dd692757c983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:29.421390 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-3e8aa3c7-e845-437d-86c8-dd692757c983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:29.422894 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1184/2367] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:42:29 2022] DELETE /identity/v3/projects/a5f45bffaa734b51be8d9161ae8e8c2e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:29.427941 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bac585-cdfc-485f-8b06-c49880d922a9 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:29.428411 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bac585-cdfc-485f-8b06-c49880d922a9 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:29.428513 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bac585-cdfc-485f-8b06-c49880d922a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:29.448402 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-23bac585-cdfc-485f-8b06-c49880d922a9 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:29.449591 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-23bac585-cdfc-485f-8b06-c49880d922a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:29.511441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1184/2368] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:29.520986 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7b797-88e2-41b2-bf98-6202f5b2ca75 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:29.521296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7b797-88e2-41b2-bf98-6202f5b2ca75 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:29.522521 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7b797-88e2-41b2-bf98-6202f5b2ca75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:29.541525 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-0da7b797-88e2-41b2-bf98-6202f5b2ca75 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:29.542729 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-0da7b797-88e2-41b2-bf98-6202f5b2ca75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:29.550736 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1185/2369] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:29.555508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bac585-cdfc-485f-8b06-c49880d922a9 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:29.565455 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bac585-cdfc-485f-8b06-c49880d922a9 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:29.570723 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173ab74-86ff-4992-aaef-61cf0f89e8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:29.571357 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173ab74-86ff-4992-aaef-61cf0f89e8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:29.571638 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173ab74-86ff-4992-aaef-61cf0f89e8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:29.571910 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173ab74-86ff-4992-aaef-61cf0f89e8d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:29.572561 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173ab74-86ff-4992-aaef-61cf0f89e8d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:42:29.572866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173ab74-86ff-4992-aaef-61cf0f89e8d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:29.574487 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173ab74-86ff-4992-aaef-61cf0f89e8d3 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:29.590363 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1185/2370] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:42:29.591694 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7b797-88e2-41b2-bf98-6202f5b2ca75 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:29.601046 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7b797-88e2-41b2-bf98-6202f5b2ca75 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:29.605742 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6059d7-7cfb-4d41-b17f-434de932163d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:29.606358 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6059d7-7cfb-4d41-b17f-434de932163d admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:29.606635 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6059d7-7cfb-4d41-b17f-434de932163d admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:29.606941 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6059d7-7cfb-4d41-b17f-434de932163d admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:29.607577 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6059d7-7cfb-4d41-b17f-434de932163d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:29.609495 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6059d7-7cfb-4d41-b17f-434de932163d admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:29.756325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1186/2371] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:42:29 2022] POST /identity/v3/projects => generated 407 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:42:29.757667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173ab74-86ff-4992-aaef-61cf0f89e8d3 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:29.767951 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173ab74-86ff-4992-aaef-61cf0f89e8d3 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:29.793735 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:29.824565 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a43825-567e-4975-94c9-e17a2b7170d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:29.825171 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a43825-567e-4975-94c9-e17a2b7170d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:29.825452 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a43825-567e-4975-94c9-e17a2b7170d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:29.825997 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a43825-567e-4975-94c9-e17a2b7170d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:29.826637 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a43825-567e-4975-94c9-e17a2b7170d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:29.828671 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a43825-567e-4975-94c9-e17a2b7170d2 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:29.970213 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1186/2372] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:42:29 2022] POST /identity/v3/users => generated 304 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:42:29.974975 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6059d7-7cfb-4d41-b17f-434de932163d admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:29.985590 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6059d7-7cfb-4d41-b17f-434de932163d admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:29.991154 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84923215-2468-4696-9de3-206d0f087e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:29.991724 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84923215-2468-4696-9de3-206d0f087e8c admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:29.991999 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84923215-2468-4696-9de3-206d0f087e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:29.992268 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84923215-2468-4696-9de3-206d0f087e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:29.992905 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84923215-2468-4696-9de3-206d0f087e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:29.994507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84923215-2468-4696-9de3-206d0f087e8c admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:30.004467 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1187/2373] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:30.008311 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a43825-567e-4975-94c9-e17a2b7170d2 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:30.017991 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a43825-567e-4975-94c9-e17a2b7170d2 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:30.023179 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d6a74-1be1-4e43-bbcc-7995334866ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:30.023764 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d6a74-1be1-4e43-bbcc-7995334866ad admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:30.024041 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d6a74-1be1-4e43-bbcc-7995334866ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:30.024309 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d6a74-1be1-4e43-bbcc-7995334866ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:30.024969 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d6a74-1be1-4e43-bbcc-7995334866ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:30.026559 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d6a74-1be1-4e43-bbcc-7995334866ad admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:30.037850 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1187/2374] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:30.041908 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84923215-2468-4696-9de3-206d0f087e8c admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:30.052709 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84923215-2468-4696-9de3-206d0f087e8c admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:30.057266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48edc3ce-e24f-4fcb-a65c-1b5bf9f3be80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:30.057912 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edc3ce-e24f-4fcb-a65c-1b5bf9f3be80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:30.058171 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edc3ce-e24f-4fcb-a65c-1b5bf9f3be80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:30.058445 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edc3ce-e24f-4fcb-a65c-1b5bf9f3be80 admin admin] PATH_INFO: `/v3/projects/4ec92a34081249aca4f81a58e1354e71/users/602cd9dd889b47338447409a334e85c1/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:30.070102 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:30.074103 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48edc3ce-e24f-4fcb-a65c-1b5bf9f3be80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec92a34081249aca4f81a58e1354e71, user_id=602cd9dd889b47338447409a334e85c1, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:30.077064 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48edc3ce-e24f-4fcb-a65c-1b5bf9f3be80 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:30.197324 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1188/2375] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:42:30 2022] PUT /identity/v3/projects/4ec92a34081249aca4f81a58e1354e71/users/602cd9dd889b47338447409a334e85c1/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:30.208438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65ed24-b068-48a8-84b8-10df3834629c None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:30.208722 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65ed24-b068-48a8-84b8-10df3834629c None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:30.209022 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65ed24-b068-48a8-84b8-10df3834629c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:30.239796 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-5e65ed24-b068-48a8-84b8-10df3834629c None None] MFA Rules not processed for user `602cd9dd889b47338447409a334e85c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:30.240952 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-5e65ed24-b068-48a8-84b8-10df3834629c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:30.306351 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1188/2376] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:30 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:30.310952 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48edc3ce-e24f-4fcb-a65c-1b5bf9f3be80 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:30.373372 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48edc3ce-e24f-4fcb-a65c-1b5bf9f3be80 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:30.378421 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3afc3-71a9-49b5-b659-1e8fd2568200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:30.379078 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3afc3-71a9-49b5-b659-1e8fd2568200 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:30.379538 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3afc3-71a9-49b5-b659-1e8fd2568200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:30.379865 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3afc3-71a9-49b5-b659-1e8fd2568200 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:30.380496 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3afc3-71a9-49b5-b659-1e8fd2568200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:30.382417 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3afc3-71a9-49b5-b659-1e8fd2568200 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:30.487267 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1189/2377] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:42:30 2022] POST /identity/v3/projects => generated 409 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:42:30.490453 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65ed24-b068-48a8-84b8-10df3834629c None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:30.500951 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65ed24-b068-48a8-84b8-10df3834629c None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:30.558709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c2837-2ffd-4343-9656-2582ab14fb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:30.559344 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c2837-2ffd-4343-9656-2582ab14fb84 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:30.559620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c2837-2ffd-4343-9656-2582ab14fb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:30.559893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c2837-2ffd-4343-9656-2582ab14fb84 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:30.560543 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c2837-2ffd-4343-9656-2582ab14fb84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:30.562558 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c2837-2ffd-4343-9656-2582ab14fb84 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:30.650260 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1189/2378] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:42:30 2022] POST /identity/v3/users => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:42:30.654448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3afc3-71a9-49b5-b659-1e8fd2568200 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:30.665826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3afc3-71a9-49b5-b659-1e8fd2568200 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:30.670385 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf45f1-5c5d-482a-a9c1-19268f6fd703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:30.671012 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf45f1-5c5d-482a-a9c1-19268f6fd703 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:30.671287 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf45f1-5c5d-482a-a9c1-19268f6fd703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:30.671556 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf45f1-5c5d-482a-a9c1-19268f6fd703 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:30.672188 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf45f1-5c5d-482a-a9c1-19268f6fd703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:30.673771 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf45f1-5c5d-482a-a9c1-19268f6fd703 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:30.684532 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1190/2379] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:30.688791 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c2837-2ffd-4343-9656-2582ab14fb84 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:30.698986 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c2837-2ffd-4343-9656-2582ab14fb84 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:30.703859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5336a-cdc1-4149-a445-7043d4f720fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:30.704495 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5336a-cdc1-4149-a445-7043d4f720fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:30.704772 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5336a-cdc1-4149-a445-7043d4f720fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:30.705045 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5336a-cdc1-4149-a445-7043d4f720fb admin admin] PATH_INFO: `/v3/projects/07174e2ecfa24badbefecc5697ff50d4/users/4091ed7a73804245b004b2c378e88b19/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:30.720318 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5336a-cdc1-4149-a445-7043d4f720fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=07174e2ecfa24badbefecc5697ff50d4, user_id=4091ed7a73804245b004b2c378e88b19, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:30.723769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5336a-cdc1-4149-a445-7043d4f720fb admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:30.799082 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1190/2380] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:42:30 2022] PUT /identity/v3/projects/07174e2ecfa24badbefecc5697ff50d4/users/4091ed7a73804245b004b2c378e88b19/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:42:30.803349 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf45f1-5c5d-482a-a9c1-19268f6fd703 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:30.813966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf45f1-5c5d-482a-a9c1-19268f6fd703 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:30.870613 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bceee-b73e-47fd-baea-ea7dca757930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:30.871250 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bceee-b73e-47fd-baea-ea7dca757930 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:30.871527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bceee-b73e-47fd-baea-ea7dca757930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:30.871799 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bceee-b73e-47fd-baea-ea7dca757930 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:30.872438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68bceee-b73e-47fd-baea-ea7dca757930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:30.874044 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68bceee-b73e-47fd-baea-ea7dca757930 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:30.888657 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1191/2381] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:30.890332 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5336a-cdc1-4149-a445-7043d4f720fb admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:30.896718 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:30.901954 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5336a-cdc1-4149-a445-7043d4f720fb admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:30.906523 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d87d1-4fde-4645-a394-a3fc2dc47956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:30.907202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d87d1-4fde-4645-a394-a3fc2dc47956 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:30.907479 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d87d1-4fde-4645-a394-a3fc2dc47956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:30.907749 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d87d1-4fde-4645-a394-a3fc2dc47956 admin admin] PATH_INFO: `/v3/projects/07174e2ecfa24badbefecc5697ff50d4/users/4091ed7a73804245b004b2c378e88b19/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:30.909685 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d87d1-4fde-4645-a394-a3fc2dc47956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07174e2ecfa24badbefecc5697ff50d4, user_id=4091ed7a73804245b004b2c378e88b19, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:30.912512 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d87d1-4fde-4645-a394-a3fc2dc47956 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:30.922626 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1191/2382] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:42:30 2022] PUT /identity/v3/projects/07174e2ecfa24badbefecc5697ff50d4/users/4091ed7a73804245b004b2c378e88b19/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:30.933021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a1eef-ec3a-4f1e-a259-b5969a1517d3 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:30.933310 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a1eef-ec3a-4f1e-a259-b5969a1517d3 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:30.933587 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a1eef-ec3a-4f1e-a259-b5969a1517d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:30.964140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-010a1eef-ec3a-4f1e-a259-b5969a1517d3 None None] MFA Rules not processed for user `4091ed7a73804245b004b2c378e88b19`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:30.966146 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-010a1eef-ec3a-4f1e-a259-b5969a1517d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:31.016029 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:31.038197 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1192/2383] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:30 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:42:31.048842 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d87d1-4fde-4645-a394-a3fc2dc47956 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:31.050509 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-831d87d1-4fde-4645-a394-a3fc2dc47956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:31.109881 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d87d1-4fde-4645-a394-a3fc2dc47956 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:31.114506 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0e400-6403-4829-b6be-f63f06f894a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:31.116570 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0e400-6403-4829-b6be-f63f06f894a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:31.116570 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0e400-6403-4829-b6be-f63f06f894a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:31.116570 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0e400-6403-4829-b6be-f63f06f894a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:31.126268 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0e400-6403-4829-b6be-f63f06f894a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:31.127766 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0e400-6403-4829-b6be-f63f06f894a9 service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:31.138387 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1192/2384] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:42:31 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:42:31.490309 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a1eef-ec3a-4f1e-a259-b5969a1517d3 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:31.499797 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a1eef-ec3a-4f1e-a259-b5969a1517d3 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:31.503257 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc0e07-59df-447a-96ab-bd8bb439a95d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:31.504310 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc0e07-59df-447a-96ab-bd8bb439a95d service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:31.504586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc0e07-59df-447a-96ab-bd8bb439a95d service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:31.504854 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc0e07-59df-447a-96ab-bd8bb439a95d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:31.562010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc0e07-59df-447a-96ab-bd8bb439a95d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:31.563501 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc0e07-59df-447a-96ab-bd8bb439a95d service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:31.572762 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1193/2385] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:42:31 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:42:32.049077 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0e400-6403-4829-b6be-f63f06f894a9 service cinder] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:32.050529 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-40f0e400-6403-4829-b6be-f63f06f894a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:32.114959 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0e400-6403-4829-b6be-f63f06f894a9 service cinder] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:32.119489 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4f764-5826-4683-a082-e7897551fb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:32.120113 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4f764-5826-4683-a082-e7897551fb90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:32.120385 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4f764-5826-4683-a082-e7897551fb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:32.120661 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4f764-5826-4683-a082-e7897551fb90 admin admin] PATH_INFO: `/v3/users/a1105769308f424a8d6a8ee0641768db` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:32.121775 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4f764-5826-4683-a082-e7897551fb90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1105769308f424a8d6a8ee0641768db)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:32.123707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4f764-5826-4683-a082-e7897551fb90 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:32.370084 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0ec4f764-5826-4683-a082-e7897551fb90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1105769308f424a8d6a8ee0641768db'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:32.370746 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0ec4f764-5826-4683-a082-e7897551fb90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1105769308f424a8d6a8ee0641768db'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:32.449638 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0ec4f764-5826-4683-a082-e7897551fb90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1105769308f424a8d6a8ee0641768db'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:32.463375 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0ec4f764-5826-4683-a082-e7897551fb90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1105769308f424a8d6a8ee0641768db'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:32.464009 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0ec4f764-5826-4683-a082-e7897551fb90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1105769308f424a8d6a8ee0641768db'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:32.476279 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1193/2386] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:42:32 2022] DELETE /identity/v3/users/a1105769308f424a8d6a8ee0641768db => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:32.480720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0021fe7-d9ce-4c3e-8ebb-9bb688e20bb8 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:32.481007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0021fe7-d9ce-4c3e-8ebb-9bb688e20bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:32.481280 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0021fe7-d9ce-4c3e-8ebb-9bb688e20bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:32.500717 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-c0021fe7-d9ce-4c3e-8ebb-9bb688e20bb8 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:32.501949 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c0021fe7-d9ce-4c3e-8ebb-9bb688e20bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:32.562305 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1194/2387] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:32.572712 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4f764-5826-4683-a082-e7897551fb90 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:32.574270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-0ec4f764-5826-4683-a082-e7897551fb90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:32.588360 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:32.632442 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4f764-5826-4683-a082-e7897551fb90 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:32.636043 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9ea0f-4f5f-465c-891b-abd6d9526f60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:32.636663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9ea0f-4f5f-465c-891b-abd6d9526f60 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:32.636942 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9ea0f-4f5f-465c-891b-abd6d9526f60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:32.637215 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9ea0f-4f5f-465c-891b-abd6d9526f60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:32.647631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9ea0f-4f5f-465c-891b-abd6d9526f60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:32.649100 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9ea0f-4f5f-465c-891b-abd6d9526f60 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:32.658418 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1194/2388] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:42:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:42:33.211064 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0021fe7-d9ce-4c3e-8ebb-9bb688e20bb8 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:33.212513 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c0021fe7-d9ce-4c3e-8ebb-9bb688e20bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:33.231205 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0021fe7-d9ce-4c3e-8ebb-9bb688e20bb8 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:33.236508 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05497a14-2c5c-4904-b5f1-0776882eb79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:33.237183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05497a14-2c5c-4904-b5f1-0776882eb79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:33.237500 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05497a14-2c5c-4904-b5f1-0776882eb79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:33.237846 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05497a14-2c5c-4904-b5f1-0776882eb79a admin admin] PATH_INFO: `/v3/projects/9cc1e7df4c9d40a2bd01ad2e9238a88a` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:33.243895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05497a14-2c5c-4904-b5f1-0776882eb79a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cc1e7df4c9d40a2bd01ad2e9238a88a)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:33.243895 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05497a14-2c5c-4904-b5f1-0776882eb79a admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:33.377010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-05497a14-2c5c-4904-b5f1-0776882eb79a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cc1e7df4c9d40a2bd01ad2e9238a88a', 'request_id': 'req-05497a14-2c5c-4904-b5f1-0776882eb79a'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:33.383308 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-05497a14-2c5c-4904-b5f1-0776882eb79a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cc1e7df4c9d40a2bd01ad2e9238a88a', 'request_id': 'req-05497a14-2c5c-4904-b5f1-0776882eb79a'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:33.389782 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-05497a14-2c5c-4904-b5f1-0776882eb79a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cc1e7df4c9d40a2bd01ad2e9238a88a', 'request_id': 'req-05497a14-2c5c-4904-b5f1-0776882eb79a'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:33.500513 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-05497a14-2c5c-4904-b5f1-0776882eb79a admin admin] The token cache is being invalidate because project 9cc1e7df4c9d40a2bd01ad2e9238a88a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:42:33.500797 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-05497a14-2c5c-4904-b5f1-0776882eb79a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:33.501403 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-05497a14-2c5c-4904-b5f1-0776882eb79a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:33.502928 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1195/2389] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:42:33 2022] DELETE /identity/v3/projects/9cc1e7df4c9d40a2bd01ad2e9238a88a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:33.508577 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f845a3d-0c83-4ec0-abb0-604e70c51039 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:33.509039 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f845a3d-0c83-4ec0-abb0-604e70c51039 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:33.509153 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f845a3d-0c83-4ec0-abb0-604e70c51039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:33.528905 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-1f845a3d-0c83-4ec0-abb0-604e70c51039 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:33.530088 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-1f845a3d-0c83-4ec0-abb0-604e70c51039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:33.591043 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1195/2390] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:33.598668 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab105c25-9425-4d85-8bc2-a364f47c57dd None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:33.598981 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab105c25-9425-4d85-8bc2-a364f47c57dd None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:33.599256 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab105c25-9425-4d85-8bc2-a364f47c57dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:33.614387 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:33.620089 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-ab105c25-9425-4d85-8bc2-a364f47c57dd None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:33.621346 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ab105c25-9425-4d85-8bc2-a364f47c57dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:33.629323 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1196/2391] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:42:33.633506 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f845a3d-0c83-4ec0-abb0-604e70c51039 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:33.643299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f845a3d-0c83-4ec0-abb0-604e70c51039 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:33.648666 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c4ba4-6aa7-4fdc-bfc6-f9bec5e16a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:33.649261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c4ba4-6aa7-4fdc-bfc6-f9bec5e16a61 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:33.649539 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c4ba4-6aa7-4fdc-bfc6-f9bec5e16a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:33.649858 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c4ba4-6aa7-4fdc-bfc6-f9bec5e16a61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:33.650502 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c4ba4-6aa7-4fdc-bfc6-f9bec5e16a61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:42:33.650804 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c4ba4-6aa7-4fdc-bfc6-f9bec5e16a61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:33.652467 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c4ba4-6aa7-4fdc-bfc6-f9bec5e16a61 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:33.665091 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1196/2392] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:42:33.669124 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab105c25-9425-4d85-8bc2-a364f47c57dd None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:33.678710 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab105c25-9425-4d85-8bc2-a364f47c57dd None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:33.683616 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4aebd-a150-43d7-92a0-036e238cf7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:33.684931 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4aebd-a150-43d7-92a0-036e238cf7ec admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:33.684931 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4aebd-a150-43d7-92a0-036e238cf7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:33.684931 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4aebd-a150-43d7-92a0-036e238cf7ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:33.685426 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4aebd-a150-43d7-92a0-036e238cf7ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:33.687380 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4aebd-a150-43d7-92a0-036e238cf7ec admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:33.782610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1197/2393] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:42:33 2022] POST /identity/v3/projects => generated 397 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:42:33.786528 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c4ba4-6aa7-4fdc-bfc6-f9bec5e16a61 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:33.796865 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c4ba4-6aa7-4fdc-bfc6-f9bec5e16a61 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:33.856864 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fd641-9faa-4075-9b88-35de38533d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:33.857474 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fd641-9faa-4075-9b88-35de38533d23 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:33.857754 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fd641-9faa-4075-9b88-35de38533d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:33.858030 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fd641-9faa-4075-9b88-35de38533d23 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:33.858663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fd641-9faa-4075-9b88-35de38533d23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:33.860725 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fd641-9faa-4075-9b88-35de38533d23 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:33.970480 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1197/2394] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:42:33 2022] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:42:33.974468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4aebd-a150-43d7-92a0-036e238cf7ec admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:33.984767 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4aebd-a150-43d7-92a0-036e238cf7ec admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:33.989729 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5cac7-1354-4538-86d9-cc3c0dbe36f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:33.990331 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5cac7-1354-4538-86d9-cc3c0dbe36f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:33.990606 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5cac7-1354-4538-86d9-cc3c0dbe36f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:33.990995 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5cac7-1354-4538-86d9-cc3c0dbe36f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:33.991637 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5cac7-1354-4538-86d9-cc3c0dbe36f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:33.993244 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5cac7-1354-4538-86d9-cc3c0dbe36f6 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:34.003051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1198/2395] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:34.007470 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fd641-9faa-4075-9b88-35de38533d23 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:34.017338 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fd641-9faa-4075-9b88-35de38533d23 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:34.022656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01293642-e774-42ad-aacf-3f0bb0fbc128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:34.023272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01293642-e774-42ad-aacf-3f0bb0fbc128 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:34.023552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01293642-e774-42ad-aacf-3f0bb0fbc128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:34.023822 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01293642-e774-42ad-aacf-3f0bb0fbc128 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:34.024463 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01293642-e774-42ad-aacf-3f0bb0fbc128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:34.026038 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01293642-e774-42ad-aacf-3f0bb0fbc128 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:34.036406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1198/2396] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:34.040289 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5cac7-1354-4538-86d9-cc3c0dbe36f6 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:34.050525 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5cac7-1354-4538-86d9-cc3c0dbe36f6 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:34.056032 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277659d-0325-4baa-a025-9fb69b348cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:34.056669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277659d-0325-4baa-a025-9fb69b348cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:34.056973 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277659d-0325-4baa-a025-9fb69b348cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:34.057248 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277659d-0325-4baa-a025-9fb69b348cc8 admin admin] PATH_INFO: `/v3/projects/715cec3ac49d46a7bc806d8b58b5b34d/users/df12a277ef4145109c3332edff1915e1/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:34.072268 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277659d-0325-4baa-a025-9fb69b348cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=715cec3ac49d46a7bc806d8b58b5b34d, user_id=df12a277ef4145109c3332edff1915e1, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:34.074967 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277659d-0325-4baa-a025-9fb69b348cc8 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:34.129244 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1199/2397] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:42:34 2022] PUT /identity/v3/projects/715cec3ac49d46a7bc806d8b58b5b34d/users/df12a277ef4145109c3332edff1915e1/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:34.141711 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b2d1d-ae1c-4ccd-8fb9-e1d71caa0343 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:34.141999 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b2d1d-ae1c-4ccd-8fb9-e1d71caa0343 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:34.142278 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b2d1d-ae1c-4ccd-8fb9-e1d71caa0343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:34.172004 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-9b7b2d1d-ae1c-4ccd-8fb9-e1d71caa0343 None None] MFA Rules not processed for user `df12a277ef4145109c3332edff1915e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:34.173215 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-9b7b2d1d-ae1c-4ccd-8fb9-e1d71caa0343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:34.181913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:34.241653 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1199/2398] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:34 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:34.253106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277659d-0325-4baa-a025-9fb69b348cc8 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:34.254769 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-e277659d-0325-4baa-a025-9fb69b348cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:34.312617 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277659d-0325-4baa-a025-9fb69b348cc8 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:34.316213 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018b80f-ed42-4663-a3ec-43fee7a1df85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:34.316805 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018b80f-ed42-4663-a3ec-43fee7a1df85 service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:34.317076 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018b80f-ed42-4663-a3ec-43fee7a1df85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:34.317344 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018b80f-ed42-4663-a3ec-43fee7a1df85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:34.326881 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018b80f-ed42-4663-a3ec-43fee7a1df85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:34.328296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018b80f-ed42-4663-a3ec-43fee7a1df85 service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:34.337310 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1200/2399] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:42:34 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:42:39.848140 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b2d1d-ae1c-4ccd-8fb9-e1d71caa0343 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:39.849785 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-9b7b2d1d-ae1c-4ccd-8fb9-e1d71caa0343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:39.917132 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b2d1d-ae1c-4ccd-8fb9-e1d71caa0343 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:39.921866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90658a-851f-4548-9245-c4457eae39ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:39.922502 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90658a-851f-4548-9245-c4457eae39ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:39.922781 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90658a-851f-4548-9245-c4457eae39ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:39.923097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90658a-851f-4548-9245-c4457eae39ea admin admin] PATH_INFO: `/v3/users/602cd9dd889b47338447409a334e85c1` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:39.924227 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90658a-851f-4548-9245-c4457eae39ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=602cd9dd889b47338447409a334e85c1)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:39.926346 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90658a-851f-4548-9245-c4457eae39ea admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:40.125978 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-fe90658a-851f-4548-9245-c4457eae39ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '602cd9dd889b47338447409a334e85c1'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:40.126631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-fe90658a-851f-4548-9245-c4457eae39ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '602cd9dd889b47338447409a334e85c1'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:40.203969 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-fe90658a-851f-4548-9245-c4457eae39ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '602cd9dd889b47338447409a334e85c1'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:40.219085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-fe90658a-851f-4548-9245-c4457eae39ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '602cd9dd889b47338447409a334e85c1'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:40.219812 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-fe90658a-851f-4548-9245-c4457eae39ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '602cd9dd889b47338447409a334e85c1'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:40.233363 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1200/2400] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:42:39 2022] DELETE /identity/v3/users/602cd9dd889b47338447409a334e85c1 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:40.237462 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d573811-e30b-4183-a41d-6f4793d69cfe None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:40.237915 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d573811-e30b-4183-a41d-6f4793d69cfe None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:40.240015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d573811-e30b-4183-a41d-6f4793d69cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:40.257400 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-6d573811-e30b-4183-a41d-6f4793d69cfe None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:40.258464 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-6d573811-e30b-4183-a41d-6f4793d69cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:40.315988 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1201/2401] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:40.325581 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90658a-851f-4548-9245-c4457eae39ea admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:40.327318 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-fe90658a-851f-4548-9245-c4457eae39ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:40.359425 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:40.384568 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90658a-851f-4548-9245-c4457eae39ea admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:40.388159 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e2112-f593-41e9-be66-e76296dc163f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:40.388758 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e2112-f593-41e9-be66-e76296dc163f service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:40.389031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e2112-f593-41e9-be66-e76296dc163f service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:40.389305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e2112-f593-41e9-be66-e76296dc163f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:40.398752 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e2112-f593-41e9-be66-e76296dc163f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:40.400205 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e2112-f593-41e9-be66-e76296dc163f service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:40.409798 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1201/2402] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:42:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:42:40.570027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d573811-e30b-4183-a41d-6f4793d69cfe None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:40.571365 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-6d573811-e30b-4183-a41d-6f4793d69cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:40.583405 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d573811-e30b-4183-a41d-6f4793d69cfe None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:40.588964 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba0459-9a32-4740-8e60-185215576aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:40.589840 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba0459-9a32-4740-8e60-185215576aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:40.590113 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba0459-9a32-4740-8e60-185215576aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:40.590378 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba0459-9a32-4740-8e60-185215576aeb admin admin] PATH_INFO: `/v3/users/df12a277ef4145109c3332edff1915e1` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:40.591695 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba0459-9a32-4740-8e60-185215576aeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=df12a277ef4145109c3332edff1915e1)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:40.593621 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba0459-9a32-4740-8e60-185215576aeb admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:40.812682 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e2112-f593-41e9-be66-e76296dc163f service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:40.814174 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-4c2e2112-f593-41e9-be66-e76296dc163f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:40.827310 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:40.829895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e2112-f593-41e9-be66-e76296dc163f service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:40.833530 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-21ba0459-9a32-4740-8e60-185215576aeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df12a277ef4145109c3332edff1915e1'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:40.834204 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-21ba0459-9a32-4740-8e60-185215576aeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df12a277ef4145109c3332edff1915e1'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:40.835709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e453e4-4a97-425f-a538-06737341e39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:40.836408 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e453e4-4a97-425f-a538-06737341e39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:40.836731 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e453e4-4a97-425f-a538-06737341e39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:40.836924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e453e4-4a97-425f-a538-06737341e39a admin admin] PATH_INFO: `/v3/projects/4ec92a34081249aca4f81a58e1354e71` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:40.838450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e453e4-4a97-425f-a538-06737341e39a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ec92a34081249aca4f81a58e1354e71)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:40.840581 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e453e4-4a97-425f-a538-06737341e39a admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:40.935799 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-21ba0459-9a32-4740-8e60-185215576aeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df12a277ef4145109c3332edff1915e1'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:40.943602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-21ba0459-9a32-4740-8e60-185215576aeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df12a277ef4145109c3332edff1915e1'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:40.944338 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-21ba0459-9a32-4740-8e60-185215576aeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df12a277ef4145109c3332edff1915e1'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:40.955354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-16e453e4-4a97-425f-a538-06737341e39a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ec92a34081249aca4f81a58e1354e71', 'request_id': 'req-16e453e4-4a97-425f-a538-06737341e39a'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:40.962141 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-16e453e4-4a97-425f-a538-06737341e39a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ec92a34081249aca4f81a58e1354e71', 'request_id': 'req-16e453e4-4a97-425f-a538-06737341e39a'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:40.962826 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1202/2403] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:42:40 2022] DELETE /identity/v3/users/df12a277ef4145109c3332edff1915e1 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:40.967515 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083534d9-160f-4f20-af09-43734707fa9c None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:40.967854 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083534d9-160f-4f20-af09-43734707fa9c None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:40.968125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083534d9-160f-4f20-af09-43734707fa9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:40.987386 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-083534d9-160f-4f20-af09-43734707fa9c None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:40.988562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-083534d9-160f-4f20-af09-43734707fa9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:41.044221 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-16e453e4-4a97-425f-a538-06737341e39a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ec92a34081249aca4f81a58e1354e71', 'request_id': 'req-16e453e4-4a97-425f-a538-06737341e39a'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:41.047685 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1203/2404] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:42:41.057516 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083534d9-160f-4f20-af09-43734707fa9c None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:41.058327 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-16e453e4-4a97-425f-a538-06737341e39a admin admin] The token cache is being invalidate because project 4ec92a34081249aca4f81a58e1354e71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:42:41.058614 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-16e453e4-4a97-425f-a538-06737341e39a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:41.058923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-083534d9-160f-4f20-af09-43734707fa9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:41.059351 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-16e453e4-4a97-425f-a538-06737341e39a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:41.060900 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1202/2405] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:42:40 2022] DELETE /identity/v3/projects/4ec92a34081249aca4f81a58e1354e71 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:41.064492 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e453e4-4a97-425f-a538-06737341e39a admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:41.065864 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-16e453e4-4a97-425f-a538-06737341e39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:41.122061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083534d9-160f-4f20-af09-43734707fa9c None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:41.125806 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4e3dd-f886-472e-8495-1db371a1f4c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:41.126405 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4e3dd-f886-472e-8495-1db371a1f4c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:41.126676 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4e3dd-f886-472e-8495-1db371a1f4c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:41.127044 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4e3dd-f886-472e-8495-1db371a1f4c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:41.128947 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-6ef4e3dd-f886-472e-8495-1db371a1f4c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:41.132304 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e453e4-4a97-425f-a538-06737341e39a admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:41.137745 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140d297-8eb4-4e01-b7b1-b273b6125ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:41.138371 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140d297-8eb4-4e01-b7b1-b273b6125ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:41.138649 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140d297-8eb4-4e01-b7b1-b273b6125ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:41.138965 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140d297-8eb4-4e01-b7b1-b273b6125ad7 admin admin] PATH_INFO: `/v3/users/4091ed7a73804245b004b2c378e88b19` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:41.140148 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140d297-8eb4-4e01-b7b1-b273b6125ad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4091ed7a73804245b004b2c378e88b19)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:41.145527 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140d297-8eb4-4e01-b7b1-b273b6125ad7 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:41.145639 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4e3dd-f886-472e-8495-1db371a1f4c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:41.145639 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4e3dd-f886-472e-8495-1db371a1f4c9 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:41.154854 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1204/2406] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:42:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:42:41.339795 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-f140d297-8eb4-4e01-b7b1-b273b6125ad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4091ed7a73804245b004b2c378e88b19'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:41.340566 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-f140d297-8eb4-4e01-b7b1-b273b6125ad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4091ed7a73804245b004b2c378e88b19'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:41.467158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-f140d297-8eb4-4e01-b7b1-b273b6125ad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4091ed7a73804245b004b2c378e88b19'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:41.469606 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:41.481216 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-f140d297-8eb4-4e01-b7b1-b273b6125ad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4091ed7a73804245b004b2c378e88b19'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:41.481910 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-f140d297-8eb4-4e01-b7b1-b273b6125ad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4091ed7a73804245b004b2c378e88b19'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:41.494768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1203/2407] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:42:41 2022] DELETE /identity/v3/users/4091ed7a73804245b004b2c378e88b19 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:42:41.611345 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4e3dd-f886-472e-8495-1db371a1f4c9 service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:41.612834 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-6ef4e3dd-f886-472e-8495-1db371a1f4c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:41.629616 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4e3dd-f886-472e-8495-1db371a1f4c9 service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:41.693246 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b55330-0974-49f2-819f-6013f712d198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:41.693877 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b55330-0974-49f2-819f-6013f712d198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:41.694168 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b55330-0974-49f2-819f-6013f712d198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:41.694484 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b55330-0974-49f2-819f-6013f712d198 admin admin] PATH_INFO: `/v3/projects/715cec3ac49d46a7bc806d8b58b5b34d` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:41.696196 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b55330-0974-49f2-819f-6013f712d198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=715cec3ac49d46a7bc806d8b58b5b34d)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:41.698110 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b55330-0974-49f2-819f-6013f712d198 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:41.700546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:41.839370 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-42b55330-0974-49f2-819f-6013f712d198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '715cec3ac49d46a7bc806d8b58b5b34d', 'request_id': 'req-42b55330-0974-49f2-819f-6013f712d198'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:41.844821 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-42b55330-0974-49f2-819f-6013f712d198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '715cec3ac49d46a7bc806d8b58b5b34d', 'request_id': 'req-42b55330-0974-49f2-819f-6013f712d198'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:41.851387 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-42b55330-0974-49f2-819f-6013f712d198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '715cec3ac49d46a7bc806d8b58b5b34d', 'request_id': 'req-42b55330-0974-49f2-819f-6013f712d198'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:41.953233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-42b55330-0974-49f2-819f-6013f712d198 admin admin] The token cache is being invalidate because project 715cec3ac49d46a7bc806d8b58b5b34d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:42:41.953517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-42b55330-0974-49f2-819f-6013f712d198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:41.954160 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-42b55330-0974-49f2-819f-6013f712d198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:41.955712 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1205/2408] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:42:41 2022] DELETE /identity/v3/projects/715cec3ac49d46a7bc806d8b58b5b34d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:41.979378 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140d297-8eb4-4e01-b7b1-b273b6125ad7 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:41.981226 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-f140d297-8eb4-4e01-b7b1-b273b6125ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:42.002326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140d297-8eb4-4e01-b7b1-b273b6125ad7 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:42.067602 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7eba6-6116-4f28-9fff-3ce21d34103a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:42.068255 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7eba6-6116-4f28-9fff-3ce21d34103a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:42.068558 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7eba6-6116-4f28-9fff-3ce21d34103a admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:42.068832 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7eba6-6116-4f28-9fff-3ce21d34103a admin admin] PATH_INFO: `/v3/projects/07174e2ecfa24badbefecc5697ff50d4` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:42.070006 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7eba6-6116-4f28-9fff-3ce21d34103a admin admin] RBAC: Authorizing `identity:delete_project(project_id=07174e2ecfa24badbefecc5697ff50d4)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:42.072555 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7eba6-6116-4f28-9fff-3ce21d34103a admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:42.194151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-b2e7eba6-6116-4f28-9fff-3ce21d34103a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07174e2ecfa24badbefecc5697ff50d4', 'request_id': 'req-b2e7eba6-6116-4f28-9fff-3ce21d34103a'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:42.201592 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-b2e7eba6-6116-4f28-9fff-3ce21d34103a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07174e2ecfa24badbefecc5697ff50d4', 'request_id': 'req-b2e7eba6-6116-4f28-9fff-3ce21d34103a'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:42.288399 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-b2e7eba6-6116-4f28-9fff-3ce21d34103a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07174e2ecfa24badbefecc5697ff50d4', 'request_id': 'req-b2e7eba6-6116-4f28-9fff-3ce21d34103a'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:42.300458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-b2e7eba6-6116-4f28-9fff-3ce21d34103a admin admin] The token cache is being invalidate because project 07174e2ecfa24badbefecc5697ff50d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:42:42.300751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-b2e7eba6-6116-4f28-9fff-3ce21d34103a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:42.301385 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-b2e7eba6-6116-4f28-9fff-3ce21d34103a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:42.302887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1204/2409] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:42:41 2022] DELETE /identity/v3/projects/07174e2ecfa24badbefecc5697ff50d4 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:42.308481 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0041ed5-7781-4c99-af65-a01f00764512 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:42.308761 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0041ed5-7781-4c99-af65-a01f00764512 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:42.309029 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0041ed5-7781-4c99-af65-a01f00764512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:42.329509 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-f0041ed5-7781-4c99-af65-a01f00764512 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:42.330835 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-f0041ed5-7781-4c99-af65-a01f00764512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:42.390456 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1206/2410] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:42.398183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d5bb1-bac0-42b1-8f55-d54ef3216ebc None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:42.398472 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d5bb1-bac0-42b1-8f55-d54ef3216ebc None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:42.398749 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d5bb1-bac0-42b1-8f55-d54ef3216ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:42.418536 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-6a3d5bb1-bac0-42b1-8f55-d54ef3216ebc None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:42.419789 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-6a3d5bb1-bac0-42b1-8f55-d54ef3216ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:42.427949 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1205/2411] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:42.432813 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0041ed5-7781-4c99-af65-a01f00764512 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:42.442809 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0041ed5-7781-4c99-af65-a01f00764512 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:42.448497 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27845c-e06d-4c3e-9410-194d16765184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:42.449105 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27845c-e06d-4c3e-9410-194d16765184 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:42.449382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27845c-e06d-4c3e-9410-194d16765184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:42.449650 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27845c-e06d-4c3e-9410-194d16765184 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:42.450299 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27845c-e06d-4c3e-9410-194d16765184 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:42:42.450922 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27845c-e06d-4c3e-9410-194d16765184 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:42.452622 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27845c-e06d-4c3e-9410-194d16765184 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:42.468199 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1207/2412] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:42:42.469350 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d5bb1-bac0-42b1-8f55-d54ef3216ebc None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:42.478781 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d5bb1-bac0-42b1-8f55-d54ef3216ebc None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:42.483654 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848336bc-913d-4f55-91be-a9dcb1a60699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:42.484248 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848336bc-913d-4f55-91be-a9dcb1a60699 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:42.484563 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848336bc-913d-4f55-91be-a9dcb1a60699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:42.484836 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848336bc-913d-4f55-91be-a9dcb1a60699 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:42.485472 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848336bc-913d-4f55-91be-a9dcb1a60699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:42.487402 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848336bc-913d-4f55-91be-a9dcb1a60699 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:42.582908 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1206/2413] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:42:42 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:42:42.587619 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27845c-e06d-4c3e-9410-194d16765184 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:42.597441 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27845c-e06d-4c3e-9410-194d16765184 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:42.655966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa3d62-f483-4eee-b7e3-b5eee64fe9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:42.656820 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa3d62-f483-4eee-b7e3-b5eee64fe9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:42.656820 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa3d62-f483-4eee-b7e3-b5eee64fe9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:42.657100 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa3d62-f483-4eee-b7e3-b5eee64fe9f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:42.657724 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa3d62-f483-4eee-b7e3-b5eee64fe9f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:42.659863 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa3d62-f483-4eee-b7e3-b5eee64fe9f3 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:42.764343 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1208/2414] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:42:42 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:42:42.770736 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848336bc-913d-4f55-91be-a9dcb1a60699 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:42.779450 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848336bc-913d-4f55-91be-a9dcb1a60699 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:42.783994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9aac4c-0bc9-440b-9fd6-d6e70b997006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:42.784586 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9aac4c-0bc9-440b-9fd6-d6e70b997006 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:42.784861 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9aac4c-0bc9-440b-9fd6-d6e70b997006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:42.785130 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9aac4c-0bc9-440b-9fd6-d6e70b997006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:42.785764 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9aac4c-0bc9-440b-9fd6-d6e70b997006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:42.787424 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9aac4c-0bc9-440b-9fd6-d6e70b997006 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:42.797899 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1207/2415] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:42.801762 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa3d62-f483-4eee-b7e3-b5eee64fe9f3 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:42.812337 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa3d62-f483-4eee-b7e3-b5eee64fe9f3 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:42.817285 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f567dd-3772-48ce-8cb3-99eb751d54c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:42.817879 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f567dd-3772-48ce-8cb3-99eb751d54c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:42.818155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f567dd-3772-48ce-8cb3-99eb751d54c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:42.818424 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f567dd-3772-48ce-8cb3-99eb751d54c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:42.819123 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f567dd-3772-48ce-8cb3-99eb751d54c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:42.821000 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f567dd-3772-48ce-8cb3-99eb751d54c1 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:42.823004 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:42.832138 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1209/2416] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:42.836079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9aac4c-0bc9-440b-9fd6-d6e70b997006 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:42.846085 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9aac4c-0bc9-440b-9fd6-d6e70b997006 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:42.850900 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba6ef5-864e-4ce8-bc17-35235bf6b042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:42.851538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba6ef5-864e-4ce8-bc17-35235bf6b042 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:42.852532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba6ef5-864e-4ce8-bc17-35235bf6b042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:42.852532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba6ef5-864e-4ce8-bc17-35235bf6b042 admin admin] PATH_INFO: `/v3/projects/3a68442cd6284875871f0e5469ecc7e4/users/731037adff9b4e48960a41ee188c03f6/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:42.869267 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba6ef5-864e-4ce8-bc17-35235bf6b042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a68442cd6284875871f0e5469ecc7e4, user_id=731037adff9b4e48960a41ee188c03f6, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:42.872005 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba6ef5-864e-4ce8-bc17-35235bf6b042 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:42.971318 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:42.976094 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1208/2417] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:42:42 2022] PUT /identity/v3/projects/3a68442cd6284875871f0e5469ecc7e4/users/731037adff9b4e48960a41ee188c03f6/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:42.986992 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68770a-38dc-4a0a-bf2c-34df61204834 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:42.987327 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68770a-38dc-4a0a-bf2c-34df61204834 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:42.987645 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68770a-38dc-4a0a-bf2c-34df61204834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:43.015891 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-ab68770a-38dc-4a0a-bf2c-34df61204834 None None] MFA Rules not processed for user `731037adff9b4e48960a41ee188c03f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:43.017099 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ab68770a-38dc-4a0a-bf2c-34df61204834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:43.080900 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1210/2418] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:43.085506 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba6ef5-864e-4ce8-bc17-35235bf6b042 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:43.147982 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba6ef5-864e-4ce8-bc17-35235bf6b042 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:43.153532 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ef364-6cb9-4077-a5e1-3a1e082b879d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:43.154130 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ef364-6cb9-4077-a5e1-3a1e082b879d admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:43.154407 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ef364-6cb9-4077-a5e1-3a1e082b879d admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:43.154741 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ef364-6cb9-4077-a5e1-3a1e082b879d admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:43.155416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ef364-6cb9-4077-a5e1-3a1e082b879d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:43.157310 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ef364-6cb9-4077-a5e1-3a1e082b879d admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:43.234898 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1209/2419] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:42:43 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:42:43.238941 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68770a-38dc-4a0a-bf2c-34df61204834 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:43.249586 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68770a-38dc-4a0a-bf2c-34df61204834 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:43.307536 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3450001-c420-40cd-be28-52932565690f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:43.308142 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3450001-c420-40cd-be28-52932565690f admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:43.308414 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3450001-c420-40cd-be28-52932565690f admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:43.308679 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3450001-c420-40cd-be28-52932565690f admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:43.309291 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3450001-c420-40cd-be28-52932565690f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:43.311244 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3450001-c420-40cd-be28-52932565690f admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:43.409494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1211/2420] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:42:43 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:42:43.413504 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ef364-6cb9-4077-a5e1-3a1e082b879d admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:43.424353 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ef364-6cb9-4077-a5e1-3a1e082b879d admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:43.429080 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448b482-2ed9-4798-9507-76b4aceb9387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:43.429665 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448b482-2ed9-4798-9507-76b4aceb9387 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:43.430276 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448b482-2ed9-4798-9507-76b4aceb9387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:43.430413 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448b482-2ed9-4798-9507-76b4aceb9387 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:43.431199 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448b482-2ed9-4798-9507-76b4aceb9387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:43.432789 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448b482-2ed9-4798-9507-76b4aceb9387 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:43.443323 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1210/2421] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:43.447945 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3450001-c420-40cd-be28-52932565690f admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:43.458408 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3450001-c420-40cd-be28-52932565690f admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:43.463790 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bae832-4bc5-4896-bcac-dfca2ae8265d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:43.464372 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bae832-4bc5-4896-bcac-dfca2ae8265d admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:43.464641 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bae832-4bc5-4896-bcac-dfca2ae8265d admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:43.464906 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bae832-4bc5-4896-bcac-dfca2ae8265d admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:43.465536 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bae832-4bc5-4896-bcac-dfca2ae8265d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:43.467175 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bae832-4bc5-4896-bcac-dfca2ae8265d admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:43.476951 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1212/2422] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:43.481177 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448b482-2ed9-4798-9507-76b4aceb9387 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:43.491097 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448b482-2ed9-4798-9507-76b4aceb9387 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:43.496001 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf34a7-2a11-4cdc-8cca-a9e2edeff627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:43.496635 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf34a7-2a11-4cdc-8cca-a9e2edeff627 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:43.496911 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf34a7-2a11-4cdc-8cca-a9e2edeff627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:43.497187 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf34a7-2a11-4cdc-8cca-a9e2edeff627 admin admin] PATH_INFO: `/v3/projects/f2080cee39c24e66a74505392980d93b/users/d927f4e9b1394d9a8dd146413c9b8050/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:43.512073 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf34a7-2a11-4cdc-8cca-a9e2edeff627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2080cee39c24e66a74505392980d93b, user_id=d927f4e9b1394d9a8dd146413c9b8050, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:43.514704 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf34a7-2a11-4cdc-8cca-a9e2edeff627 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:43.579407 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1211/2423] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:42:43 2022] PUT /identity/v3/projects/f2080cee39c24e66a74505392980d93b/users/d927f4e9b1394d9a8dd146413c9b8050/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:43.645730 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227579f-957e-4aea-9c03-44edbe09a461 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:43.646011 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227579f-957e-4aea-9c03-44edbe09a461 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:43.646304 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227579f-957e-4aea-9c03-44edbe09a461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:43.674787 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-e227579f-957e-4aea-9c03-44edbe09a461 None None] MFA Rules not processed for user `d927f4e9b1394d9a8dd146413c9b8050`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:43.675957 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-e227579f-957e-4aea-9c03-44edbe09a461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:43.731217 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:43.739721 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1213/2424] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:43.747049 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf34a7-2a11-4cdc-8cca-a9e2edeff627 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:43.806859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf34a7-2a11-4cdc-8cca-a9e2edeff627 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:43.811802 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd282e9-b13e-4e6f-8bc2-6c2fb7a8d79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:43.812400 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd282e9-b13e-4e6f-8bc2-6c2fb7a8d79f admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:43.812680 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd282e9-b13e-4e6f-8bc2-6c2fb7a8d79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:43.812955 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd282e9-b13e-4e6f-8bc2-6c2fb7a8d79f admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:43.813584 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd282e9-b13e-4e6f-8bc2-6c2fb7a8d79f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:43.815560 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd282e9-b13e-4e6f-8bc2-6c2fb7a8d79f admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:43.902854 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1212/2425] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:42:43 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:42:43.906982 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227579f-957e-4aea-9c03-44edbe09a461 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:43.918315 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227579f-957e-4aea-9c03-44edbe09a461 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:43.975495 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2be13a-ba39-440f-8384-db1b120263d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:43.976022 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2be13a-ba39-440f-8384-db1b120263d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:43.976335 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2be13a-ba39-440f-8384-db1b120263d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:43.976641 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2be13a-ba39-440f-8384-db1b120263d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:43.977263 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2be13a-ba39-440f-8384-db1b120263d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:43.979222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2be13a-ba39-440f-8384-db1b120263d3 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:44.065209 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1214/2426] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:42:43 2022] POST /identity/v3/users => generated 296 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:42:44.069196 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd282e9-b13e-4e6f-8bc2-6c2fb7a8d79f admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:44.080415 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd282e9-b13e-4e6f-8bc2-6c2fb7a8d79f admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:44.085089 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74b77a-a142-44c8-b935-24fc95f12ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:44.085677 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74b77a-a142-44c8-b935-24fc95f12ede admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:44.086252 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74b77a-a142-44c8-b935-24fc95f12ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:44.086252 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74b77a-a142-44c8-b935-24fc95f12ede admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:44.086894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74b77a-a142-44c8-b935-24fc95f12ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:44.088484 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74b77a-a142-44c8-b935-24fc95f12ede admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:44.099246 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1213/2427] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:44.103863 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2be13a-ba39-440f-8384-db1b120263d3 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:44.113915 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2be13a-ba39-440f-8384-db1b120263d3 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:44.119237 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc01de-e4d3-428c-9aa4-e2d384254183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:44.119878 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc01de-e4d3-428c-9aa4-e2d384254183 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:44.120152 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc01de-e4d3-428c-9aa4-e2d384254183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:44.120420 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc01de-e4d3-428c-9aa4-e2d384254183 admin admin] PATH_INFO: `/v3/projects/98ff61df12014618875363ca777669d1/users/9dcb7474779a4a43b0c523e660157b0d/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:44.134906 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc01de-e4d3-428c-9aa4-e2d384254183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98ff61df12014618875363ca777669d1, user_id=9dcb7474779a4a43b0c523e660157b0d, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:44.137563 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc01de-e4d3-428c-9aa4-e2d384254183 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:44.202738 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1215/2428] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:42:44 2022] PUT /identity/v3/projects/98ff61df12014618875363ca777669d1/users/9dcb7474779a4a43b0c523e660157b0d/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:44.206516 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74b77a-a142-44c8-b935-24fc95f12ede admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:44.217016 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74b77a-a142-44c8-b935-24fc95f12ede admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:44.238410 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:44.274358 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cd32c-d56e-4b7f-85fb-1e2410d3ea18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:44.275020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cd32c-d56e-4b7f-85fb-1e2410d3ea18 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:44.275297 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cd32c-d56e-4b7f-85fb-1e2410d3ea18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:44.275567 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cd32c-d56e-4b7f-85fb-1e2410d3ea18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:44.276241 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8cd32c-d56e-4b7f-85fb-1e2410d3ea18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:44.277944 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8cd32c-d56e-4b7f-85fb-1e2410d3ea18 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:44.287965 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1214/2429] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:44.292621 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc01de-e4d3-428c-9aa4-e2d384254183 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:44.302880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc01de-e4d3-428c-9aa4-e2d384254183 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:44.308600 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e912f0-864b-4d18-a3c2-91e035cb4ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:44.309233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e912f0-864b-4d18-a3c2-91e035cb4ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:44.309507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e912f0-864b-4d18-a3c2-91e035cb4ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:44.309771 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e912f0-864b-4d18-a3c2-91e035cb4ef3 admin admin] PATH_INFO: `/v3/projects/98ff61df12014618875363ca777669d1/users/9dcb7474779a4a43b0c523e660157b0d/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:44.311700 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e912f0-864b-4d18-a3c2-91e035cb4ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98ff61df12014618875363ca777669d1, user_id=9dcb7474779a4a43b0c523e660157b0d, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:44.314329 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e912f0-864b-4d18-a3c2-91e035cb4ef3 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:44.324810 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1216/2430] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:42:44 2022] PUT /identity/v3/projects/98ff61df12014618875363ca777669d1/users/9dcb7474779a4a43b0c523e660157b0d/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:44.334732 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608bb43-d337-4288-9c7c-fa682f753ecd None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:44.335063 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608bb43-d337-4288-9c7c-fa682f753ecd None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:44.335363 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608bb43-d337-4288-9c7c-fa682f753ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:44.362732 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-0608bb43-d337-4288-9c7c-fa682f753ecd None None] MFA Rules not processed for user `9dcb7474779a4a43b0c523e660157b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:44.363951 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-0608bb43-d337-4288-9c7c-fa682f753ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:44.432599 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1215/2431] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:44 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:44.444195 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e912f0-864b-4d18-a3c2-91e035cb4ef3 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:44.445906 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-07e912f0-864b-4d18-a3c2-91e035cb4ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:44.504104 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e912f0-864b-4d18-a3c2-91e035cb4ef3 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:44.507706 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f18408-6b5b-4ef2-a664-c86d77aaad24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:44.508301 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f18408-6b5b-4ef2-a664-c86d77aaad24 service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:44.508580 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f18408-6b5b-4ef2-a664-c86d77aaad24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:44.508856 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f18408-6b5b-4ef2-a664-c86d77aaad24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:44.517858 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f18408-6b5b-4ef2-a664-c86d77aaad24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:44.519321 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f18408-6b5b-4ef2-a664-c86d77aaad24 service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:44.529427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1217/2432] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:42:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:42:44.629246 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608bb43-d337-4288-9c7c-fa682f753ecd None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:44.630681 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-0608bb43-d337-4288-9c7c-fa682f753ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:44.643129 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608bb43-d337-4288-9c7c-fa682f753ecd None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:44.646916 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e65a8-cf04-45a3-8c0b-72b850843137 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:44.647294 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e65a8-cf04-45a3-8c0b-72b850843137 service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:44.647568 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e65a8-cf04-45a3-8c0b-72b850843137 service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:44.647840 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e65a8-cf04-45a3-8c0b-72b850843137 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:44.705160 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e65a8-cf04-45a3-8c0b-72b850843137 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:44.706584 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e65a8-cf04-45a3-8c0b-72b850843137 service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:44.716119 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1216/2433] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:42:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:42:48.773749 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f18408-6b5b-4ef2-a664-c86d77aaad24 service cinder] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:48.827634 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:48.839892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f18408-6b5b-4ef2-a664-c86d77aaad24 service cinder] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:48.844462 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec2b69-7164-4241-a300-d5221eae677c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:48.845079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec2b69-7164-4241-a300-d5221eae677c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:48.845351 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec2b69-7164-4241-a300-d5221eae677c admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:48.845618 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec2b69-7164-4241-a300-d5221eae677c admin admin] PATH_INFO: `/v3/users/731037adff9b4e48960a41ee188c03f6` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:48.846729 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec2b69-7164-4241-a300-d5221eae677c admin admin] RBAC: Authorizing `identity:delete_user(user_id=731037adff9b4e48960a41ee188c03f6)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:48.848746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec2b69-7164-4241-a300-d5221eae677c admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:49.027887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e65a8-cf04-45a3-8c0b-72b850843137 service cinder] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:49.037604 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e65a8-cf04-45a3-8c0b-72b850843137 service cinder] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:49.041941 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64da084-b5a8-4843-9a76-20748d668c7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:49.042685 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64da084-b5a8-4843-9a76-20748d668c7b service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:49.042998 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64da084-b5a8-4843-9a76-20748d668c7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:49.043268 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64da084-b5a8-4843-9a76-20748d668c7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:49.045876 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-f64da084-b5a8-4843-9a76-20748d668c7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:49.057890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-68ec2b69-7164-4241-a300-d5221eae677c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '731037adff9b4e48960a41ee188c03f6'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:49.058629 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-68ec2b69-7164-4241-a300-d5221eae677c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '731037adff9b4e48960a41ee188c03f6'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:49.092086 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:49.121686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64da084-b5a8-4843-9a76-20748d668c7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:49.121976 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-68ec2b69-7164-4241-a300-d5221eae677c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '731037adff9b4e48960a41ee188c03f6'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:49.123663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64da084-b5a8-4843-9a76-20748d668c7b service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:49.130192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-68ec2b69-7164-4241-a300-d5221eae677c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '731037adff9b4e48960a41ee188c03f6'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:49.130954 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-68ec2b69-7164-4241-a300-d5221eae677c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '731037adff9b4e48960a41ee188c03f6'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:49.135924 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1217/2434] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:42:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:42:49.151425 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1218/2435] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:42:48 2022] DELETE /identity/v3/users/731037adff9b4e48960a41ee188c03f6 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:49.155921 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a2768-ffdc-41d7-8c14-d143ed307a3d None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:49.156213 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a2768-ffdc-41d7-8c14-d143ed307a3d None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:49.156490 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a2768-ffdc-41d7-8c14-d143ed307a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:49.178255 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-693a2768-ffdc-41d7-8c14-d143ed307a3d None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:49.178720 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-693a2768-ffdc-41d7-8c14-d143ed307a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:49.255609 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1218/2436] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:49.265867 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec2b69-7164-4241-a300-d5221eae677c admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:49.267410 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-68ec2b69-7164-4241-a300-d5221eae677c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:49.325140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec2b69-7164-4241-a300-d5221eae677c admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:49.328951 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05f52a-b4d6-4a11-b3f5-e930d5982b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:49.329545 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05f52a-b4d6-4a11-b3f5-e930d5982b89 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:49.329818 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05f52a-b4d6-4a11-b3f5-e930d5982b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:49.330084 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05f52a-b4d6-4a11-b3f5-e930d5982b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:49.339614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05f52a-b4d6-4a11-b3f5-e930d5982b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:49.341032 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05f52a-b4d6-4a11-b3f5-e930d5982b89 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:49.350182 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1219/2437] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:42:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:42:49.842023 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a2768-ffdc-41d7-8c14-d143ed307a3d None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:49.847395 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-693a2768-ffdc-41d7-8c14-d143ed307a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:49.861978 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a2768-ffdc-41d7-8c14-d143ed307a3d None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:49.868798 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631d791-a12f-426d-bd64-5a549df2bd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:49.869686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631d791-a12f-426d-bd64-5a549df2bd74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:49.869782 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631d791-a12f-426d-bd64-5a549df2bd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:49.870053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631d791-a12f-426d-bd64-5a549df2bd74 admin admin] PATH_INFO: `/v3/projects/3a68442cd6284875871f0e5469ecc7e4` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:49.871254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631d791-a12f-426d-bd64-5a549df2bd74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a68442cd6284875871f0e5469ecc7e4)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:49.873209 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631d791-a12f-426d-bd64-5a549df2bd74 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:50.019020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0631d791-a12f-426d-bd64-5a549df2bd74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a68442cd6284875871f0e5469ecc7e4', 'request_id': 'req-0631d791-a12f-426d-bd64-5a549df2bd74'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:50.024681 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0631d791-a12f-426d-bd64-5a549df2bd74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a68442cd6284875871f0e5469ecc7e4', 'request_id': 'req-0631d791-a12f-426d-bd64-5a549df2bd74'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:50.095072 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0631d791-a12f-426d-bd64-5a549df2bd74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a68442cd6284875871f0e5469ecc7e4', 'request_id': 'req-0631d791-a12f-426d-bd64-5a549df2bd74'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:50.107809 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0631d791-a12f-426d-bd64-5a549df2bd74 admin admin] The token cache is being invalidate because project 3a68442cd6284875871f0e5469ecc7e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:42:50.108104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0631d791-a12f-426d-bd64-5a549df2bd74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:50.108742 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-0631d791-a12f-426d-bd64-5a549df2bd74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:50.110285 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1219/2438] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:42:49 2022] DELETE /identity/v3/projects/3a68442cd6284875871f0e5469ecc7e4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:50.114305 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05f52a-b4d6-4a11-b3f5-e930d5982b89 service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:50.124964 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05f52a-b4d6-4a11-b3f5-e930d5982b89 service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:50.181117 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f7414-7d2e-4adf-ab36-2e6aae759749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:50.181786 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f7414-7d2e-4adf-ab36-2e6aae759749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:50.182087 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f7414-7d2e-4adf-ab36-2e6aae759749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:50.182381 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f7414-7d2e-4adf-ab36-2e6aae759749 admin admin] PATH_INFO: `/v3/users/d927f4e9b1394d9a8dd146413c9b8050` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:50.183635 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f7414-7d2e-4adf-ab36-2e6aae759749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d927f4e9b1394d9a8dd146413c9b8050)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:50.186312 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f7414-7d2e-4adf-ab36-2e6aae759749 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:50.199929 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:50.362628 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-e24f7414-7d2e-4adf-ab36-2e6aae759749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd927f4e9b1394d9a8dd146413c9b8050'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:50.363305 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-e24f7414-7d2e-4adf-ab36-2e6aae759749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd927f4e9b1394d9a8dd146413c9b8050'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:50.421178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-e24f7414-7d2e-4adf-ab36-2e6aae759749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd927f4e9b1394d9a8dd146413c9b8050'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:50.429992 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-e24f7414-7d2e-4adf-ab36-2e6aae759749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd927f4e9b1394d9a8dd146413c9b8050'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:50.431362 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-e24f7414-7d2e-4adf-ab36-2e6aae759749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd927f4e9b1394d9a8dd146413c9b8050'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:50.450389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1220/2439] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:42:50 2022] DELETE /identity/v3/users/d927f4e9b1394d9a8dd146413c9b8050 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:50.878770 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631d791-a12f-426d-bd64-5a549df2bd74 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:50.880663 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-0631d791-a12f-426d-bd64-5a549df2bd74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:50.902318 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631d791-a12f-426d-bd64-5a549df2bd74 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:50.958885 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:50.970836 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500bec0-7a4e-42c1-9f94-120dd02db953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:50.971468 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500bec0-7a4e-42c1-9f94-120dd02db953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:50.971742 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500bec0-7a4e-42c1-9f94-120dd02db953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:50.972012 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500bec0-7a4e-42c1-9f94-120dd02db953 admin admin] PATH_INFO: `/v3/projects/f2080cee39c24e66a74505392980d93b` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:50.973788 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500bec0-7a4e-42c1-9f94-120dd02db953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2080cee39c24e66a74505392980d93b)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:50.976571 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500bec0-7a4e-42c1-9f94-120dd02db953 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:51.085820 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f7414-7d2e-4adf-ab36-2e6aae759749 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:51.087508 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-e24f7414-7d2e-4adf-ab36-2e6aae759749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:51.148922 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-3500bec0-7a4e-42c1-9f94-120dd02db953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2080cee39c24e66a74505392980d93b', 'request_id': 'req-3500bec0-7a4e-42c1-9f94-120dd02db953'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:51.151698 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f7414-7d2e-4adf-ab36-2e6aae759749 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:51.155455 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-3500bec0-7a4e-42c1-9f94-120dd02db953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2080cee39c24e66a74505392980d93b', 'request_id': 'req-3500bec0-7a4e-42c1-9f94-120dd02db953'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:51.204229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b9528-e888-40fb-b6f6-9a052ab6983a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:51.204801 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b9528-e888-40fb-b6f6-9a052ab6983a service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:51.205076 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b9528-e888-40fb-b6f6-9a052ab6983a service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:51.205344 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b9528-e888-40fb-b6f6-9a052ab6983a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:51.207531 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-948b9528-e888-40fb-b6f6-9a052ab6983a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:51.271308 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-3500bec0-7a4e-42c1-9f94-120dd02db953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2080cee39c24e66a74505392980d93b', 'request_id': 'req-3500bec0-7a4e-42c1-9f94-120dd02db953'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:51.275546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:51.283861 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-3500bec0-7a4e-42c1-9f94-120dd02db953 admin admin] The token cache is being invalidate because project f2080cee39c24e66a74505392980d93b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:42:51.284154 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-3500bec0-7a4e-42c1-9f94-120dd02db953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:51.284791 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-3500bec0-7a4e-42c1-9f94-120dd02db953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:51.286286 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1220/2440] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:42:50 2022] DELETE /identity/v3/projects/f2080cee39c24e66a74505392980d93b => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:42:51.290230 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500bec0-7a4e-42c1-9f94-120dd02db953 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:51.291641 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-3500bec0-7a4e-42c1-9f94-120dd02db953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:51.293609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b9528-e888-40fb-b6f6-9a052ab6983a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:51.295147 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b9528-e888-40fb-b6f6-9a052ab6983a service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:51.309715 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1221/2441] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:42:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:42:51.369938 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500bec0-7a4e-42c1-9f94-120dd02db953 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:51.375594 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca7ba3-42ef-4e72-910d-3644dedbb283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:51.375976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca7ba3-42ef-4e72-910d-3644dedbb283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:51.376257 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca7ba3-42ef-4e72-910d-3644dedbb283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:51.376531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca7ba3-42ef-4e72-910d-3644dedbb283 admin admin] PATH_INFO: `/v3/users/9dcb7474779a4a43b0c523e660157b0d` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:51.377702 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca7ba3-42ef-4e72-910d-3644dedbb283 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dcb7474779a4a43b0c523e660157b0d)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:51.379698 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca7ba3-42ef-4e72-910d-3644dedbb283 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:51.621278 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d2ca7ba3-42ef-4e72-910d-3644dedbb283 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dcb7474779a4a43b0c523e660157b0d'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:51.621953 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d2ca7ba3-42ef-4e72-910d-3644dedbb283 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dcb7474779a4a43b0c523e660157b0d'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:51.747395 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d2ca7ba3-42ef-4e72-910d-3644dedbb283 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dcb7474779a4a43b0c523e660157b0d'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:51.761457 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d2ca7ba3-42ef-4e72-910d-3644dedbb283 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dcb7474779a4a43b0c523e660157b0d'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:51.762240 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-d2ca7ba3-42ef-4e72-910d-3644dedbb283 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dcb7474779a4a43b0c523e660157b0d'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:51.775960 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1221/2442] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:42:51 2022] DELETE /identity/v3/users/9dcb7474779a4a43b0c523e660157b0d => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:42:52.236605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b9528-e888-40fb-b6f6-9a052ab6983a service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:52.237988 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-948b9528-e888-40fb-b6f6-9a052ab6983a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:52.265380 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b9528-e888-40fb-b6f6-9a052ab6983a service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:52.327863 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f256b0e-b3c7-4cf2-9b7e-1c8aa1839c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:52.328507 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f256b0e-b3c7-4cf2-9b7e-1c8aa1839c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:52.328791 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f256b0e-b3c7-4cf2-9b7e-1c8aa1839c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:52.329062 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f256b0e-b3c7-4cf2-9b7e-1c8aa1839c63 admin admin] PATH_INFO: `/v3/projects/98ff61df12014618875363ca777669d1` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:52.330234 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f256b0e-b3c7-4cf2-9b7e-1c8aa1839c63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98ff61df12014618875363ca777669d1)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:52.332262 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f256b0e-b3c7-4cf2-9b7e-1c8aa1839c63 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:52.473614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-4f256b0e-b3c7-4cf2-9b7e-1c8aa1839c63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98ff61df12014618875363ca777669d1', 'request_id': 'req-4f256b0e-b3c7-4cf2-9b7e-1c8aa1839c63'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:52.481328 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-4f256b0e-b3c7-4cf2-9b7e-1c8aa1839c63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98ff61df12014618875363ca777669d1', 'request_id': 'req-4f256b0e-b3c7-4cf2-9b7e-1c8aa1839c63'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:52.488372 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-4f256b0e-b3c7-4cf2-9b7e-1c8aa1839c63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98ff61df12014618875363ca777669d1', 'request_id': 'req-4f256b0e-b3c7-4cf2-9b7e-1c8aa1839c63'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:52.565498 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-4f256b0e-b3c7-4cf2-9b7e-1c8aa1839c63 admin admin] The token cache is being invalidate because project 98ff61df12014618875363ca777669d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:42:52.565799 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-4f256b0e-b3c7-4cf2-9b7e-1c8aa1839c63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:52.568744 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-4f256b0e-b3c7-4cf2-9b7e-1c8aa1839c63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:52.574050 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1222/2443] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:42:52 2022] DELETE /identity/v3/projects/98ff61df12014618875363ca777669d1 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:52.578064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5afd1-7945-4ab6-b4c5-7d96379a47d0 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:52.578525 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5afd1-7945-4ab6-b4c5-7d96379a47d0 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:52.578611 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5afd1-7945-4ab6-b4c5-7d96379a47d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:52.591591 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:52.605973 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-13b5afd1-7945-4ab6-b4c5-7d96379a47d0 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:52.607276 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-13b5afd1-7945-4ab6-b4c5-7d96379a47d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:52.686984 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1222/2444] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:42:52.692233 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e630d1-2cbd-41fe-bcd2-07648b4f6b38 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:52.692543 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e630d1-2cbd-41fe-bcd2-07648b4f6b38 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:52.692821 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e630d1-2cbd-41fe-bcd2-07648b4f6b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:52.718585 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-18e630d1-2cbd-41fe-bcd2-07648b4f6b38 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:52.719841 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-18e630d1-2cbd-41fe-bcd2-07648b4f6b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:52.729155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1223/2445] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:52.733205 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5afd1-7945-4ab6-b4c5-7d96379a47d0 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:52.743719 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5afd1-7945-4ab6-b4c5-7d96379a47d0 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:52.753180 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74535827-e9a0-4e99-93d7-47828770c565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:52.757270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74535827-e9a0-4e99-93d7-47828770c565 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:52.757270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74535827-e9a0-4e99-93d7-47828770c565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:52.757270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74535827-e9a0-4e99-93d7-47828770c565 admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:52.757270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74535827-e9a0-4e99-93d7-47828770c565 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:42:52.757270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74535827-e9a0-4e99-93d7-47828770c565 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:52.757270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74535827-e9a0-4e99-93d7-47828770c565 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:52.774171 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1223/2446] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:42:52.775715 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e630d1-2cbd-41fe-bcd2-07648b4f6b38 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:52.785508 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e630d1-2cbd-41fe-bcd2-07648b4f6b38 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:52.791702 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151e4aa-66ee-4021-ac19-459644d3d2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:52.797565 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151e4aa-66ee-4021-ac19-459644d3d2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:52.797565 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151e4aa-66ee-4021-ac19-459644d3d2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:52.797565 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151e4aa-66ee-4021-ac19-459644d3d2f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:52.797565 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151e4aa-66ee-4021-ac19-459644d3d2f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:52.797565 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151e4aa-66ee-4021-ac19-459644d3d2f6 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:52.981072 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1224/2447] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:42:52 2022] POST /identity/v3/projects => generated 379 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:42:52.982298 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74535827-e9a0-4e99-93d7-47828770c565 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:52.992491 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74535827-e9a0-4e99-93d7-47828770c565 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:53.053808 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a59aba-a0f0-485c-87cb-7f0a88443a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:53.054441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a59aba-a0f0-485c-87cb-7f0a88443a98 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:53.054758 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a59aba-a0f0-485c-87cb-7f0a88443a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:53.055110 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a59aba-a0f0-485c-87cb-7f0a88443a98 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:53.056416 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a59aba-a0f0-485c-87cb-7f0a88443a98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:53.058722 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a59aba-a0f0-485c-87cb-7f0a88443a98 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:53.348041 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1224/2448] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:42:52 2022] POST /identity/v3/users => generated 290 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:42:53.351973 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151e4aa-66ee-4021-ac19-459644d3d2f6 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:53.365161 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151e4aa-66ee-4021-ac19-459644d3d2f6 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:53.371105 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199377d-4575-4bbb-9655-646cb1fbcca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:53.371768 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199377d-4575-4bbb-9655-646cb1fbcca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:53.372298 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199377d-4575-4bbb-9655-646cb1fbcca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:53.372567 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199377d-4575-4bbb-9655-646cb1fbcca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:53.373211 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199377d-4575-4bbb-9655-646cb1fbcca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:53.375024 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199377d-4575-4bbb-9655-646cb1fbcca9 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:53.389348 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1225/2449] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:42:53.391168 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a59aba-a0f0-485c-87cb-7f0a88443a98 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:53.401868 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a59aba-a0f0-485c-87cb-7f0a88443a98 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:53.407980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bbf21-59a5-4132-908d-bc81ebba23a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:53.408582 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bbf21-59a5-4132-908d-bc81ebba23a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:53.408857 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bbf21-59a5-4132-908d-bc81ebba23a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:53.409126 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bbf21-59a5-4132-908d-bc81ebba23a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:53.409780 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1bbf21-59a5-4132-908d-bc81ebba23a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:53.411444 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1bbf21-59a5-4132-908d-bc81ebba23a3 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:53.425205 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1225/2450] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:53.430152 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199377d-4575-4bbb-9655-646cb1fbcca9 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:53.441574 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199377d-4575-4bbb-9655-646cb1fbcca9 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:53.447666 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201e27f-5177-4f66-97e2-9b9f3c3452d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:53.448616 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201e27f-5177-4f66-97e2-9b9f3c3452d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:53.448890 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201e27f-5177-4f66-97e2-9b9f3c3452d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:53.449154 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201e27f-5177-4f66-97e2-9b9f3c3452d5 admin admin] PATH_INFO: `/v3/projects/a05b52e4cae743aa8c30e91f24963e80/users/6c1f58774690401f9753d77dd1a94507/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:53.466395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201e27f-5177-4f66-97e2-9b9f3c3452d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a05b52e4cae743aa8c30e91f24963e80, user_id=6c1f58774690401f9753d77dd1a94507, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:53.469446 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201e27f-5177-4f66-97e2-9b9f3c3452d5 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:53.548471 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1226/2451] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:42:53 2022] PUT /identity/v3/projects/a05b52e4cae743aa8c30e91f24963e80/users/6c1f58774690401f9753d77dd1a94507/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:53.561764 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28597328-3448-480d-856a-24621117c186 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:53.562039 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28597328-3448-480d-856a-24621117c186 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:53.562309 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28597328-3448-480d-856a-24621117c186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:53.593105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-28597328-3448-480d-856a-24621117c186 None None] MFA Rules not processed for user `6c1f58774690401f9753d77dd1a94507`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:53.594271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-28597328-3448-480d-856a-24621117c186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:53.679162 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:53.686141 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1226/2452] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:53.690733 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201e27f-5177-4f66-97e2-9b9f3c3452d5 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:53.711379 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:53.763978 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201e27f-5177-4f66-97e2-9b9f3c3452d5 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:53.768678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774e8e8-1972-4b3a-be06-e55908a06b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:53.769282 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774e8e8-1972-4b3a-be06-e55908a06b0f admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:53.769557 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774e8e8-1972-4b3a-be06-e55908a06b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:53.769824 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774e8e8-1972-4b3a-be06-e55908a06b0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:53.770451 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774e8e8-1972-4b3a-be06-e55908a06b0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:53.772494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774e8e8-1972-4b3a-be06-e55908a06b0f admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:53.866876 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1227/2453] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:42:53 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:42:53.871882 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28597328-3448-480d-856a-24621117c186 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:53.883281 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28597328-3448-480d-856a-24621117c186 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:53.941960 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582f3f4-d3c2-4459-b8ac-b8492e35ed5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:53.942570 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582f3f4-d3c2-4459-b8ac-b8492e35ed5b admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:53.942884 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582f3f4-d3c2-4459-b8ac-b8492e35ed5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:53.943158 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582f3f4-d3c2-4459-b8ac-b8492e35ed5b admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:53.943784 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6582f3f4-d3c2-4459-b8ac-b8492e35ed5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:53.945796 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6582f3f4-d3c2-4459-b8ac-b8492e35ed5b admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:54.039365 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1227/2454] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:42:53 2022] POST /identity/v3/users => generated 296 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:42:54.043711 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774e8e8-1972-4b3a-be06-e55908a06b0f admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:54.054458 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774e8e8-1972-4b3a-be06-e55908a06b0f admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:54.059784 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5cce7-b881-4e17-9c46-6ef105ffece3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:54.060380 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5cce7-b881-4e17-9c46-6ef105ffece3 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:54.060655 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5cce7-b881-4e17-9c46-6ef105ffece3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:54.060926 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5cce7-b881-4e17-9c46-6ef105ffece3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:54.061568 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5cce7-b881-4e17-9c46-6ef105ffece3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:54.063251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5cce7-b881-4e17-9c46-6ef105ffece3 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:54.073734 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1228/2455] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:54.078642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582f3f4-d3c2-4459-b8ac-b8492e35ed5b admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:54.091031 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582f3f4-d3c2-4459-b8ac-b8492e35ed5b admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:54.095562 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d29b4-e86d-43d0-b654-2366fa534407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:54.096195 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d29b4-e86d-43d0-b654-2366fa534407 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:54.096567 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d29b4-e86d-43d0-b654-2366fa534407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:54.096826 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d29b4-e86d-43d0-b654-2366fa534407 admin admin] PATH_INFO: `/v3/projects/3a1d89dc0cce4c339724ceb5d783eede/users/c9eede637ddf4528af1c668302659740/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:54.113881 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d29b4-e86d-43d0-b654-2366fa534407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a1d89dc0cce4c339724ceb5d783eede, user_id=c9eede637ddf4528af1c668302659740, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:54.116555 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d29b4-e86d-43d0-b654-2366fa534407 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:54.193449 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1228/2456] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:42:54 2022] PUT /identity/v3/projects/3a1d89dc0cce4c339724ceb5d783eede/users/c9eede637ddf4528af1c668302659740/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:54.197815 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5cce7-b881-4e17-9c46-6ef105ffece3 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:54.208532 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5cce7-b881-4e17-9c46-6ef105ffece3 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:54.268290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad741d-074d-4626-9502-bec0a589417c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:54.268905 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad741d-074d-4626-9502-bec0a589417c admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:54.269180 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad741d-074d-4626-9502-bec0a589417c admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:54.269453 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad741d-074d-4626-9502-bec0a589417c admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:54.270094 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad741d-074d-4626-9502-bec0a589417c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:54.271724 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad741d-074d-4626-9502-bec0a589417c admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:54.281933 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1229/2457] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:42:54.286194 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d29b4-e86d-43d0-b654-2366fa534407 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:54.297506 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d29b4-e86d-43d0-b654-2366fa534407 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:54.302529 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d94610-d4d7-4625-9a04-bd0a080c36f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:54.303206 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d94610-d4d7-4625-9a04-bd0a080c36f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:54.303482 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d94610-d4d7-4625-9a04-bd0a080c36f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:54.303757 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d94610-d4d7-4625-9a04-bd0a080c36f7 admin admin] PATH_INFO: `/v3/projects/3a1d89dc0cce4c339724ceb5d783eede/users/c9eede637ddf4528af1c668302659740/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:54.305814 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d94610-d4d7-4625-9a04-bd0a080c36f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a1d89dc0cce4c339724ceb5d783eede, user_id=c9eede637ddf4528af1c668302659740, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:54.308568 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d94610-d4d7-4625-9a04-bd0a080c36f7 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:54.318763 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1229/2458] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:42:54 2022] PUT /identity/v3/projects/3a1d89dc0cce4c339724ceb5d783eede/users/c9eede637ddf4528af1c668302659740/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:54.329372 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fe21c-86d9-42e5-86ca-c4706591c38d None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:54.329660 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fe21c-86d9-42e5-86ca-c4706591c38d None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:54.335305 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fe21c-86d9-42e5-86ca-c4706591c38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:54.358717 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-0c6fe21c-86d9-42e5-86ca-c4706591c38d None None] MFA Rules not processed for user `c9eede637ddf4528af1c668302659740`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:54.359945 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-0c6fe21c-86d9-42e5-86ca-c4706591c38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:54.431864 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1230/2459] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:54 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:54.442667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d94610-d4d7-4625-9a04-bd0a080c36f7 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:54.444435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-84d94610-d4d7-4625-9a04-bd0a080c36f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:54.502506 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d94610-d4d7-4625-9a04-bd0a080c36f7 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:54.506157 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816458ac-2e16-4cbd-8de8-9048785c2a7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:54.506752 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816458ac-2e16-4cbd-8de8-9048785c2a7d service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:54.507058 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816458ac-2e16-4cbd-8de8-9048785c2a7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:54.507334 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816458ac-2e16-4cbd-8de8-9048785c2a7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:54.516678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816458ac-2e16-4cbd-8de8-9048785c2a7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:54.518103 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816458ac-2e16-4cbd-8de8-9048785c2a7d service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:54.528388 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1230/2460] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:42:54 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:42:55.082900 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fe21c-86d9-42e5-86ca-c4706591c38d None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:55.095953 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:55.146412 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fe21c-86d9-42e5-86ca-c4706591c38d None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:55.151291 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5257fe-0b2c-4bfb-a8c8-5b873c08077c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:55.151923 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5257fe-0b2c-4bfb-a8c8-5b873c08077c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:55.152201 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5257fe-0b2c-4bfb-a8c8-5b873c08077c admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:55.152505 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5257fe-0b2c-4bfb-a8c8-5b873c08077c admin admin] PATH_INFO: `/v3/users/6c1f58774690401f9753d77dd1a94507` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:55.153632 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5257fe-0b2c-4bfb-a8c8-5b873c08077c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c1f58774690401f9753d77dd1a94507)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:55.155615 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5257fe-0b2c-4bfb-a8c8-5b873c08077c admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:55.335720 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-4a5257fe-0b2c-4bfb-a8c8-5b873c08077c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c1f58774690401f9753d77dd1a94507'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:55.336448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-4a5257fe-0b2c-4bfb-a8c8-5b873c08077c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c1f58774690401f9753d77dd1a94507'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:55.416798 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-4a5257fe-0b2c-4bfb-a8c8-5b873c08077c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c1f58774690401f9753d77dd1a94507'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:55.426334 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-4a5257fe-0b2c-4bfb-a8c8-5b873c08077c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c1f58774690401f9753d77dd1a94507'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:55.427037 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-4a5257fe-0b2c-4bfb-a8c8-5b873c08077c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c1f58774690401f9753d77dd1a94507'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:55.446451 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1231/2461] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:42:55 2022] DELETE /identity/v3/users/6c1f58774690401f9753d77dd1a94507 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:55.451782 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4201e-ed78-4cf8-a394-fe1d2d939b6b None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:55.452321 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4201e-ed78-4cf8-a394-fe1d2d939b6b None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:55.452506 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4201e-ed78-4cf8-a394-fe1d2d939b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:55.473071 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-97f4201e-ed78-4cf8-a394-fe1d2d939b6b None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:42:55.474299 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-97f4201e-ed78-4cf8-a394-fe1d2d939b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:55.523921 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:55.537521 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1231/2462] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:42:55.548702 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5257fe-0b2c-4bfb-a8c8-5b873c08077c admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:55.550122 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-4a5257fe-0b2c-4bfb-a8c8-5b873c08077c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:55.610070 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5257fe-0b2c-4bfb-a8c8-5b873c08077c admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:55.613838 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8efea-4df1-48b0-9cd4-4a3f182c98f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:55.614497 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8efea-4df1-48b0-9cd4-4a3f182c98f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:55.614795 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8efea-4df1-48b0-9cd4-4a3f182c98f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:55.615092 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8efea-4df1-48b0-9cd4-4a3f182c98f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:55.624824 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8efea-4df1-48b0-9cd4-4a3f182c98f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:55.626251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8efea-4df1-48b0-9cd4-4a3f182c98f7 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:55.636015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1232/2463] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:42:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:42:56.148943 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4201e-ed78-4cf8-a394-fe1d2d939b6b None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:56.150507 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-97f4201e-ed78-4cf8-a394-fe1d2d939b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:56.162775 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4201e-ed78-4cf8-a394-fe1d2d939b6b None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:56.168210 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d3697-97bf-4588-b041-bd7dd9033c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:56.168854 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d3697-97bf-4588-b041-bd7dd9033c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:56.169130 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d3697-97bf-4588-b041-bd7dd9033c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:56.169420 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d3697-97bf-4588-b041-bd7dd9033c3d admin admin] PATH_INFO: `/v3/projects/a05b52e4cae743aa8c30e91f24963e80` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:56.170551 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d3697-97bf-4588-b041-bd7dd9033c3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a05b52e4cae743aa8c30e91f24963e80)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:56.172526 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d3697-97bf-4588-b041-bd7dd9033c3d admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:56.302043 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e82d3697-97bf-4588-b041-bd7dd9033c3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a05b52e4cae743aa8c30e91f24963e80', 'request_id': 'req-e82d3697-97bf-4588-b041-bd7dd9033c3d'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:56.308624 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e82d3697-97bf-4588-b041-bd7dd9033c3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a05b52e4cae743aa8c30e91f24963e80', 'request_id': 'req-e82d3697-97bf-4588-b041-bd7dd9033c3d'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:56.413738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e82d3697-97bf-4588-b041-bd7dd9033c3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a05b52e4cae743aa8c30e91f24963e80', 'request_id': 'req-e82d3697-97bf-4588-b041-bd7dd9033c3d'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:56.426690 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e82d3697-97bf-4588-b041-bd7dd9033c3d admin admin] The token cache is being invalidate because project a05b52e4cae743aa8c30e91f24963e80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:42:56.427010 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e82d3697-97bf-4588-b041-bd7dd9033c3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:56.427667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-e82d3697-97bf-4588-b041-bd7dd9033c3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:56.429145 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1232/2464] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:42:56 2022] DELETE /identity/v3/projects/a05b52e4cae743aa8c30e91f24963e80 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:56.434580 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8efea-4df1-48b0-9cd4-4a3f182c98f7 service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:56.444958 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8efea-4df1-48b0-9cd4-4a3f182c98f7 service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:56.479699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:42:56.508721 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bba72-22d7-4e90-a717-5eeca8c5b7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:56.513842 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bba72-22d7-4e90-a717-5eeca8c5b7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:56.513842 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bba72-22d7-4e90-a717-5eeca8c5b7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:56.513842 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bba72-22d7-4e90-a717-5eeca8c5b7bc admin admin] PATH_INFO: `/v3/users/c9eede637ddf4528af1c668302659740` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:56.513842 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bba72-22d7-4e90-a717-5eeca8c5b7bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9eede637ddf4528af1c668302659740)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:56.513842 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bba72-22d7-4e90-a717-5eeca8c5b7bc admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:57.142784 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a25bba72-22d7-4e90-a717-5eeca8c5b7bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9eede637ddf4528af1c668302659740'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:57.143494 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a25bba72-22d7-4e90-a717-5eeca8c5b7bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9eede637ddf4528af1c668302659740'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:57.237971 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a25bba72-22d7-4e90-a717-5eeca8c5b7bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9eede637ddf4528af1c668302659740'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:57.245874 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a25bba72-22d7-4e90-a717-5eeca8c5b7bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9eede637ddf4528af1c668302659740'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:57.246527 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-a25bba72-22d7-4e90-a717-5eeca8c5b7bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9eede637ddf4528af1c668302659740'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:57.266936 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1233/2465] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:42:56 2022] DELETE /identity/v3/users/c9eede637ddf4528af1c668302659740 => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:42:57.714258 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d3697-97bf-4588-b041-bd7dd9033c3d admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:42:57.715925 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-e82d3697-97bf-4588-b041-bd7dd9033c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:42:57.730143 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d3697-97bf-4588-b041-bd7dd9033c3d admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:42:57.786598 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68fb24-a89d-45db-8c9f-3e01b904a875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:42:57.787264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68fb24-a89d-45db-8c9f-3e01b904a875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:42:57.787547 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68fb24-a89d-45db-8c9f-3e01b904a875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:42:57.787824 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68fb24-a89d-45db-8c9f-3e01b904a875 admin admin] PATH_INFO: `/v3/projects/3a1d89dc0cce4c339724ceb5d783eede` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:42:57.788972 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68fb24-a89d-45db-8c9f-3e01b904a875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a1d89dc0cce4c339724ceb5d783eede)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:42:57.791020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68fb24-a89d-45db-8c9f-3e01b904a875 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:42:57.968361 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-1c68fb24-a89d-45db-8c9f-3e01b904a875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a1d89dc0cce4c339724ceb5d783eede', 'request_id': 'req-1c68fb24-a89d-45db-8c9f-3e01b904a875'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:57.980591 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-1c68fb24-a89d-45db-8c9f-3e01b904a875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a1d89dc0cce4c339724ceb5d783eede', 'request_id': 'req-1c68fb24-a89d-45db-8c9f-3e01b904a875'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:58.073620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-1c68fb24-a89d-45db-8c9f-3e01b904a875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a1d89dc0cce4c339724ceb5d783eede', 'request_id': 'req-1c68fb24-a89d-45db-8c9f-3e01b904a875'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:58.086796 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-1c68fb24-a89d-45db-8c9f-3e01b904a875 admin admin] The token cache is being invalidate because project 3a1d89dc0cce4c339724ceb5d783eede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:42:58.087114 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-1c68fb24-a89d-45db-8c9f-3e01b904a875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:58.087847 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-1c68fb24-a89d-45db-8c9f-3e01b904a875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:42:58.089379 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1233/2466] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:42:57 2022] DELETE /identity/v3/projects/3a1d89dc0cce4c339724ceb5d783eede => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:43:07.102623 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21dba4-66f4-4c59-b01c-88c8e4978e1c None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:43:07.103205 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21dba4-66f4-4c59-b01c-88c8e4978e1c None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:43:07.103205 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21dba4-66f4-4c59-b01c-88c8e4978e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:43:07.123056 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-bb21dba4-66f4-4c59-b01c-88c8e4978e1c None None] MFA Rules not processed for user `0e81138fb66c448cb56375eacd407a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:43:07.129287 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-bb21dba4-66f4-4c59-b01c-88c8e4978e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:43:07.179814 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1234/2467] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:43:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:43:08.083511 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:43:12.193440 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68fb24-a89d-45db-8c9f-3e01b904a875 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:43:12.195077 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-1c68fb24-a89d-45db-8c9f-3e01b904a875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:43:12.279371 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68fb24-a89d-45db-8c9f-3e01b904a875 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:43:12.284881 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31279f49-9665-4c6b-8468-e1a2e25557ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:43:12.285492 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31279f49-9665-4c6b-8468-e1a2e25557ad service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:43:12.285846 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31279f49-9665-4c6b-8468-e1a2e25557ad service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:43:12.286135 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31279f49-9665-4c6b-8468-e1a2e25557ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:43:12.288033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-31279f49-9665-4c6b-8468-e1a2e25557ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:43:12.301355 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31279f49-9665-4c6b-8468-e1a2e25557ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:43:12.303041 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31279f49-9665-4c6b-8468-e1a2e25557ad service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:43:12.315313 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1234/2468] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:43:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:43:17.173199 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=63,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:43:22.310527 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=34 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:43:22.433084 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21dba4-66f4-4c59-b01c-88c8e4978e1c None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:43:22.434717 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-bb21dba4-66f4-4c59-b01c-88c8e4978e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:43:22.492993 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21dba4-66f4-4c59-b01c-88c8e4978e1c None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:43:22.497135 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814e975-aa86-4c39-b9ce-c167b78cdf24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:43:22.497738 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814e975-aa86-4c39-b9ce-c167b78cdf24 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:43:22.498013 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814e975-aa86-4c39-b9ce-c167b78cdf24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:43:22.498283 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814e975-aa86-4c39-b9ce-c167b78cdf24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:43:22.500025 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-c814e975-aa86-4c39-b9ce-c167b78cdf24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:43:22.509888 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814e975-aa86-4c39-b9ce-c167b78cdf24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:43:22.514078 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814e975-aa86-4c39-b9ce-c167b78cdf24 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:43:22.519995 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1235/2469] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:43:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:43:32.516436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=26 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:44:37.448004 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31279f49-9665-4c6b-8468-e1a2e25557ad service nova] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:44:37.459828 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31279f49-9665-4c6b-8468-e1a2e25557ad service nova] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:44:37.465411 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c13362-eb10-40a9-a318-0573f0423426 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:44:37.465942 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c13362-eb10-40a9-a318-0573f0423426 service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:44:37.466219 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c13362-eb10-40a9-a318-0573f0423426 service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:44:37.466492 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c13362-eb10-40a9-a318-0573f0423426 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:44:37.468365 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-80c13362-eb10-40a9-a318-0573f0423426 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:44:37.478711 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c13362-eb10-40a9-a318-0573f0423426 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:44:37.480284 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c13362-eb10-40a9-a318-0573f0423426 service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:44:37.489878 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1235/2470] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:44:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:44:47.485797 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=6 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:44:53.443393 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54b909-f96e-4e22-88a7-19cf18e2a61e None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:44:53.443977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54b909-f96e-4e22-88a7-19cf18e2a61e None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:44:53.443977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54b909-f96e-4e22-88a7-19cf18e2a61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:44:53.464551 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-ce54b909-f96e-4e22-88a7-19cf18e2a61e None None] MFA Rules not processed for user `0e81138fb66c448cb56375eacd407a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:44:53.465754 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ce54b909-f96e-4e22-88a7-19cf18e2a61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:44:53.474477 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1236/2471] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:44:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:44:53.789585 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c13362-eb10-40a9-a318-0573f0423426 service nova] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:44:53.798796 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c13362-eb10-40a9-a318-0573f0423426 service nova] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:44:53.802613 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e11ce4-cabd-4c54-aa95-c4c14fadbe16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:44:53.803240 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e11ce4-cabd-4c54-aa95-c4c14fadbe16 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:44:53.806136 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e11ce4-cabd-4c54-aa95-c4c14fadbe16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:44:53.806136 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e11ce4-cabd-4c54-aa95-c4c14fadbe16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:44:53.806136 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-00e11ce4-cabd-4c54-aa95-c4c14fadbe16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:44:53.814981 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e11ce4-cabd-4c54-aa95-c4c14fadbe16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:44:53.817121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e11ce4-cabd-4c54-aa95-c4c14fadbe16 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:44:53.825204 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1236/2472] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:44:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:44:54.250707 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54b909-f96e-4e22-88a7-19cf18e2a61e None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:44:54.252112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-ce54b909-f96e-4e22-88a7-19cf18e2a61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:44:54.323407 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54b909-f96e-4e22-88a7-19cf18e2a61e None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:44:54.328583 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abffcb-069a-45a3-96b2-dc2b37a8ac45 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66b9bc695b44877a06f17ea6bbeb27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:44:54.329183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abffcb-069a-45a3-96b2-dc2b37a8ac45 service placement] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:44:54.329460 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abffcb-069a-45a3-96b2-dc2b37a8ac45 service placement] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:44:54.329729 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abffcb-069a-45a3-96b2-dc2b37a8ac45 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:44:54.331609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-e8abffcb-069a-45a3-96b2-dc2b37a8ac45 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:44:54.343435 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abffcb-069a-45a3-96b2-dc2b37a8ac45 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:44:54.345020 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abffcb-069a-45a3-96b2-dc2b37a8ac45 service placement] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:44:54.355731 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1237/2473] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:44:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:45:03.821500 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=6 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:45:04.351430 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=35 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:45:05.000375 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e11ce4-cabd-4c54-aa95-c4c14fadbe16 service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:45:05.014576 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e11ce4-cabd-4c54-aa95-c4c14fadbe16 service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:45:05.019956 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b42cf-899f-4ad0-ab3e-b6c3753127e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:45:05.020544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b42cf-899f-4ad0-ab3e-b6c3753127e5 service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:45:05.020818 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b42cf-899f-4ad0-ab3e-b6c3753127e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:45:05.021084 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b42cf-899f-4ad0-ab3e-b6c3753127e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:45:05.023394 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-fd8b42cf-899f-4ad0-ab3e-b6c3753127e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:45:05.035351 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b42cf-899f-4ad0-ab3e-b6c3753127e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:45:05.036905 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b42cf-899f-4ad0-ab3e-b6c3753127e5 service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:45:05.047854 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1237/2474] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:45:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:45:15.043467 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=6 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:45:45.520483 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abffcb-069a-45a3-96b2-dc2b37a8ac45 service placement] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:45:45.531544 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abffcb-069a-45a3-96b2-dc2b37a8ac45 service placement] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:45:45.536601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3ac32-3fa4-4d6d-a1fc-e82d52be8464 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66b9bc695b44877a06f17ea6bbeb27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:45:45.537191 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3ac32-3fa4-4d6d-a1fc-e82d52be8464 service placement] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:45:45.537466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3ac32-3fa4-4d6d-a1fc-e82d52be8464 service placement] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:45:45.537734 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3ac32-3fa4-4d6d-a1fc-e82d52be8464 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:45:45.539446 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-efb3ac32-3fa4-4d6d-a1fc-e82d52be8464 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:45:45.551810 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3ac32-3fa4-4d6d-a1fc-e82d52be8464 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:45:45.553387 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3ac32-3fa4-4d6d-a1fc-e82d52be8464 service placement] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:45:45.563757 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1238/2475] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:45:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:45:55.559407 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=6 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:46:41.049969 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b42cf-899f-4ad0-ab3e-b6c3753127e5 service nova] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:41.060487 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b42cf-899f-4ad0-ab3e-b6c3753127e5 service nova] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:41.064084 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6f14e-9e09-41c7-8938-3ca9e070b3e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:41.064667 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6f14e-9e09-41c7-8938-3ca9e070b3e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:41.064940 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6f14e-9e09-41c7-8938-3ca9e070b3e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:41.065207 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6f14e-9e09-41c7-8938-3ca9e070b3e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:41.066925 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-68e6f14e-9e09-41c7-8938-3ca9e070b3e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:46:41.131237 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6f14e-9e09-41c7-8938-3ca9e070b3e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:41.133206 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6f14e-9e09-41c7-8938-3ca9e070b3e2 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:41.142656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1238/2476] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:46:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:46:44.594394 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3ac32-3fa4-4d6d-a1fc-e82d52be8464 service placement] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:44.605705 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3ac32-3fa4-4d6d-a1fc-e82d52be8464 service placement] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:44.611289 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44714ab-8f28-4821-aa58-24a10da47f10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66b9bc695b44877a06f17ea6bbeb27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:44.612044 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44714ab-8f28-4821-aa58-24a10da47f10 service placement] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:44.612326 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44714ab-8f28-4821-aa58-24a10da47f10 service placement] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:44.612597 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44714ab-8f28-4821-aa58-24a10da47f10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:44.614370 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-d44714ab-8f28-4821-aa58-24a10da47f10 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:46:44.630718 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44714ab-8f28-4821-aa58-24a10da47f10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:44.630718 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44714ab-8f28-4821-aa58-24a10da47f10 service placement] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:44.640651 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1239/2477] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:46:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:46:44.728761 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6f14e-9e09-41c7-8938-3ca9e070b3e2 service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:44.730309 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-68e6f14e-9e09-41c7-8938-3ca9e070b3e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:46:44.746261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6f14e-9e09-41c7-8938-3ca9e070b3e2 service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:44.748652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5154df-11e6-4a75-87ba-d526a416d051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:44.749280 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5154df-11e6-4a75-87ba-d526a416d051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:44.749558 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5154df-11e6-4a75-87ba-d526a416d051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:44.749883 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5154df-11e6-4a75-87ba-d526a416d051 admin admin] PATH_INFO: `/v3/users/0e81138fb66c448cb56375eacd407a6c` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:44.751041 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5154df-11e6-4a75-87ba-d526a416d051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e81138fb66c448cb56375eacd407a6c)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:44.752999 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5154df-11e6-4a75-87ba-d526a416d051 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:44.957523 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2a5154df-11e6-4a75-87ba-d526a416d051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e81138fb66c448cb56375eacd407a6c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:46:44.958129 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2a5154df-11e6-4a75-87ba-d526a416d051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e81138fb66c448cb56375eacd407a6c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:46:45.024543 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2a5154df-11e6-4a75-87ba-d526a416d051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e81138fb66c448cb56375eacd407a6c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:46:45.036830 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2a5154df-11e6-4a75-87ba-d526a416d051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e81138fb66c448cb56375eacd407a6c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:46:45.037586 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-2a5154df-11e6-4a75-87ba-d526a416d051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e81138fb66c448cb56375eacd407a6c'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:46:45.050368 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1239/2478] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:46:44 2022] DELETE /identity/v3/users/0e81138fb66c448cb56375eacd407a6c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:46:45.279292 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44714ab-8f28-4821-aa58-24a10da47f10 service placement] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:45.291440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44714ab-8f28-4821-aa58-24a10da47f10 service placement] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:45.352764 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d20b09-39e7-4f8a-bd25-270093c96636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:45.353397 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d20b09-39e7-4f8a-bd25-270093c96636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:45.353674 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d20b09-39e7-4f8a-bd25-270093c96636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:45.353948 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d20b09-39e7-4f8a-bd25-270093c96636 admin admin] PATH_INFO: `/v3/projects/af203f2a6e1b46f88c2da83f1d224897` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:45.355101 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d20b09-39e7-4f8a-bd25-270093c96636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af203f2a6e1b46f88c2da83f1d224897)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:45.356993 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d20b09-39e7-4f8a-bd25-270093c96636 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:45.493268 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-30d20b09-39e7-4f8a-bd25-270093c96636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af203f2a6e1b46f88c2da83f1d224897', 'request_id': 'req-30d20b09-39e7-4f8a-bd25-270093c96636'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:46:45.498807 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-30d20b09-39e7-4f8a-bd25-270093c96636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af203f2a6e1b46f88c2da83f1d224897', 'request_id': 'req-30d20b09-39e7-4f8a-bd25-270093c96636'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:46:45.505113 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-30d20b09-39e7-4f8a-bd25-270093c96636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af203f2a6e1b46f88c2da83f1d224897', 'request_id': 'req-30d20b09-39e7-4f8a-bd25-270093c96636'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:46:45.583592 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-30d20b09-39e7-4f8a-bd25-270093c96636 admin admin] The token cache is being invalidate because project af203f2a6e1b46f88c2da83f1d224897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:46:45.583879 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-30d20b09-39e7-4f8a-bd25-270093c96636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:46:45.584497 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-30d20b09-39e7-4f8a-bd25-270093c96636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:46:45.586657 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1240/2479] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:46:45 2022] DELETE /identity/v3/projects/af203f2a6e1b46f88c2da83f1d224897 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:46:45.591591 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390e870-d045-4ac7-ba65-5a7ea9b28842 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:45.591876 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390e870-d045-4ac7-ba65-5a7ea9b28842 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:45.592173 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390e870-d045-4ac7-ba65-5a7ea9b28842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:45.613006 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-d390e870-d045-4ac7-ba65-5a7ea9b28842 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:46:45.614199 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-d390e870-d045-4ac7-ba65-5a7ea9b28842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:46:45.676367 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1240/2480] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:46:45.685887 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0baab-a5bf-449b-adcc-70a7bf387888 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:45.686379 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0baab-a5bf-449b-adcc-70a7bf387888 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:45.686498 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0baab-a5bf-449b-adcc-70a7bf387888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:45.706391 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-3ed0baab-a5bf-449b-adcc-70a7bf387888 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:46:45.707644 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-3ed0baab-a5bf-449b-adcc-70a7bf387888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:46:45.715784 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1241/2481] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:46:45.719934 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390e870-d045-4ac7-ba65-5a7ea9b28842 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:45.730624 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390e870-d045-4ac7-ba65-5a7ea9b28842 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:45.735629 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833ce93-56cc-4474-8351-d6d0c4f2c240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:45.736212 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833ce93-56cc-4474-8351-d6d0c4f2c240 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:45.736509 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833ce93-56cc-4474-8351-d6d0c4f2c240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:45.736774 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833ce93-56cc-4474-8351-d6d0c4f2c240 admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:45.737423 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833ce93-56cc-4474-8351-d6d0c4f2c240 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:46:45.737727 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833ce93-56cc-4474-8351-d6d0c4f2c240 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:45.739421 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833ce93-56cc-4474-8351-d6d0c4f2c240 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:45.752223 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:46:45.752223 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1241/2482] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:46:45.756362 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0baab-a5bf-449b-adcc-70a7bf387888 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:45.766461 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0baab-a5bf-449b-adcc-70a7bf387888 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:45.771389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc06d88-9200-4635-81b4-1bc8af8e8df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:45.772011 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc06d88-9200-4635-81b4-1bc8af8e8df7 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:45.775248 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc06d88-9200-4635-81b4-1bc8af8e8df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:45.775248 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc06d88-9200-4635-81b4-1bc8af8e8df7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:45.775248 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc06d88-9200-4635-81b4-1bc8af8e8df7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:45.776010 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc06d88-9200-4635-81b4-1bc8af8e8df7 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:45.843409 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1242/2483] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:46:45 2022] POST /identity/v3/projects => generated 367 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:46:45.847657 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833ce93-56cc-4474-8351-d6d0c4f2c240 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:45.858317 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833ce93-56cc-4474-8351-d6d0c4f2c240 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:45.915750 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e986b95-702d-4ddf-aa0c-d0e37b60e0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:45.916354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e986b95-702d-4ddf-aa0c-d0e37b60e0a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:45.916633 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e986b95-702d-4ddf-aa0c-d0e37b60e0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:45.916906 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e986b95-702d-4ddf-aa0c-d0e37b60e0a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:45.917530 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e986b95-702d-4ddf-aa0c-d0e37b60e0a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:45.919478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e986b95-702d-4ddf-aa0c-d0e37b60e0a8 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:46.030253 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1242/2484] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:46:45 2022] POST /identity/v3/users => generated 284 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:46:46.034297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc06d88-9200-4635-81b4-1bc8af8e8df7 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:46.045789 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc06d88-9200-4635-81b4-1bc8af8e8df7 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:46.050627 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4d7f9-9cea-4612-8f46-1404d86c1a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:46.051297 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4d7f9-9cea-4612-8f46-1404d86c1a20 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:46.051581 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4d7f9-9cea-4612-8f46-1404d86c1a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:46.051857 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4d7f9-9cea-4612-8f46-1404d86c1a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:46.052508 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4d7f9-9cea-4612-8f46-1404d86c1a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:46.054290 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4d7f9-9cea-4612-8f46-1404d86c1a20 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:46.064182 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1243/2485] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:46:46.068013 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e986b95-702d-4ddf-aa0c-d0e37b60e0a8 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:46.078575 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e986b95-702d-4ddf-aa0c-d0e37b60e0a8 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:46.083186 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240bcb54-2cfb-49fd-9f1a-4054f1388631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:46.083765 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bcb54-2cfb-49fd-9f1a-4054f1388631 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:46.084039 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bcb54-2cfb-49fd-9f1a-4054f1388631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:46.084308 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bcb54-2cfb-49fd-9f1a-4054f1388631 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:46.084945 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240bcb54-2cfb-49fd-9f1a-4054f1388631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:46.087672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240bcb54-2cfb-49fd-9f1a-4054f1388631 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:46.098037 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1243/2486] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:46:46.102610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4d7f9-9cea-4612-8f46-1404d86c1a20 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:46.113568 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4d7f9-9cea-4612-8f46-1404d86c1a20 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:46.118364 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca24241-f21e-46b2-aa85-2885f6ad172c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:46.119029 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca24241-f21e-46b2-aa85-2885f6ad172c admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:46.119307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca24241-f21e-46b2-aa85-2885f6ad172c admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:46.119578 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca24241-f21e-46b2-aa85-2885f6ad172c admin admin] PATH_INFO: `/v3/projects/d91710eb1dc74e53aa100e4398289e54/users/4f66b23d757b4e74a1332884cc47c43e/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:46.133906 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca24241-f21e-46b2-aa85-2885f6ad172c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d91710eb1dc74e53aa100e4398289e54, user_id=4f66b23d757b4e74a1332884cc47c43e, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:46.136587 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca24241-f21e-46b2-aa85-2885f6ad172c admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:46.231682 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1244/2487] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:46:46 2022] PUT /identity/v3/projects/d91710eb1dc74e53aa100e4398289e54/users/4f66b23d757b4e74a1332884cc47c43e/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:46:46.242193 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2274b60-eb5e-4d0d-b480-ba7b16f4fe02 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:46.242508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2274b60-eb5e-4d0d-b480-ba7b16f4fe02 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:46.242786 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2274b60-eb5e-4d0d-b480-ba7b16f4fe02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:46.270907 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-f2274b60-eb5e-4d0d-b480-ba7b16f4fe02 None None] MFA Rules not processed for user `4f66b23d757b4e74a1332884cc47c43e`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:46:46.272110 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-f2274b60-eb5e-4d0d-b480-ba7b16f4fe02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:46:46.338006 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1244/2488] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:46:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:46:46.348699 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca24241-f21e-46b2-aa85-2885f6ad172c admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:46.350398 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-aca24241-f21e-46b2-aa85-2885f6ad172c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:46:46.364801 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:46:46.408753 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca24241-f21e-46b2-aa85-2885f6ad172c admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:46.412369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ded3d-ae7e-4e0b-8c52-6bc92eeebb87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:46.412959 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ded3d-ae7e-4e0b-8c52-6bc92eeebb87 service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:46.413231 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ded3d-ae7e-4e0b-8c52-6bc92eeebb87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:46.414036 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ded3d-ae7e-4e0b-8c52-6bc92eeebb87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:46.422348 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ded3d-ae7e-4e0b-8c52-6bc92eeebb87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:46.423801 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ded3d-ae7e-4e0b-8c52-6bc92eeebb87 service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:46.432801 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1245/2489] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:46:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:46:55.897915 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2274b60-eb5e-4d0d-b480-ba7b16f4fe02 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:55.968329 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2274b60-eb5e-4d0d-b480-ba7b16f4fe02 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:55.972830 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10050a-b078-492d-96a0-afabdfd4694f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:55.973467 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10050a-b078-492d-96a0-afabdfd4694f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:55.973956 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10050a-b078-492d-96a0-afabdfd4694f admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:55.974093 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10050a-b078-492d-96a0-afabdfd4694f admin admin] PATH_INFO: `/v3/users/4f66b23d757b4e74a1332884cc47c43e` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:55.975404 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10050a-b078-492d-96a0-afabdfd4694f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f66b23d757b4e74a1332884cc47c43e)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:55.977327 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10050a-b078-492d-96a0-afabdfd4694f admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:55.980047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:46:56.191523 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-ce10050a-b078-492d-96a0-afabdfd4694f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f66b23d757b4e74a1332884cc47c43e'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:46:56.192190 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-ce10050a-b078-492d-96a0-afabdfd4694f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f66b23d757b4e74a1332884cc47c43e'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:46:56.299026 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-ce10050a-b078-492d-96a0-afabdfd4694f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f66b23d757b4e74a1332884cc47c43e'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:46:56.315310 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-ce10050a-b078-492d-96a0-afabdfd4694f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f66b23d757b4e74a1332884cc47c43e'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:46:56.316036 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-ce10050a-b078-492d-96a0-afabdfd4694f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f66b23d757b4e74a1332884cc47c43e'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:46:56.333182 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1245/2490] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:46:55 2022] DELETE /identity/v3/users/4f66b23d757b4e74a1332884cc47c43e => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:46:56.338430 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38878c-00c6-4840-8d90-61c37661c1c4 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:56.339100 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38878c-00c6-4840-8d90-61c37661c1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:56.339100 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38878c-00c6-4840-8d90-61c37661c1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:56.358528 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-3a38878c-00c6-4840-8d90-61c37661c1c4 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:46:56.359778 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-3a38878c-00c6-4840-8d90-61c37661c1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:46:56.421074 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1246/2491] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:46:56.431791 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10050a-b078-492d-96a0-afabdfd4694f admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:56.434535 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-ce10050a-b078-492d-96a0-afabdfd4694f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:46:56.495486 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10050a-b078-492d-96a0-afabdfd4694f admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:56.499061 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57f971-41a3-4f63-8c74-841f827f9825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:56.499670 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57f971-41a3-4f63-8c74-841f827f9825 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:56.499949 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57f971-41a3-4f63-8c74-841f827f9825 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:56.500460 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57f971-41a3-4f63-8c74-841f827f9825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:56.510361 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57f971-41a3-4f63-8c74-841f827f9825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:56.511846 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57f971-41a3-4f63-8c74-841f827f9825 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:56.522242 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1246/2492] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:46:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:46:56.957164 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38878c-00c6-4840-8d90-61c37661c1c4 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:56.958592 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-3a38878c-00c6-4840-8d90-61c37661c1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:46:56.971239 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38878c-00c6-4840-8d90-61c37661c1c4 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:56.975996 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a3419-64c7-4afe-9f95-e65044b2cf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:56.976845 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a3419-64c7-4afe-9f95-e65044b2cf14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:56.977291 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a3419-64c7-4afe-9f95-e65044b2cf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:56.977723 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a3419-64c7-4afe-9f95-e65044b2cf14 admin admin] PATH_INFO: `/v3/projects/d91710eb1dc74e53aa100e4398289e54` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:56.979617 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a3419-64c7-4afe-9f95-e65044b2cf14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d91710eb1dc74e53aa100e4398289e54)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:56.982611 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a3419-64c7-4afe-9f95-e65044b2cf14 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:57.094114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-9b8a3419-64c7-4afe-9f95-e65044b2cf14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd91710eb1dc74e53aa100e4398289e54', 'request_id': 'req-9b8a3419-64c7-4afe-9f95-e65044b2cf14'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:46:57.099695 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-9b8a3419-64c7-4afe-9f95-e65044b2cf14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd91710eb1dc74e53aa100e4398289e54', 'request_id': 'req-9b8a3419-64c7-4afe-9f95-e65044b2cf14'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:46:57.106697 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-9b8a3419-64c7-4afe-9f95-e65044b2cf14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd91710eb1dc74e53aa100e4398289e54', 'request_id': 'req-9b8a3419-64c7-4afe-9f95-e65044b2cf14'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:46:57.172304 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-9b8a3419-64c7-4afe-9f95-e65044b2cf14 admin admin] The token cache is being invalidate because project d91710eb1dc74e53aa100e4398289e54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:46:57.172592 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-9b8a3419-64c7-4afe-9f95-e65044b2cf14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:46:57.173217 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-9b8a3419-64c7-4afe-9f95-e65044b2cf14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:46:57.174701 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1247/2493] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:46:56 2022] DELETE /identity/v3/projects/d91710eb1dc74e53aa100e4398289e54 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:46:57.179715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad201411-24b3-4219-bdb7-4da51df947b8 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:57.184011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad201411-24b3-4219-bdb7-4da51df947b8 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:57.184011 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad201411-24b3-4219-bdb7-4da51df947b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:57.200280 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-ad201411-24b3-4219-bdb7-4da51df947b8 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:46:57.201483 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-ad201411-24b3-4219-bdb7-4da51df947b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:46:57.261577 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1247/2494] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:46:57.269592 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0bbd7-4932-44c2-bf53-24eaa817b445 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:57.269877 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0bbd7-4932-44c2-bf53-24eaa817b445 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:57.270150 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0bbd7-4932-44c2-bf53-24eaa817b445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:57.290515 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-5fc0bbd7-4932-44c2-bf53-24eaa817b445 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:46:57.291916 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-5fc0bbd7-4932-44c2-bf53-24eaa817b445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:46:57.300139 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1248/2495] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:46:57.304323 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad201411-24b3-4219-bdb7-4da51df947b8 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:57.314272 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad201411-24b3-4219-bdb7-4da51df947b8 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:57.318805 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27707a-7068-4554-bee4-8d6ffb1435ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:57.319438 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27707a-7068-4554-bee4-8d6ffb1435ef admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:57.319720 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27707a-7068-4554-bee4-8d6ffb1435ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:57.319993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27707a-7068-4554-bee4-8d6ffb1435ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:57.320642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27707a-7068-4554-bee4-8d6ffb1435ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:46:57.320944 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27707a-7068-4554-bee4-8d6ffb1435ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:57.323092 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27707a-7068-4554-bee4-8d6ffb1435ef admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:57.334639 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1248/2496] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:46:57.339954 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0bbd7-4932-44c2-bf53-24eaa817b445 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:57.349106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0bbd7-4932-44c2-bf53-24eaa817b445 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:57.353560 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf496aa8-e282-4ca0-9a0e-caf5ab73652d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:57.354697 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf496aa8-e282-4ca0-9a0e-caf5ab73652d admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:57.355001 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf496aa8-e282-4ca0-9a0e-caf5ab73652d admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:57.355270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf496aa8-e282-4ca0-9a0e-caf5ab73652d admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:57.355900 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf496aa8-e282-4ca0-9a0e-caf5ab73652d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:57.357779 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf496aa8-e282-4ca0-9a0e-caf5ab73652d admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:57.506118 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1249/2497] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:46:57 2022] POST /identity/v3/projects => generated 365 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:46:57.511128 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27707a-7068-4554-bee4-8d6ffb1435ef admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:57.521356 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27707a-7068-4554-bee4-8d6ffb1435ef admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:57.529705 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:46:57.579799 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9f76a-ddc6-48de-a8b9-581528b278c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:57.580401 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9f76a-ddc6-48de-a8b9-581528b278c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:57.580683 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9f76a-ddc6-48de-a8b9-581528b278c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:57.580957 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9f76a-ddc6-48de-a8b9-581528b278c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:57.581586 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9f76a-ddc6-48de-a8b9-581528b278c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:57.583658 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9f76a-ddc6-48de-a8b9-581528b278c4 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:57.670275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1249/2498] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:46:57 2022] POST /identity/v3/users => generated 283 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:46:57.674443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf496aa8-e282-4ca0-9a0e-caf5ab73652d admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:57.685736 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf496aa8-e282-4ca0-9a0e-caf5ab73652d admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:57.690377 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3dcc57-b5ab-4903-a654-9bbd4b19da56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:57.691178 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3dcc57-b5ab-4903-a654-9bbd4b19da56 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:57.691466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3dcc57-b5ab-4903-a654-9bbd4b19da56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:57.691739 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3dcc57-b5ab-4903-a654-9bbd4b19da56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:57.692391 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3dcc57-b5ab-4903-a654-9bbd4b19da56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:57.693984 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3dcc57-b5ab-4903-a654-9bbd4b19da56 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:57.699939 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:46:57.705247 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1250/2499] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:46:57.709844 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9f76a-ddc6-48de-a8b9-581528b278c4 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:57.719456 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9f76a-ddc6-48de-a8b9-581528b278c4 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:57.724239 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7bbcc-dae4-487d-b8a1-dc512718278e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:57.724829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7bbcc-dae4-487d-b8a1-dc512718278e admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:57.725109 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7bbcc-dae4-487d-b8a1-dc512718278e admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:57.725379 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7bbcc-dae4-487d-b8a1-dc512718278e admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:57.726022 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7bbcc-dae4-487d-b8a1-dc512718278e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:57.727784 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7bbcc-dae4-487d-b8a1-dc512718278e admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:57.740826 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1250/2500] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:46:57.745346 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3dcc57-b5ab-4903-a654-9bbd4b19da56 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:57.755608 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3dcc57-b5ab-4903-a654-9bbd4b19da56 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:57.761038 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6b8a5-efe5-416f-88ce-0774210a6212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:57.767483 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6b8a5-efe5-416f-88ce-0774210a6212 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:57.767483 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6b8a5-efe5-416f-88ce-0774210a6212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:57.767483 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6b8a5-efe5-416f-88ce-0774210a6212 admin admin] PATH_INFO: `/v3/projects/a7c89a00065944bcb83cc848493d4373/users/3920cae39b3d4caba05681736aa32b18/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:57.776946 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6b8a5-efe5-416f-88ce-0774210a6212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7c89a00065944bcb83cc848493d4373, user_id=3920cae39b3d4caba05681736aa32b18, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:57.779763 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6b8a5-efe5-416f-88ce-0774210a6212 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:57.853323 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1251/2501] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:46:57 2022] PUT /identity/v3/projects/a7c89a00065944bcb83cc848493d4373/users/3920cae39b3d4caba05681736aa32b18/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:46:57.865313 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20775f6f-d931-4f97-bc9f-87140c442bbd None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:57.870642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20775f6f-d931-4f97-bc9f-87140c442bbd None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:57.870642 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20775f6f-d931-4f97-bc9f-87140c442bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:57.895610 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-20775f6f-d931-4f97-bc9f-87140c442bbd None None] MFA Rules not processed for user `3920cae39b3d4caba05681736aa32b18`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:46:57.897671 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-20775f6f-d931-4f97-bc9f-87140c442bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:46:57.962609 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1251/2502] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:46:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:46:57.967176 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6b8a5-efe5-416f-88ce-0774210a6212 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:58.027822 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6b8a5-efe5-416f-88ce-0774210a6212 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:58.032430 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2f8c6-852b-4c97-97e0-9c963604736a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:58.033022 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2f8c6-852b-4c97-97e0-9c963604736a admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:58.033299 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2f8c6-852b-4c97-97e0-9c963604736a admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:58.033569 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2f8c6-852b-4c97-97e0-9c963604736a admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:58.034183 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2f8c6-852b-4c97-97e0-9c963604736a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:58.036124 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2f8c6-852b-4c97-97e0-9c963604736a admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:58.123662 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1252/2503] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:46:57 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:46:58.128022 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20775f6f-d931-4f97-bc9f-87140c442bbd None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:58.139076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20775f6f-d931-4f97-bc9f-87140c442bbd None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:58.195241 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b0ce7-0357-4053-80db-551cb0f69e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:58.195904 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b0ce7-0357-4053-80db-551cb0f69e65 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:58.196104 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b0ce7-0357-4053-80db-551cb0f69e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:58.196373 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b0ce7-0357-4053-80db-551cb0f69e65 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:58.196996 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b0ce7-0357-4053-80db-551cb0f69e65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:58.199033 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b0ce7-0357-4053-80db-551cb0f69e65 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:58.253787 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1252/2504] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:46:58 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:46:58.257493 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2f8c6-852b-4c97-97e0-9c963604736a admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:58.268201 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2f8c6-852b-4c97-97e0-9c963604736a admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:58.272854 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59c181-04f1-4bdc-9810-691f78934725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:58.273440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59c181-04f1-4bdc-9810-691f78934725 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:58.273715 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59c181-04f1-4bdc-9810-691f78934725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:58.273981 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59c181-04f1-4bdc-9810-691f78934725 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:58.274670 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59c181-04f1-4bdc-9810-691f78934725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:58.277296 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59c181-04f1-4bdc-9810-691f78934725 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:58.288758 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1253/2505] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:46:58.293561 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b0ce7-0357-4053-80db-551cb0f69e65 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:58.303550 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b0ce7-0357-4053-80db-551cb0f69e65 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:58.308291 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0eb17a-9686-4265-b12c-7f15e0c198e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:58.308935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0eb17a-9686-4265-b12c-7f15e0c198e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:58.309212 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0eb17a-9686-4265-b12c-7f15e0c198e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:58.309515 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0eb17a-9686-4265-b12c-7f15e0c198e1 admin admin] PATH_INFO: `/v3/projects/4146d3cbe9244df2ac4737805193ac54/users/8af59391e2db4f7387e5e705cd9aa2e7/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:58.312635 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:46:58.324814 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0eb17a-9686-4265-b12c-7f15e0c198e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4146d3cbe9244df2ac4737805193ac54, user_id=8af59391e2db4f7387e5e705cd9aa2e7, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:58.327549 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0eb17a-9686-4265-b12c-7f15e0c198e1 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:58.383988 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1253/2506] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:46:58 2022] PUT /identity/v3/projects/4146d3cbe9244df2ac4737805193ac54/users/8af59391e2db4f7387e5e705cd9aa2e7/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:46:58.388030 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59c181-04f1-4bdc-9810-691f78934725 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:58.398288 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59c181-04f1-4bdc-9810-691f78934725 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:58.454945 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2696d34-ad76-4589-9f54-9b82d1e5a0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:58.455561 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2696d34-ad76-4589-9f54-9b82d1e5a0aa admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:58.455823 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2696d34-ad76-4589-9f54-9b82d1e5a0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:58.456094 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2696d34-ad76-4589-9f54-9b82d1e5a0aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:58.456725 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2696d34-ad76-4589-9f54-9b82d1e5a0aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:58.458325 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2696d34-ad76-4589-9f54-9b82d1e5a0aa admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:58.468605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1254/2507] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:46:58.472604 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0eb17a-9686-4265-b12c-7f15e0c198e1 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:58.483634 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0eb17a-9686-4265-b12c-7f15e0c198e1 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:58.488203 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e869a3-6654-47d7-ade5-60bc33b4ab7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:58.488840 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e869a3-6654-47d7-ade5-60bc33b4ab7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:58.489116 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e869a3-6654-47d7-ade5-60bc33b4ab7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:58.489384 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e869a3-6654-47d7-ade5-60bc33b4ab7b admin admin] PATH_INFO: `/v3/projects/4146d3cbe9244df2ac4737805193ac54/users/8af59391e2db4f7387e5e705cd9aa2e7/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:58.491353 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e869a3-6654-47d7-ade5-60bc33b4ab7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4146d3cbe9244df2ac4737805193ac54, user_id=8af59391e2db4f7387e5e705cd9aa2e7, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:58.493994 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e869a3-6654-47d7-ade5-60bc33b4ab7b admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:58.504121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1254/2508] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:46:58 2022] PUT /identity/v3/projects/4146d3cbe9244df2ac4737805193ac54/users/8af59391e2db4f7387e5e705cd9aa2e7/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:46:58.514578 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41b9ef-a3af-4074-a9e7-195711620934 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:58.514888 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41b9ef-a3af-4074-a9e7-195711620934 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:58.515164 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41b9ef-a3af-4074-a9e7-195711620934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:58.543975 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-6b41b9ef-a3af-4074-a9e7-195711620934 None None] MFA Rules not processed for user `8af59391e2db4f7387e5e705cd9aa2e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:46:58.545167 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-6b41b9ef-a3af-4074-a9e7-195711620934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:46:58.577758 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:46:58.613120 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1255/2509] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:46:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:46:58.625071 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e869a3-6654-47d7-ade5-60bc33b4ab7b admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:58.626756 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-68e869a3-6654-47d7-ade5-60bc33b4ab7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:46:58.685414 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e869a3-6654-47d7-ade5-60bc33b4ab7b admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:58.689048 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6b61f-2937-43ee-a6b7-efee59a98f74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:58.689641 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6b61f-2937-43ee-a6b7-efee59a98f74 service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:58.689913 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6b61f-2937-43ee-a6b7-efee59a98f74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:58.690177 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6b61f-2937-43ee-a6b7-efee59a98f74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:58.700020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6b61f-2937-43ee-a6b7-efee59a98f74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:58.701429 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6b61f-2937-43ee-a6b7-efee59a98f74 service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:58.711064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1255/2510] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:46:58 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:46:58.877499 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41b9ef-a3af-4074-a9e7-195711620934 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:46:58.887795 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41b9ef-a3af-4074-a9e7-195711620934 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:46:58.891372 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a8a5a-b14a-461b-808b-6ac28040bb71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:46:58.891962 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a8a5a-b14a-461b-808b-6ac28040bb71 service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:46:58.892238 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a8a5a-b14a-461b-808b-6ac28040bb71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:46:58.892510 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a8a5a-b14a-461b-808b-6ac28040bb71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:46:58.949899 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a8a5a-b14a-461b-808b-6ac28040bb71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:46:58.951480 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a8a5a-b14a-461b-808b-6ac28040bb71 service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:46:58.960648 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1256/2511] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:46:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:47:02.488955 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6b61f-2937-43ee-a6b7-efee59a98f74 service cinder] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:02.549437 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6b61f-2937-43ee-a6b7-efee59a98f74 service cinder] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:02.554732 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0ce96-c21e-4c31-afd1-05ca74e01998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:02.555390 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0ce96-c21e-4c31-afd1-05ca74e01998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:02.555665 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0ce96-c21e-4c31-afd1-05ca74e01998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:02.555935 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0ce96-c21e-4c31-afd1-05ca74e01998 admin admin] PATH_INFO: `/v3/users/3920cae39b3d4caba05681736aa32b18` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:02.557052 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0ce96-c21e-4c31-afd1-05ca74e01998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3920cae39b3d4caba05681736aa32b18)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:02.559270 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0ce96-c21e-4c31-afd1-05ca74e01998 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:02.826530 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-dfc0ce96-c21e-4c31-afd1-05ca74e01998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3920cae39b3d4caba05681736aa32b18'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:02.827134 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-dfc0ce96-c21e-4c31-afd1-05ca74e01998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3920cae39b3d4caba05681736aa32b18'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:02.897393 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-dfc0ce96-c21e-4c31-afd1-05ca74e01998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3920cae39b3d4caba05681736aa32b18'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:02.910068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-dfc0ce96-c21e-4c31-afd1-05ca74e01998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3920cae39b3d4caba05681736aa32b18'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:02.910699 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-dfc0ce96-c21e-4c31-afd1-05ca74e01998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3920cae39b3d4caba05681736aa32b18'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:02.915399 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:47:02.923749 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1256/2512] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:47:02 2022] DELETE /identity/v3/users/3920cae39b3d4caba05681736aa32b18 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:47:02.928258 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff2040-8414-41cc-86a6-10e50cd696d5 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:02.933053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff2040-8414-41cc-86a6-10e50cd696d5 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:02.933053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff2040-8414-41cc-86a6-10e50cd696d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:02.948113 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-89ff2040-8414-41cc-86a6-10e50cd696d5 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:47:02.950034 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-89ff2040-8414-41cc-86a6-10e50cd696d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:03.007771 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1257/2513] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:47:03.018250 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0ce96-c21e-4c31-afd1-05ca74e01998 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:03.019713 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-dfc0ce96-c21e-4c31-afd1-05ca74e01998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:03.077801 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0ce96-c21e-4c31-afd1-05ca74e01998 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:03.081593 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72537b21-779e-415b-bd0b-03018cb83caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:03.082188 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72537b21-779e-415b-bd0b-03018cb83caa service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:03.082463 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72537b21-779e-415b-bd0b-03018cb83caa service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:03.082734 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72537b21-779e-415b-bd0b-03018cb83caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:03.091996 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72537b21-779e-415b-bd0b-03018cb83caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:03.093424 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72537b21-779e-415b-bd0b-03018cb83caa service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:03.102885 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1257/2514] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:47:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:47:03.500766 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff2040-8414-41cc-86a6-10e50cd696d5 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:03.502543 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-89ff2040-8414-41cc-86a6-10e50cd696d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:03.514285 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff2040-8414-41cc-86a6-10e50cd696d5 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:03.518988 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4445e-cb74-47be-af41-dba39cd27d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:03.519645 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4445e-cb74-47be-af41-dba39cd27d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:03.519924 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4445e-cb74-47be-af41-dba39cd27d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:03.520190 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4445e-cb74-47be-af41-dba39cd27d87 admin admin] PATH_INFO: `/v3/projects/a7c89a00065944bcb83cc848493d4373` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:03.521305 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4445e-cb74-47be-af41-dba39cd27d87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7c89a00065944bcb83cc848493d4373)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:03.523251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4445e-cb74-47be-af41-dba39cd27d87 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:03.624744 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-72c4445e-cb74-47be-af41-dba39cd27d87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7c89a00065944bcb83cc848493d4373', 'request_id': 'req-72c4445e-cb74-47be-af41-dba39cd27d87'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:03.630231 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-72c4445e-cb74-47be-af41-dba39cd27d87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7c89a00065944bcb83cc848493d4373', 'request_id': 'req-72c4445e-cb74-47be-af41-dba39cd27d87'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:03.636472 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-72c4445e-cb74-47be-af41-dba39cd27d87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7c89a00065944bcb83cc848493d4373', 'request_id': 'req-72c4445e-cb74-47be-af41-dba39cd27d87'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:03.639121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:47:03.766503 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-72c4445e-cb74-47be-af41-dba39cd27d87 admin admin] The token cache is being invalidate because project a7c89a00065944bcb83cc848493d4373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:47:03.766792 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-72c4445e-cb74-47be-af41-dba39cd27d87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:03.767458 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-72c4445e-cb74-47be-af41-dba39cd27d87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:03.768990 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1258/2515] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:47:03 2022] DELETE /identity/v3/projects/a7c89a00065944bcb83cc848493d4373 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:47:03.773007 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72537b21-779e-415b-bd0b-03018cb83caa service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:03.783955 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72537b21-779e-415b-bd0b-03018cb83caa service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:03.840968 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08236a72-9723-46c2-ac7a-3d07e0323679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:03.841581 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08236a72-9723-46c2-ac7a-3d07e0323679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:03.841859 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08236a72-9723-46c2-ac7a-3d07e0323679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:03.842129 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08236a72-9723-46c2-ac7a-3d07e0323679 admin admin] PATH_INFO: `/v3/users/8af59391e2db4f7387e5e705cd9aa2e7` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:03.843267 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08236a72-9723-46c2-ac7a-3d07e0323679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8af59391e2db4f7387e5e705cd9aa2e7)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:03.845182 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08236a72-9723-46c2-ac7a-3d07e0323679 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:04.014382 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-08236a72-9723-46c2-ac7a-3d07e0323679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8af59391e2db4f7387e5e705cd9aa2e7'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:04.015020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-08236a72-9723-46c2-ac7a-3d07e0323679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8af59391e2db4f7387e5e705cd9aa2e7'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:04.086869 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-08236a72-9723-46c2-ac7a-3d07e0323679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8af59391e2db4f7387e5e705cd9aa2e7'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:04.100275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-08236a72-9723-46c2-ac7a-3d07e0323679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8af59391e2db4f7387e5e705cd9aa2e7'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:04.100921 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-08236a72-9723-46c2-ac7a-3d07e0323679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8af59391e2db4f7387e5e705cd9aa2e7'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:04.113342 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1258/2516] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:47:03 2022] DELETE /identity/v3/users/8af59391e2db4f7387e5e705cd9aa2e7 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:47:04.557315 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4445e-cb74-47be-af41-dba39cd27d87 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:04.563468 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-72c4445e-cb74-47be-af41-dba39cd27d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:04.573142 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4445e-cb74-47be-af41-dba39cd27d87 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:04.632545 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a77ab7-36a4-4971-92f2-93e5c94c6a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:04.633174 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a77ab7-36a4-4971-92f2-93e5c94c6a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:04.633450 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a77ab7-36a4-4971-92f2-93e5c94c6a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:04.633719 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a77ab7-36a4-4971-92f2-93e5c94c6a7f admin admin] PATH_INFO: `/v3/projects/4146d3cbe9244df2ac4737805193ac54` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:04.634828 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a77ab7-36a4-4971-92f2-93e5c94c6a7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4146d3cbe9244df2ac4737805193ac54)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:04.636932 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a77ab7-36a4-4971-92f2-93e5c94c6a7f admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:04.756160 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-08a77ab7-36a4-4971-92f2-93e5c94c6a7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4146d3cbe9244df2ac4737805193ac54', 'request_id': 'req-08a77ab7-36a4-4971-92f2-93e5c94c6a7f'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:04.761827 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-08a77ab7-36a4-4971-92f2-93e5c94c6a7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4146d3cbe9244df2ac4737805193ac54', 'request_id': 'req-08a77ab7-36a4-4971-92f2-93e5c94c6a7f'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:04.768536 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-08a77ab7-36a4-4971-92f2-93e5c94c6a7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4146d3cbe9244df2ac4737805193ac54', 'request_id': 'req-08a77ab7-36a4-4971-92f2-93e5c94c6a7f'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:04.841311 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-08a77ab7-36a4-4971-92f2-93e5c94c6a7f admin admin] The token cache is being invalidate because project 4146d3cbe9244df2ac4737805193ac54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:47:04.841564 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-08a77ab7-36a4-4971-92f2-93e5c94c6a7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:04.842154 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-08a77ab7-36a4-4971-92f2-93e5c94c6a7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:04.843702 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1259/2517] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:47:04 2022] DELETE /identity/v3/projects/4146d3cbe9244df2ac4737805193ac54 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:47:04.848576 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11407a0-8015-4925-9525-0fd26f70108e None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:04.849076 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11407a0-8015-4925-9525-0fd26f70108e None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:04.849177 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11407a0-8015-4925-9525-0fd26f70108e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:04.870405 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-d11407a0-8015-4925-9525-0fd26f70108e None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:47:04.871703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-d11407a0-8015-4925-9525-0fd26f70108e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:04.882005 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:47:04.933027 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1259/2518] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:47:04.941982 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d61ca0-eb8d-4537-a4a1-c699944dc951 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:04.942261 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d61ca0-eb8d-4537-a4a1-c699944dc951 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:04.942531 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d61ca0-eb8d-4537-a4a1-c699944dc951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:04.962654 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-71d61ca0-eb8d-4537-a4a1-c699944dc951 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:47:04.963865 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-71d61ca0-eb8d-4537-a4a1-c699944dc951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:04.972636 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1260/2519] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:47:04.976715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11407a0-8015-4925-9525-0fd26f70108e None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:04.987305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11407a0-8015-4925-9525-0fd26f70108e None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:04.991826 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e68738-9b6a-4440-a7dd-32e68805f1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:04.992414 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e68738-9b6a-4440-a7dd-32e68805f1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:04.992687 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e68738-9b6a-4440-a7dd-32e68805f1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:04.992956 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e68738-9b6a-4440-a7dd-32e68805f1f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:04.993595 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e68738-9b6a-4440-a7dd-32e68805f1f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:47:04.993894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e68738-9b6a-4440-a7dd-32e68805f1f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:04.995511 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e68738-9b6a-4440-a7dd-32e68805f1f9 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:05.007292 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1260/2520] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:47:05.011512 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d61ca0-eb8d-4537-a4a1-c699944dc951 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:05.020647 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d61ca0-eb8d-4537-a4a1-c699944dc951 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:05.025201 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5178d-1433-41b1-8b7d-3a64da517d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:05.025782 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5178d-1433-41b1-8b7d-3a64da517d87 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:05.026056 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5178d-1433-41b1-8b7d-3a64da517d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:05.026321 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5178d-1433-41b1-8b7d-3a64da517d87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:05.026976 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5178d-1433-41b1-8b7d-3a64da517d87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:05.029432 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5178d-1433-41b1-8b7d-3a64da517d87 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:05.103486 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1261/2521] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:47:05 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:47:05.111333 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e68738-9b6a-4440-a7dd-32e68805f1f9 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:05.118555 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e68738-9b6a-4440-a7dd-32e68805f1f9 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:05.174903 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d52f6-cf2e-4976-90a7-2860328cad06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:05.175514 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d52f6-cf2e-4976-90a7-2860328cad06 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:05.175794 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d52f6-cf2e-4976-90a7-2860328cad06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:05.176068 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d52f6-cf2e-4976-90a7-2860328cad06 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:05.176707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d52f6-cf2e-4976-90a7-2860328cad06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:05.178707 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d52f6-cf2e-4976-90a7-2860328cad06 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:05.259253 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1261/2522] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:47:05 2022] POST /identity/v3/users => generated 291 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:47:05.263662 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5178d-1433-41b1-8b7d-3a64da517d87 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:05.274046 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5178d-1433-41b1-8b7d-3a64da517d87 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:05.279207 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0e4a7-0ac0-4fca-9717-78490b9c2ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:05.280354 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0e4a7-0ac0-4fca-9717-78490b9c2ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:05.280630 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0e4a7-0ac0-4fca-9717-78490b9c2ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:05.280898 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0e4a7-0ac0-4fca-9717-78490b9c2ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:05.281531 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0e4a7-0ac0-4fca-9717-78490b9c2ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:05.283159 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0e4a7-0ac0-4fca-9717-78490b9c2ef5 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:05.293361 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1262/2523] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:47:05.298340 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d52f6-cf2e-4976-90a7-2860328cad06 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:05.308583 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d52f6-cf2e-4976-90a7-2860328cad06 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:05.313365 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7be78a-687e-4f2d-9ba7-2f0652a7941a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:05.313978 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7be78a-687e-4f2d-9ba7-2f0652a7941a admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:05.314257 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7be78a-687e-4f2d-9ba7-2f0652a7941a admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:05.314554 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7be78a-687e-4f2d-9ba7-2f0652a7941a admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:05.315234 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7be78a-687e-4f2d-9ba7-2f0652a7941a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:05.316811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7be78a-687e-4f2d-9ba7-2f0652a7941a admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:05.327896 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1262/2524] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:47:05.332053 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0e4a7-0ac0-4fca-9717-78490b9c2ef5 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:05.342638 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0e4a7-0ac0-4fca-9717-78490b9c2ef5 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:05.347194 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fd0bf-0a5d-4e4c-b28e-dc21a95cdb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:05.347822 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fd0bf-0a5d-4e4c-b28e-dc21a95cdb32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:05.348094 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fd0bf-0a5d-4e4c-b28e-dc21a95cdb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:05.348365 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fd0bf-0a5d-4e4c-b28e-dc21a95cdb32 admin admin] PATH_INFO: `/v3/projects/4b9133b94c7f432fba6879796645a333/users/5d5ad94aabbe4666ac3f24dbc8a96fec/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:05.363848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fd0bf-0a5d-4e4c-b28e-dc21a95cdb32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9133b94c7f432fba6879796645a333, user_id=5d5ad94aabbe4666ac3f24dbc8a96fec, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:05.366410 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fd0bf-0a5d-4e4c-b28e-dc21a95cdb32 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:05.441337 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1263/2525] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:47:05 2022] PUT /identity/v3/projects/4b9133b94c7f432fba6879796645a333/users/5d5ad94aabbe4666ac3f24dbc8a96fec/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:47:05.504040 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecec88-9a30-4615-b4e0-17df9e01e335 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:05.504320 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecec88-9a30-4615-b4e0-17df9e01e335 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:05.504589 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecec88-9a30-4615-b4e0-17df9e01e335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:05.532881 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-35ecec88-9a30-4615-b4e0-17df9e01e335 None None] MFA Rules not processed for user `5d5ad94aabbe4666ac3f24dbc8a96fec`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:47:05.534083 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-35ecec88-9a30-4615-b4e0-17df9e01e335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:05.597749 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1263/2526] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:47:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:47:05.602318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fd0bf-0a5d-4e4c-b28e-dc21a95cdb32 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:05.623470 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:47:05.665452 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fd0bf-0a5d-4e4c-b28e-dc21a95cdb32 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:05.670782 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10f1b8-be9a-468c-941d-d55babcc84ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:05.671410 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10f1b8-be9a-468c-941d-d55babcc84ad admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:05.673045 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10f1b8-be9a-468c-941d-d55babcc84ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:05.673045 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10f1b8-be9a-468c-941d-d55babcc84ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:05.673045 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10f1b8-be9a-468c-941d-d55babcc84ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:05.674614 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10f1b8-be9a-468c-941d-d55babcc84ad admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:05.791029 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1264/2527] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:47:05 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:47:05.795405 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecec88-9a30-4615-b4e0-17df9e01e335 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:05.806180 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecec88-9a30-4615-b4e0-17df9e01e335 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:05.814938 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:47:05.865122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54886c47-835b-41fa-ae5e-69719ff2a8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:05.865807 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54886c47-835b-41fa-ae5e-69719ff2a8d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:05.865982 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54886c47-835b-41fa-ae5e-69719ff2a8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:05.866251 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54886c47-835b-41fa-ae5e-69719ff2a8d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:05.866900 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54886c47-835b-41fa-ae5e-69719ff2a8d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:05.868816 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54886c47-835b-41fa-ae5e-69719ff2a8d9 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:05.967736 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1264/2528] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:47:05 2022] POST /identity/v3/users => generated 296 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 02:47:05.971558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10f1b8-be9a-468c-941d-d55babcc84ad admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:05.982277 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10f1b8-be9a-468c-941d-d55babcc84ad admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:05.986934 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95922268-3a1a-4941-b898-9286186fe451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:05.987519 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95922268-3a1a-4941-b898-9286186fe451 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:05.987788 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95922268-3a1a-4941-b898-9286186fe451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:05.988051 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95922268-3a1a-4941-b898-9286186fe451 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:05.988682 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95922268-3a1a-4941-b898-9286186fe451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:05.990266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95922268-3a1a-4941-b898-9286186fe451 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:06.001287 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1265/2529] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:47:06.005441 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54886c47-835b-41fa-ae5e-69719ff2a8d9 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:06.016203 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54886c47-835b-41fa-ae5e-69719ff2a8d9 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:06.020774 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bace99f-308e-4ae6-8569-b73e93c1480c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:06.021418 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bace99f-308e-4ae6-8569-b73e93c1480c admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:06.021703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bace99f-308e-4ae6-8569-b73e93c1480c admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:06.021980 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bace99f-308e-4ae6-8569-b73e93c1480c admin admin] PATH_INFO: `/v3/projects/34a315b94975485380840ed27de1ccbf/users/b9c8596eb8464c4db3c756e3bc9d9380/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:06.037529 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bace99f-308e-4ae6-8569-b73e93c1480c admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a315b94975485380840ed27de1ccbf, user_id=b9c8596eb8464c4db3c756e3bc9d9380, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:06.040246 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bace99f-308e-4ae6-8569-b73e93c1480c admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:06.109821 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1265/2530] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:47:06 2022] PUT /identity/v3/projects/34a315b94975485380840ed27de1ccbf/users/b9c8596eb8464c4db3c756e3bc9d9380/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:47:06.113953 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95922268-3a1a-4941-b898-9286186fe451 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:06.124495 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95922268-3a1a-4941-b898-9286186fe451 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:06.180014 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123ec49-96d2-4bb1-98c2-eb7a70953ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:06.180620 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123ec49-96d2-4bb1-98c2-eb7a70953ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:06.180901 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123ec49-96d2-4bb1-98c2-eb7a70953ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:06.181174 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123ec49-96d2-4bb1-98c2-eb7a70953ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:06.181807 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123ec49-96d2-4bb1-98c2-eb7a70953ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:06.183495 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123ec49-96d2-4bb1-98c2-eb7a70953ae9 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:06.193859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1266/2531] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:47:06.197976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bace99f-308e-4ae6-8569-b73e93c1480c admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:06.208769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bace99f-308e-4ae6-8569-b73e93c1480c admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:06.213564 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9646d4-9827-4ac4-8937-803b7697a6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:06.214218 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9646d4-9827-4ac4-8937-803b7697a6fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:06.214522 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9646d4-9827-4ac4-8937-803b7697a6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:06.214794 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9646d4-9827-4ac4-8937-803b7697a6fd admin admin] PATH_INFO: `/v3/projects/34a315b94975485380840ed27de1ccbf/users/b9c8596eb8464c4db3c756e3bc9d9380/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:06.216845 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9646d4-9827-4ac4-8937-803b7697a6fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a315b94975485380840ed27de1ccbf, user_id=b9c8596eb8464c4db3c756e3bc9d9380, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:06.219709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9646d4-9827-4ac4-8937-803b7697a6fd admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:06.230220 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1266/2532] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:47:06 2022] PUT /identity/v3/projects/34a315b94975485380840ed27de1ccbf/users/b9c8596eb8464c4db3c756e3bc9d9380/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:47:06.240829 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01c0d8-2194-448e-b0aa-4f5e4b7943d7 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:06.241114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01c0d8-2194-448e-b0aa-4f5e4b7943d7 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:06.241389 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01c0d8-2194-448e-b0aa-4f5e4b7943d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:06.269575 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-be01c0d8-2194-448e-b0aa-4f5e4b7943d7 None None] MFA Rules not processed for user `b9c8596eb8464c4db3c756e3bc9d9380`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:47:06.270777 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-be01c0d8-2194-448e-b0aa-4f5e4b7943d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:06.337667 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1267/2533] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:47:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:47:06.349811 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9646d4-9827-4ac4-8937-803b7697a6fd admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:06.351556 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-3d9646d4-9827-4ac4-8937-803b7697a6fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:06.409260 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9646d4-9827-4ac4-8937-803b7697a6fd admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:06.412944 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25a63d-8cf2-4b23-b7d1-4e3fdd685fae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:06.413542 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25a63d-8cf2-4b23-b7d1-4e3fdd685fae service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:06.413819 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25a63d-8cf2-4b23-b7d1-4e3fdd685fae service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:06.414091 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25a63d-8cf2-4b23-b7d1-4e3fdd685fae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:06.423624 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25a63d-8cf2-4b23-b7d1-4e3fdd685fae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:06.425050 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25a63d-8cf2-4b23-b7d1-4e3fdd685fae service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:06.434373 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1267/2534] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:47:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:47:07.367751 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01c0d8-2194-448e-b0aa-4f5e4b7943d7 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:07.377828 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01c0d8-2194-448e-b0aa-4f5e4b7943d7 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:07.382352 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea4331-39f8-4d44-9b53-00cbb07be926 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c8596eb8464c4db3c756e3bc9d9380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34a315b94975485380840ed27de1ccbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:07.382975 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea4331-39f8-4d44-9b53-00cbb07be926 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:07.383251 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea4331-39f8-4d44-9b53-00cbb07be926 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:07.383517 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea4331-39f8-4d44-9b53-00cbb07be926 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:07.384147 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea4331-39f8-4d44-9b53-00cbb07be926 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:47:07.384444 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea4331-39f8-4d44-9b53-00cbb07be926 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:07.386045 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea4331-39f8-4d44-9b53-00cbb07be926 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:07.398181 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1268/2535] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:47:07.402181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25a63d-8cf2-4b23-b7d1-4e3fdd685fae service cinder] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:07.411357 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25a63d-8cf2-4b23-b7d1-4e3fdd685fae service cinder] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:07.415928 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a0567-27c8-4469-aae6-a292366a733f tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c8596eb8464c4db3c756e3bc9d9380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34a315b94975485380840ed27de1ccbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:07.416523 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a0567-27c8-4469-aae6-a292366a733f tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:07.416804 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a0567-27c8-4469-aae6-a292366a733f tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:07.417079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a0567-27c8-4469-aae6-a292366a733f tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:07.417710 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a0567-27c8-4469-aae6-a292366a733f tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:07.419700 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a0567-27c8-4469-aae6-a292366a733f tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:07.516726 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1268/2536] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:47:07 2022] POST /identity/v3/projects => generated 354 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:47:07.520842 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea4331-39f8-4d44-9b53-00cbb07be926 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:07.526215 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:47:07.532101 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea4331-39f8-4d44-9b53-00cbb07be926 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:07.588896 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9793b-744a-484e-b366-68928970cbe4 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c8596eb8464c4db3c756e3bc9d9380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34a315b94975485380840ed27de1ccbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:07.589601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9793b-744a-484e-b366-68928970cbe4 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:07.590098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9793b-744a-484e-b366-68928970cbe4 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:07.590390 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9793b-744a-484e-b366-68928970cbe4 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:07.591758 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9793b-744a-484e-b366-68928970cbe4 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:47:07.592387 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9793b-744a-484e-b366-68928970cbe4 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:07.594378 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9793b-744a-484e-b366-68928970cbe4 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:07.605555 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1269/2537] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:47:07.642231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a0567-27c8-4469-aae6-a292366a733f tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:07.652461 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a0567-27c8-4469-aae6-a292366a733f tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:07.658132 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742bdea-caa1-4ba3-9930-70a025711444 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9c8596eb8464c4db3c756e3bc9d9380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34a315b94975485380840ed27de1ccbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:07.658750 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742bdea-caa1-4ba3-9930-70a025711444 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:07.659063 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742bdea-caa1-4ba3-9930-70a025711444 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:07.659340 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742bdea-caa1-4ba3-9930-70a025711444 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] PATH_INFO: `/v3/projects/f54f6ecbd3254f5398bead9d44e42ccb` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:07.660471 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742bdea-caa1-4ba3-9930-70a025711444 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f54f6ecbd3254f5398bead9d44e42ccb)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:07.662454 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742bdea-caa1-4ba3-9930-70a025711444 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:07.761271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:47:07.769069 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c742bdea-caa1-4ba3-9930-70a025711444 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f54f6ecbd3254f5398bead9d44e42ccb', 'request_id': 'req-c742bdea-caa1-4ba3-9930-70a025711444'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:07.774781 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c742bdea-caa1-4ba3-9930-70a025711444 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f54f6ecbd3254f5398bead9d44e42ccb', 'request_id': 'req-c742bdea-caa1-4ba3-9930-70a025711444'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:07.857538 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c742bdea-caa1-4ba3-9930-70a025711444 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f54f6ecbd3254f5398bead9d44e42ccb', 'request_id': 'req-c742bdea-caa1-4ba3-9930-70a025711444'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:07.869437 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c742bdea-caa1-4ba3-9930-70a025711444 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] The token cache is being invalidate because project f54f6ecbd3254f5398bead9d44e42ccb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:47:07.869907 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c742bdea-caa1-4ba3-9930-70a025711444 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:07.871087 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c742bdea-caa1-4ba3-9930-70a025711444 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:07.872715 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1269/2538] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:47:07 2022] DELETE /identity/v3/projects/f54f6ecbd3254f5398bead9d44e42ccb => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:47:08.341944 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9793b-744a-484e-b366-68928970cbe4 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:08.343951 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-38d9793b-744a-484e-b366-68928970cbe4 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:08.408902 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9793b-744a-484e-b366-68928970cbe4 tempest-VolumeQuotaClassesTest-340456201 tempest-VolumeQuotaClassesTest-340456201-project-admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:08.463880 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9d9e5-2b8a-44cf-bc2b-d5c001609e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:08.464429 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9d9e5-2b8a-44cf-bc2b-d5c001609e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:08.464718 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9d9e5-2b8a-44cf-bc2b-d5c001609e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:08.464989 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9d9e5-2b8a-44cf-bc2b-d5c001609e4e admin admin] PATH_INFO: `/v3/users/5d5ad94aabbe4666ac3f24dbc8a96fec` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:08.467443 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9d9e5-2b8a-44cf-bc2b-d5c001609e4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d5ad94aabbe4666ac3f24dbc8a96fec)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:08.469280 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9d9e5-2b8a-44cf-bc2b-d5c001609e4e admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:08.652918 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:47:08.655673 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-4dd9d9e5-2b8a-44cf-bc2b-d5c001609e4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d5ad94aabbe4666ac3f24dbc8a96fec'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:08.656327 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-4dd9d9e5-2b8a-44cf-bc2b-d5c001609e4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d5ad94aabbe4666ac3f24dbc8a96fec'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:08.738261 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-4dd9d9e5-2b8a-44cf-bc2b-d5c001609e4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d5ad94aabbe4666ac3f24dbc8a96fec'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:08.745807 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-4dd9d9e5-2b8a-44cf-bc2b-d5c001609e4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d5ad94aabbe4666ac3f24dbc8a96fec'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:08.746440 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-4dd9d9e5-2b8a-44cf-bc2b-d5c001609e4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d5ad94aabbe4666ac3f24dbc8a96fec'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:08.765792 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1270/2539] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:47:08 2022] DELETE /identity/v3/users/5d5ad94aabbe4666ac3f24dbc8a96fec => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:47:08.770191 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a488197-fb9f-488f-8067-152dea91759d None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:08.770672 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a488197-fb9f-488f-8067-152dea91759d None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:08.770786 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a488197-fb9f-488f-8067-152dea91759d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:08.790741 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-8a488197-fb9f-488f-8067-152dea91759d None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:47:08.791976 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-8a488197-fb9f-488f-8067-152dea91759d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:08.850932 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1270/2540] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:47:08.860760 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9d9e5-2b8a-44cf-bc2b-d5c001609e4e admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:08.862140 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-4dd9d9e5-2b8a-44cf-bc2b-d5c001609e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:08.919740 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9d9e5-2b8a-44cf-bc2b-d5c001609e4e admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:08.923347 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbb4b6-31c8-462f-be85-731b89f0b8e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:08.923943 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbb4b6-31c8-462f-be85-731b89f0b8e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:08.924220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbb4b6-31c8-462f-be85-731b89f0b8e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:08.924491 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbb4b6-31c8-462f-be85-731b89f0b8e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:08.933399 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbb4b6-31c8-462f-be85-731b89f0b8e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:08.934837 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbb4b6-31c8-462f-be85-731b89f0b8e7 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:08.944682 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1271/2541] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:47:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:47:09.427381 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a488197-fb9f-488f-8067-152dea91759d None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:09.429110 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-8a488197-fb9f-488f-8067-152dea91759d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:09.441454 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a488197-fb9f-488f-8067-152dea91759d None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:09.446411 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad106a-d332-483e-858f-e4750d964464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:09.447067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad106a-d332-483e-858f-e4750d964464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:09.447344 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad106a-d332-483e-858f-e4750d964464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:09.447616 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad106a-d332-483e-858f-e4750d964464 admin admin] PATH_INFO: `/v3/projects/4b9133b94c7f432fba6879796645a333` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:09.448733 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad106a-d332-483e-858f-e4750d964464 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b9133b94c7f432fba6879796645a333)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:09.450637 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad106a-d332-483e-858f-e4750d964464 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:09.550123 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c7ad106a-d332-483e-858f-e4750d964464 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b9133b94c7f432fba6879796645a333', 'request_id': 'req-c7ad106a-d332-483e-858f-e4750d964464'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:09.555960 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c7ad106a-d332-483e-858f-e4750d964464 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b9133b94c7f432fba6879796645a333', 'request_id': 'req-c7ad106a-d332-483e-858f-e4750d964464'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:09.646858 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c7ad106a-d332-483e-858f-e4750d964464 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b9133b94c7f432fba6879796645a333', 'request_id': 'req-c7ad106a-d332-483e-858f-e4750d964464'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:09.659101 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c7ad106a-d332-483e-858f-e4750d964464 admin admin] The token cache is being invalidate because project 4b9133b94c7f432fba6879796645a333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:47:09.659391 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c7ad106a-d332-483e-858f-e4750d964464 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:09.660017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-c7ad106a-d332-483e-858f-e4750d964464 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:09.661519 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1271/2542] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:47:09 2022] DELETE /identity/v3/projects/4b9133b94c7f432fba6879796645a333 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:47:09.665456 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbb4b6-31c8-462f-be85-731b89f0b8e7 service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:09.676311 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbb4b6-31c8-462f-be85-731b89f0b8e7 service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:09.733490 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454640a8-05e7-4fe7-b86f-ff8264a272e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:09.734121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454640a8-05e7-4fe7-b86f-ff8264a272e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:09.734395 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454640a8-05e7-4fe7-b86f-ff8264a272e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:09.734664 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454640a8-05e7-4fe7-b86f-ff8264a272e3 admin admin] PATH_INFO: `/v3/users/b9c8596eb8464c4db3c756e3bc9d9380` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:09.735814 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454640a8-05e7-4fe7-b86f-ff8264a272e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9c8596eb8464c4db3c756e3bc9d9380)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:09.737733 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454640a8-05e7-4fe7-b86f-ff8264a272e3 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:09.969301 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-454640a8-05e7-4fe7-b86f-ff8264a272e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9c8596eb8464c4db3c756e3bc9d9380'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:09.969882 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-454640a8-05e7-4fe7-b86f-ff8264a272e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9c8596eb8464c4db3c756e3bc9d9380'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:10.040859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-454640a8-05e7-4fe7-b86f-ff8264a272e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9c8596eb8464c4db3c756e3bc9d9380'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:10.048576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-454640a8-05e7-4fe7-b86f-ff8264a272e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9c8596eb8464c4db3c756e3bc9d9380'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:10.049201 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-454640a8-05e7-4fe7-b86f-ff8264a272e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9c8596eb8464c4db3c756e3bc9d9380'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:10.053692 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:47:10.067854 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1272/2543] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:47:09 2022] DELETE /identity/v3/users/b9c8596eb8464c4db3c756e3bc9d9380 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:47:10.476620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad106a-d332-483e-858f-e4750d964464 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:10.484429 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-c7ad106a-d332-483e-858f-e4750d964464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:10.492914 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad106a-d332-483e-858f-e4750d964464 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:10.541058 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:47:10.551888 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686af41a-7c38-4218-8838-04e37154f2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:10.552552 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686af41a-7c38-4218-8838-04e37154f2d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:10.552829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686af41a-7c38-4218-8838-04e37154f2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:10.553100 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686af41a-7c38-4218-8838-04e37154f2d4 admin admin] PATH_INFO: `/v3/projects/34a315b94975485380840ed27de1ccbf` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:10.554254 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686af41a-7c38-4218-8838-04e37154f2d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34a315b94975485380840ed27de1ccbf)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:10.556181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686af41a-7c38-4218-8838-04e37154f2d4 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:10.652885 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-686af41a-7c38-4218-8838-04e37154f2d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34a315b94975485380840ed27de1ccbf', 'request_id': 'req-686af41a-7c38-4218-8838-04e37154f2d4'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:10.659421 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-686af41a-7c38-4218-8838-04e37154f2d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34a315b94975485380840ed27de1ccbf', 'request_id': 'req-686af41a-7c38-4218-8838-04e37154f2d4'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:10.726561 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-686af41a-7c38-4218-8838-04e37154f2d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34a315b94975485380840ed27de1ccbf', 'request_id': 'req-686af41a-7c38-4218-8838-04e37154f2d4'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:10.738730 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-686af41a-7c38-4218-8838-04e37154f2d4 admin admin] The token cache is being invalidate because project 34a315b94975485380840ed27de1ccbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:47:10.739050 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-686af41a-7c38-4218-8838-04e37154f2d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:10.739705 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-686af41a-7c38-4218-8838-04e37154f2d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:10.741190 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1272/2544] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:47:10 2022] DELETE /identity/v3/projects/34a315b94975485380840ed27de1ccbf => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:47:10.746324 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5feb2-d2b2-4d62-81e9-e2c81234008f None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:10.746800 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5feb2-d2b2-4d62-81e9-e2c81234008f None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:10.746800 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5feb2-d2b2-4d62-81e9-e2c81234008f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:10.766702 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-bfd5feb2-d2b2-4d62-81e9-e2c81234008f None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:47:10.767940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-bfd5feb2-d2b2-4d62-81e9-e2c81234008f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:10.826911 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1273/2545] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:47:10.836173 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea166b-ea4e-40d6-a6ed-ad92205e766b None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:10.836475 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea166b-ea4e-40d6-a6ed-ad92205e766b None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:10.836751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea166b-ea4e-40d6-a6ed-ad92205e766b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:10.857223 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-2dea166b-ea4e-40d6-a6ed-ad92205e766b None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:47:10.858508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-2dea166b-ea4e-40d6-a6ed-ad92205e766b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:10.866489 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1273/2546] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:47:10.870552 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5feb2-d2b2-4d62-81e9-e2c81234008f None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:10.880480 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5feb2-d2b2-4d62-81e9-e2c81234008f None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:10.885019 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c564d0-b20c-4d3f-b2f1-76410b0e77d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:10.885601 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c564d0-b20c-4d3f-b2f1-76410b0e77d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:10.885873 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c564d0-b20c-4d3f-b2f1-76410b0e77d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:10.886134 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c564d0-b20c-4d3f-b2f1-76410b0e77d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:10.886763 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c564d0-b20c-4d3f-b2f1-76410b0e77d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:47:10.887091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c564d0-b20c-4d3f-b2f1-76410b0e77d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:10.889187 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c564d0-b20c-4d3f-b2f1-76410b0e77d9 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:10.900678 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1274/2547] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:47:10.905432 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea166b-ea4e-40d6-a6ed-ad92205e766b None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:10.914958 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea166b-ea4e-40d6-a6ed-ad92205e766b None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:10.919668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346da1c-a9e7-4558-b84f-5bf739f8f60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:10.920624 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346da1c-a9e7-4558-b84f-5bf739f8f60a admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:10.920894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346da1c-a9e7-4558-b84f-5bf739f8f60a admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:10.921171 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346da1c-a9e7-4558-b84f-5bf739f8f60a admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:10.921816 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346da1c-a9e7-4558-b84f-5bf739f8f60a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:10.923760 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346da1c-a9e7-4558-b84f-5bf739f8f60a admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:11.048752 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1274/2548] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:47:10 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:47:11.052886 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c564d0-b20c-4d3f-b2f1-76410b0e77d9 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:11.063621 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c564d0-b20c-4d3f-b2f1-76410b0e77d9 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:11.119822 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4118837-cd44-4fe6-8ce9-d5201b3beac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:11.120427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4118837-cd44-4fe6-8ce9-d5201b3beac8 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:11.120708 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4118837-cd44-4fe6-8ce9-d5201b3beac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:11.120982 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4118837-cd44-4fe6-8ce9-d5201b3beac8 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:11.121600 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4118837-cd44-4fe6-8ce9-d5201b3beac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:11.124191 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4118837-cd44-4fe6-8ce9-d5201b3beac8 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:11.190462 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1275/2549] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:47:11 2022] POST /identity/v3/users => generated 286 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:47:11.194501 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346da1c-a9e7-4558-b84f-5bf739f8f60a admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:11.205857 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346da1c-a9e7-4558-b84f-5bf739f8f60a admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:11.210933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fd2d3-425c-48cf-842c-e1f67827b976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:11.211527 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fd2d3-425c-48cf-842c-e1f67827b976 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:11.211808 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fd2d3-425c-48cf-842c-e1f67827b976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:11.212113 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fd2d3-425c-48cf-842c-e1f67827b976 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:11.212752 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4fd2d3-425c-48cf-842c-e1f67827b976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:11.214343 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4fd2d3-425c-48cf-842c-e1f67827b976 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:11.227278 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1275/2550] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:47:11.228888 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4118837-cd44-4fe6-8ce9-d5201b3beac8 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:11.239159 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4118837-cd44-4fe6-8ce9-d5201b3beac8 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:11.243820 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff55ed3-42fb-408c-bcc3-a17dac5041f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:11.244406 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff55ed3-42fb-408c-bcc3-a17dac5041f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:11.244682 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff55ed3-42fb-408c-bcc3-a17dac5041f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:11.244954 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff55ed3-42fb-408c-bcc3-a17dac5041f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:11.245588 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff55ed3-42fb-408c-bcc3-a17dac5041f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:11.247220 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff55ed3-42fb-408c-bcc3-a17dac5041f5 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:11.258630 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1276/2551] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:47:11.262593 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fd2d3-425c-48cf-842c-e1f67827b976 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:11.273414 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fd2d3-425c-48cf-842c-e1f67827b976 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:11.278039 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a0185-fe06-49d5-9102-a7f54f0cc12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:11.278686 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a0185-fe06-49d5-9102-a7f54f0cc12e admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:11.279515 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a0185-fe06-49d5-9102-a7f54f0cc12e admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:11.279515 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a0185-fe06-49d5-9102-a7f54f0cc12e admin admin] PATH_INFO: `/v3/projects/05a5802322a848c69b596ae66813f9c9/users/cd795b4c42bc44ee9c50d49b5f9a7313/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:11.294049 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a0185-fe06-49d5-9102-a7f54f0cc12e admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a5802322a848c69b596ae66813f9c9, user_id=cd795b4c42bc44ee9c50d49b5f9a7313, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:11.297531 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a0185-fe06-49d5-9102-a7f54f0cc12e admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:11.407435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1276/2552] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:47:11 2022] PUT /identity/v3/projects/05a5802322a848c69b596ae66813f9c9/users/cd795b4c42bc44ee9c50d49b5f9a7313/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:47:11.412660 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc360a4-8ed9-4bee-ad50-9775b678b3ec None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:11.412944 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc360a4-8ed9-4bee-ad50-9775b678b3ec None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:11.413243 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc360a4-8ed9-4bee-ad50-9775b678b3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:11.432883 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-1bc360a4-8ed9-4bee-ad50-9775b678b3ec None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:47:11.434232 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-1bc360a4-8ed9-4bee-ad50-9775b678b3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:11.480289 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:47:11.494956 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1277/2553] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:47:11.505410 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a0185-fe06-49d5-9102-a7f54f0cc12e admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:11.507276 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-4d7a0185-fe06-49d5-9102-a7f54f0cc12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:11.565732 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a0185-fe06-49d5-9102-a7f54f0cc12e admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:11.569406 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5d984-77dc-4ef7-a42b-2d7d7853b5af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:11.570006 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5d984-77dc-4ef7-a42b-2d7d7853b5af service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:11.570289 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5d984-77dc-4ef7-a42b-2d7d7853b5af service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:11.570561 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5d984-77dc-4ef7-a42b-2d7d7853b5af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:11.580250 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5d984-77dc-4ef7-a42b-2d7d7853b5af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:11.581669 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5d984-77dc-4ef7-a42b-2d7d7853b5af service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:11.591021 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1277/2554] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:47:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:47:12.689230 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb0fde-7497-4241-8d00-86c77a56bb9f None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:12.689684 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb0fde-7497-4241-8d00-86c77a56bb9f None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:12.689914 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb0fde-7497-4241-8d00-86c77a56bb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:12.719361 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-3fbb0fde-7497-4241-8d00-86c77a56bb9f None None] MFA Rules not processed for user `cd795b4c42bc44ee9c50d49b5f9a7313`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:47:12.720669 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-3fbb0fde-7497-4241-8d00-86c77a56bb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:12.790771 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1278/2555] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:47:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:47:12.794334 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5d984-77dc-4ef7-a42b-2d7d7853b5af service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:12.805218 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5d984-77dc-4ef7-a42b-2d7d7853b5af service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:12.810010 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191057e-436c-4199-9400-17dad471c452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:12.811280 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191057e-436c-4199-9400-17dad471c452 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:12.811843 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191057e-436c-4199-9400-17dad471c452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:12.811843 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191057e-436c-4199-9400-17dad471c452 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:12.812422 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d191057e-436c-4199-9400-17dad471c452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:12.814327 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d191057e-436c-4199-9400-17dad471c452 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:12.881162 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:47:12.888137 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1278/2556] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:47:12 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:47:12.892526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb0fde-7497-4241-8d00-86c77a56bb9f None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:12.903319 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb0fde-7497-4241-8d00-86c77a56bb9f None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:12.961093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fd844-3d92-4860-9dc3-3acda05f19c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:12.961697 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fd844-3d92-4860-9dc3-3acda05f19c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:12.961975 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fd844-3d92-4860-9dc3-3acda05f19c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:12.962245 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fd844-3d92-4860-9dc3-3acda05f19c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:12.962912 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375fd844-3d92-4860-9dc3-3acda05f19c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:12.964938 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375fd844-3d92-4860-9dc3-3acda05f19c8 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:13.069447 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1279/2557] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:47:12 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:47:13.073247 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191057e-436c-4199-9400-17dad471c452 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:13.084609 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191057e-436c-4199-9400-17dad471c452 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:13.089267 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fabaf-5a04-4b38-8910-aeef5b07c5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:13.089851 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fabaf-5a04-4b38-8910-aeef5b07c5dc admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:13.090130 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fabaf-5a04-4b38-8910-aeef5b07c5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:13.090408 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fabaf-5a04-4b38-8910-aeef5b07c5dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:13.091091 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392fabaf-5a04-4b38-8910-aeef5b07c5dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:13.093106 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392fabaf-5a04-4b38-8910-aeef5b07c5dc admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:13.103659 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1279/2558] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:47:13.108559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fd844-3d92-4860-9dc3-3acda05f19c8 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:13.118603 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fd844-3d92-4860-9dc3-3acda05f19c8 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:13.123954 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61556b40-d98a-40e2-8a47-0a251d1ec914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:13.124789 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61556b40-d98a-40e2-8a47-0a251d1ec914 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:13.125066 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61556b40-d98a-40e2-8a47-0a251d1ec914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:13.125340 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61556b40-d98a-40e2-8a47-0a251d1ec914 admin admin] PATH_INFO: `/v3/projects/3a324287ff4a4f3784bc680312f4ec0b/users/1cab607be6434555a6eaff25fafc4fb3/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:13.140007 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61556b40-d98a-40e2-8a47-0a251d1ec914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a324287ff4a4f3784bc680312f4ec0b, user_id=1cab607be6434555a6eaff25fafc4fb3, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:13.142675 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61556b40-d98a-40e2-8a47-0a251d1ec914 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:13.218683 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1280/2559] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:47:13 2022] PUT /identity/v3/projects/3a324287ff4a4f3784bc680312f4ec0b/users/1cab607be6434555a6eaff25fafc4fb3/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:47:13.222703 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fabaf-5a04-4b38-8910-aeef5b07c5dc admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:13.233955 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fabaf-5a04-4b38-8910-aeef5b07c5dc admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:13.289870 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9b66d-6c33-4ae2-8060-e21af2a3d32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:13.290469 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9b66d-6c33-4ae2-8060-e21af2a3d32d admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:13.290744 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9b66d-6c33-4ae2-8060-e21af2a3d32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:13.291045 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9b66d-6c33-4ae2-8060-e21af2a3d32d admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:13.291680 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9b66d-6c33-4ae2-8060-e21af2a3d32d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:13.293245 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9b66d-6c33-4ae2-8060-e21af2a3d32d admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:13.303742 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1280/2560] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:47:13.307939 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61556b40-d98a-40e2-8a47-0a251d1ec914 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:13.318878 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61556b40-d98a-40e2-8a47-0a251d1ec914 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:13.323447 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed70a0-27de-4b1a-be55-eb3577e316e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:13.324021 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed70a0-27de-4b1a-be55-eb3577e316e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:13.324292 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed70a0-27de-4b1a-be55-eb3577e316e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:13.324558 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed70a0-27de-4b1a-be55-eb3577e316e3 admin admin] PATH_INFO: `/v3/projects/3a324287ff4a4f3784bc680312f4ec0b/users/1cab607be6434555a6eaff25fafc4fb3/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:13.326953 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed70a0-27de-4b1a-be55-eb3577e316e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a324287ff4a4f3784bc680312f4ec0b, user_id=1cab607be6434555a6eaff25fafc4fb3, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:13.329865 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed70a0-27de-4b1a-be55-eb3577e316e3 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:13.340098 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1281/2561] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:47:13 2022] PUT /identity/v3/projects/3a324287ff4a4f3784bc680312f4ec0b/users/1cab607be6434555a6eaff25fafc4fb3/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:47:14.602124 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600fd70-21f0-4b6e-a0a4-249d1cde13e7 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:14.602681 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600fd70-21f0-4b6e-a0a4-249d1cde13e7 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:14.602681 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600fd70-21f0-4b6e-a0a4-249d1cde13e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:14.633217 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-7600fd70-21f0-4b6e-a0a4-249d1cde13e7 None None] MFA Rules not processed for user `1cab607be6434555a6eaff25fafc4fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:47:14.634484 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-7600fd70-21f0-4b6e-a0a4-249d1cde13e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:14.708000 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1281/2562] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:47:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:47:14.720013 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b93e6e-1218-4976-ab53-0d1f1acda051 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:14.720572 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b93e6e-1218-4976-ab53-0d1f1acda051 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:14.720572 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b93e6e-1218-4976-ab53-0d1f1acda051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:14.742266 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-78b93e6e-1218-4976-ab53-0d1f1acda051 None None] MFA Rules not processed for user `cd795b4c42bc44ee9c50d49b5f9a7313`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:47:14.743512 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-78b93e6e-1218-4976-ab53-0d1f1acda051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:14.772524 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:47:14.799621 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1282/2563] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:47:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:47:14.811457 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600fd70-21f0-4b6e-a0a4-249d1cde13e7 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:14.812817 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-7600fd70-21f0-4b6e-a0a4-249d1cde13e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:14.886484 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600fd70-21f0-4b6e-a0a4-249d1cde13e7 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:14.892121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242af56c-08fa-4d89-ab6d-87dbde8784a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:14.892722 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242af56c-08fa-4d89-ab6d-87dbde8784a2 service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:14.893000 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242af56c-08fa-4d89-ab6d-87dbde8784a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:14.893271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242af56c-08fa-4d89-ab6d-87dbde8784a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:14.897867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:47:14.901510 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242af56c-08fa-4d89-ab6d-87dbde8784a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:14.903135 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242af56c-08fa-4d89-ab6d-87dbde8784a2 service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:14.912490 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1282/2564] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:47:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:47:24.829806 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=10 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:47:24.926515 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:47:31.010214 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b93e6e-1218-4976-ab53-0d1f1acda051 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:31.011648 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-78b93e6e-1218-4976-ab53-0d1f1acda051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:31.068981 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b93e6e-1218-4976-ab53-0d1f1acda051 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:31.072585 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad22eb-cf2e-4aff-b48c-c09ccbe1cf10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:31.073179 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad22eb-cf2e-4aff-b48c-c09ccbe1cf10 service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:31.073451 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad22eb-cf2e-4aff-b48c-c09ccbe1cf10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:31.073715 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad22eb-cf2e-4aff-b48c-c09ccbe1cf10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:31.083611 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad22eb-cf2e-4aff-b48c-c09ccbe1cf10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:31.085025 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad22eb-cf2e-4aff-b48c-c09ccbe1cf10 service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:31.094301 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1283/2565] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:47:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:47:41.090216 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=26 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:47:53.842001 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242af56c-08fa-4d89-ab6d-87dbde8784a2 service nova] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:53.843478 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-242af56c-08fa-4d89-ab6d-87dbde8784a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:53.921291 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242af56c-08fa-4d89-ab6d-87dbde8784a2 service nova] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:53.927128 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ada86-13e9-4443-b8ef-d2db91357009 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66b9bc695b44877a06f17ea6bbeb27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:53.927737 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ada86-13e9-4443-b8ef-d2db91357009 service placement] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:53.928020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ada86-13e9-4443-b8ef-d2db91357009 service placement] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:53.928296 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ada86-13e9-4443-b8ef-d2db91357009 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:53.930105 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-b00ada86-13e9-4443-b8ef-d2db91357009 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:53.945484 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad22eb-cf2e-4aff-b48c-c09ccbe1cf10 service cinder] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:53.947598 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ada86-13e9-4443-b8ef-d2db91357009 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:53.949499 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ada86-13e9-4443-b8ef-d2db91357009 service placement] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:53.966020 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1283/2566] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:47:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:47:54.013166 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad22eb-cf2e-4aff-b48c-c09ccbe1cf10 service cinder] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:54.017619 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d6566-0178-434b-b888-97441776d742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:54.019005 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d6566-0178-434b-b888-97441776d742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:54.019284 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d6566-0178-434b-b888-97441776d742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:54.019550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d6566-0178-434b-b888-97441776d742 admin admin] PATH_INFO: `/v3/users/cd795b4c42bc44ee9c50d49b5f9a7313` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:54.020670 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d6566-0178-434b-b888-97441776d742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd795b4c42bc44ee9c50d49b5f9a7313)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:54.022642 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d6566-0178-434b-b888-97441776d742 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:54.156695 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-375d6566-0178-434b-b888-97441776d742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd795b4c42bc44ee9c50d49b5f9a7313'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:54.157341 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-375d6566-0178-434b-b888-97441776d742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd795b4c42bc44ee9c50d49b5f9a7313'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:54.223320 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-375d6566-0178-434b-b888-97441776d742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd795b4c42bc44ee9c50d49b5f9a7313'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:54.230874 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-375d6566-0178-434b-b888-97441776d742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd795b4c42bc44ee9c50d49b5f9a7313'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:54.231554 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-375d6566-0178-434b-b888-97441776d742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd795b4c42bc44ee9c50d49b5f9a7313'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:54.249681 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1284/2567] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:47:53 2022] DELETE /identity/v3/users/cd795b4c42bc44ee9c50d49b5f9a7313 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 02:47:54.492760 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ada86-13e9-4443-b8ef-d2db91357009 service placement] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:54.506145 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ada86-13e9-4443-b8ef-d2db91357009 service placement] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:54.564551 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a45735-532f-4b02-a6ed-bbe0bc8ee77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:54.565736 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a45735-532f-4b02-a6ed-bbe0bc8ee77d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:54.566025 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a45735-532f-4b02-a6ed-bbe0bc8ee77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:54.566307 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a45735-532f-4b02-a6ed-bbe0bc8ee77d admin admin] PATH_INFO: `/v3/projects/05a5802322a848c69b596ae66813f9c9` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:54.567448 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a45735-532f-4b02-a6ed-bbe0bc8ee77d admin admin] RBAC: Authorizing `identity:delete_project(project_id=05a5802322a848c69b596ae66813f9c9)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:54.569359 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a45735-532f-4b02-a6ed-bbe0bc8ee77d admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:54.709400 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-f2a45735-532f-4b02-a6ed-bbe0bc8ee77d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a5802322a848c69b596ae66813f9c9', 'request_id': 'req-f2a45735-532f-4b02-a6ed-bbe0bc8ee77d'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:54.714947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-f2a45735-532f-4b02-a6ed-bbe0bc8ee77d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a5802322a848c69b596ae66813f9c9', 'request_id': 'req-f2a45735-532f-4b02-a6ed-bbe0bc8ee77d'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:54.805741 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-f2a45735-532f-4b02-a6ed-bbe0bc8ee77d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a5802322a848c69b596ae66813f9c9', 'request_id': 'req-f2a45735-532f-4b02-a6ed-bbe0bc8ee77d'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:54.821456 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-f2a45735-532f-4b02-a6ed-bbe0bc8ee77d admin admin] The token cache is being invalidate because project 05a5802322a848c69b596ae66813f9c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:47:54.821456 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-f2a45735-532f-4b02-a6ed-bbe0bc8ee77d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:54.821456 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-f2a45735-532f-4b02-a6ed-bbe0bc8ee77d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:54.821456 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1284/2568] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:47:54 2022] DELETE /identity/v3/projects/05a5802322a848c69b596ae66813f9c9 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:47:54.824677 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d6566-0178-434b-b888-97441776d742 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:54.826078 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-375d6566-0178-434b-b888-97441776d742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:54.839525 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d6566-0178-434b-b888-97441776d742 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:54.894716 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8166fa-7860-4277-a288-0586d74ef9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:54.895387 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8166fa-7860-4277-a288-0586d74ef9fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:54.895666 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8166fa-7860-4277-a288-0586d74ef9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:54.895943 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8166fa-7860-4277-a288-0586d74ef9fe admin admin] PATH_INFO: `/v3/users/1cab607be6434555a6eaff25fafc4fb3` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:54.897082 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8166fa-7860-4277-a288-0586d74ef9fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cab607be6434555a6eaff25fafc4fb3)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:54.899040 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8166fa-7860-4277-a288-0586d74ef9fe admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:54.919931 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:47:55.175404 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-5e8166fa-7860-4277-a288-0586d74ef9fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cab607be6434555a6eaff25fafc4fb3'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:55.176065 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-5e8166fa-7860-4277-a288-0586d74ef9fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cab607be6434555a6eaff25fafc4fb3'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:55.245519 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-5e8166fa-7860-4277-a288-0586d74ef9fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cab607be6434555a6eaff25fafc4fb3'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:55.253617 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-5e8166fa-7860-4277-a288-0586d74ef9fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cab607be6434555a6eaff25fafc4fb3'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:55.254252 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-5e8166fa-7860-4277-a288-0586d74ef9fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cab607be6434555a6eaff25fafc4fb3'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:55.271735 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1285/2569] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:47:54 2022] DELETE /identity/v3/users/1cab607be6434555a6eaff25fafc4fb3 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:47:55.481331 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a45735-532f-4b02-a6ed-bbe0bc8ee77d admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:55.482788 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-f2a45735-532f-4b02-a6ed-bbe0bc8ee77d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:55.496752 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a45735-532f-4b02-a6ed-bbe0bc8ee77d admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:55.514463 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:47:55.556264 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd13b3-a0b6-412c-9565-2c0fea32e6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:55.556901 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd13b3-a0b6-412c-9565-2c0fea32e6db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:55.557181 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd13b3-a0b6-412c-9565-2c0fea32e6db admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:55.557454 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd13b3-a0b6-412c-9565-2c0fea32e6db admin admin] PATH_INFO: `/v3/projects/3a324287ff4a4f3784bc680312f4ec0b` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:55.558620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd13b3-a0b6-412c-9565-2c0fea32e6db admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a324287ff4a4f3784bc680312f4ec0b)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:55.560754 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd13b3-a0b6-412c-9565-2c0fea32e6db admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:55.651921 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-90fd13b3-a0b6-412c-9565-2c0fea32e6db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a324287ff4a4f3784bc680312f4ec0b', 'request_id': 'req-90fd13b3-a0b6-412c-9565-2c0fea32e6db'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:55.657429 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-90fd13b3-a0b6-412c-9565-2c0fea32e6db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a324287ff4a4f3784bc680312f4ec0b', 'request_id': 'req-90fd13b3-a0b6-412c-9565-2c0fea32e6db'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:55.737725 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-90fd13b3-a0b6-412c-9565-2c0fea32e6db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a324287ff4a4f3784bc680312f4ec0b', 'request_id': 'req-90fd13b3-a0b6-412c-9565-2c0fea32e6db'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:55.749412 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-90fd13b3-a0b6-412c-9565-2c0fea32e6db admin admin] The token cache is being invalidate because project 3a324287ff4a4f3784bc680312f4ec0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:47:55.749704 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-90fd13b3-a0b6-412c-9565-2c0fea32e6db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:55.750359 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-90fd13b3-a0b6-412c-9565-2c0fea32e6db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:47:55.751949 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1285/2570] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:47:55 2022] DELETE /identity/v3/projects/3a324287ff4a4f3784bc680312f4ec0b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:47:55.756819 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a7913-2cb9-4744-b960-da1fc8ad80ba None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:55.757104 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a7913-2cb9-4744-b960-da1fc8ad80ba None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:55.757375 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a7913-2cb9-4744-b960-da1fc8ad80ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:55.777679 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-2b5a7913-2cb9-4744-b960-da1fc8ad80ba None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:47:55.781859 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-2b5a7913-2cb9-4744-b960-da1fc8ad80ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:55.841027 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1286/2571] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:47:55.849428 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d07a6-d58d-45dd-8810-dd88b5a7d1fe None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:55.849769 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d07a6-d58d-45dd-8810-dd88b5a7d1fe None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:55.850053 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d07a6-d58d-45dd-8810-dd88b5a7d1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:55.870391 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-663d07a6-d58d-45dd-8810-dd88b5a7d1fe None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:47:55.871612 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-663d07a6-d58d-45dd-8810-dd88b5a7d1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:55.881025 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1286/2572] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:47:55.885410 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a7913-2cb9-4744-b960-da1fc8ad80ba None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:55.896371 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a7913-2cb9-4744-b960-da1fc8ad80ba None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:55.900912 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4dbcb-a5dd-4d60-b8d9-b38499edfab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:55.901501 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4dbcb-a5dd-4d60-b8d9-b38499edfab0 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:55.901779 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4dbcb-a5dd-4d60-b8d9-b38499edfab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:55.902052 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4dbcb-a5dd-4d60-b8d9-b38499edfab0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:55.902695 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4dbcb-a5dd-4d60-b8d9-b38499edfab0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81671) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:47:55.903032 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4dbcb-a5dd-4d60-b8d9-b38499edfab0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:55.904620 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4dbcb-a5dd-4d60-b8d9-b38499edfab0 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:55.916055 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1287/2573] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:47:55.920191 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d07a6-d58d-45dd-8810-dd88b5a7d1fe None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:55.929484 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d07a6-d58d-45dd-8810-dd88b5a7d1fe None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:55.934134 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff396c-6463-4f4f-a557-27f0ffb99261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:55.934720 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff396c-6463-4f4f-a557-27f0ffb99261 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:55.935029 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff396c-6463-4f4f-a557-27f0ffb99261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:55.935305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff396c-6463-4f4f-a557-27f0ffb99261 admin admin] PATH_INFO: `/v3/projects` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:55.935938 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff396c-6463-4f4f-a557-27f0ffb99261 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:55.937829 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff396c-6463-4f4f-a557-27f0ffb99261 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:56.007184 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1287/2574] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:47:55 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:47:56.011038 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4dbcb-a5dd-4d60-b8d9-b38499edfab0 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:56.021602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4dbcb-a5dd-4d60-b8d9-b38499edfab0 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:56.077216 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c731afb-a2c9-4680-929b-43f8226790cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:56.077821 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c731afb-a2c9-4680-929b-43f8226790cb admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:56.078378 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c731afb-a2c9-4680-929b-43f8226790cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:56.078660 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c731afb-a2c9-4680-929b-43f8226790cb admin admin] PATH_INFO: `/v3/users` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:56.079321 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c731afb-a2c9-4680-929b-43f8226790cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:56.082015 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c731afb-a2c9-4680-929b-43f8226790cb admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:56.142383 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1288/2575] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:47:56 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:47:56.147320 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff396c-6463-4f4f-a557-27f0ffb99261 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:56.157798 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff396c-6463-4f4f-a557-27f0ffb99261 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:56.162752 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab209292-82ea-49f3-ad41-c30a6bc7b376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:56.165465 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab209292-82ea-49f3-ad41-c30a6bc7b376 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:56.165465 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab209292-82ea-49f3-ad41-c30a6bc7b376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:56.165465 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab209292-82ea-49f3-ad41-c30a6bc7b376 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:56.165465 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab209292-82ea-49f3-ad41-c30a6bc7b376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:56.166161 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab209292-82ea-49f3-ad41-c30a6bc7b376 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:56.176900 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1288/2576] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:47:56.180746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c731afb-a2c9-4680-929b-43f8226790cb admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:56.191911 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c731afb-a2c9-4680-929b-43f8226790cb admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:56.196469 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41867087-66bd-4aa1-827c-fcfd7f93b034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:56.197047 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41867087-66bd-4aa1-827c-fcfd7f93b034 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:56.197321 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41867087-66bd-4aa1-827c-fcfd7f93b034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:56.197588 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41867087-66bd-4aa1-827c-fcfd7f93b034 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:56.198218 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41867087-66bd-4aa1-827c-fcfd7f93b034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:56.199825 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41867087-66bd-4aa1-827c-fcfd7f93b034 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:56.211074 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1289/2577] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:47:56.215199 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab209292-82ea-49f3-ad41-c30a6bc7b376 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:56.225689 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab209292-82ea-49f3-ad41-c30a6bc7b376 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:56.230332 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e94c12-d615-4a49-8486-2772bf7d33f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:56.231017 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e94c12-d615-4a49-8486-2772bf7d33f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:56.231293 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e94c12-d615-4a49-8486-2772bf7d33f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:56.231592 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e94c12-d615-4a49-8486-2772bf7d33f5 admin admin] PATH_INFO: `/v3/projects/d043e782430246d4bf2ba19efd36b443/users/a1a2de663f8d4933a7661b4c1dd9a641/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:56.246839 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e94c12-d615-4a49-8486-2772bf7d33f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d043e782430246d4bf2ba19efd36b443, user_id=a1a2de663f8d4933a7661b4c1dd9a641, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:56.249493 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e94c12-d615-4a49-8486-2772bf7d33f5 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:56.308080 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1289/2578] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:47:56 2022] PUT /identity/v3/projects/d043e782430246d4bf2ba19efd36b443/users/a1a2de663f8d4933a7661b4c1dd9a641/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:47:56.312997 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350d1df-d4b4-4248-b699-ae121fc85815 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:56.313292 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350d1df-d4b4-4248-b699-ae121fc85815 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:56.313697 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350d1df-d4b4-4248-b699-ae121fc85815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:56.322707 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:47:56.333886 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-f350d1df-d4b4-4248-b699-ae121fc85815 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:47:56.335107 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-f350d1df-d4b4-4248-b699-ae121fc85815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:56.395994 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1290/2579] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:47:56.405488 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e94c12-d615-4a49-8486-2772bf7d33f5 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:56.407189 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-34e94c12-d615-4a49-8486-2772bf7d33f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:56.459083 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:47:56.464171 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e94c12-d615-4a49-8486-2772bf7d33f5 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:56.467849 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbc6d4-220c-4bc9-b05b-d582638c517d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:56.469109 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbc6d4-220c-4bc9-b05b-d582638c517d service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:56.469109 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbc6d4-220c-4bc9-b05b-d582638c517d service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:56.469109 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbc6d4-220c-4bc9-b05b-d582638c517d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:56.478051 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbc6d4-220c-4bc9-b05b-d582638c517d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:56.479535 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbc6d4-220c-4bc9-b05b-d582638c517d service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:56.489944 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1290/2580] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:47:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:47:57.720466 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c4ea1-d058-4210-9871-4a3229a47d55 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:57.721023 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c4ea1-d058-4210-9871-4a3229a47d55 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:57.721121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c4ea1-d058-4210-9871-4a3229a47d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:57.749969 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-452c4ea1-d058-4210-9871-4a3229a47d55 None None] MFA Rules not processed for user `a1a2de663f8d4933a7661b4c1dd9a641`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:47:57.751268 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-452c4ea1-d058-4210-9871-4a3229a47d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:57.819618 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1291/2581] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:47:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:47:57.830567 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbc6d4-220c-4bc9-b05b-d582638c517d service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:57.832059 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-1bcbc6d4-220c-4bc9-b05b-d582638c517d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:57.888764 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbc6d4-220c-4bc9-b05b-d582638c517d service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:57.892668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49527a61-a6ff-4059-afa5-a766b5a482c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:57.893303 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49527a61-a6ff-4059-afa5-a766b5a482c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:57.893620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49527a61-a6ff-4059-afa5-a766b5a482c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:57.893893 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49527a61-a6ff-4059-afa5-a766b5a482c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:57.902304 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49527a61-a6ff-4059-afa5-a766b5a482c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:57.903759 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49527a61-a6ff-4059-afa5-a766b5a482c4 service cinder] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:57.912412 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1291/2582] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:47:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:47:59.559022 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0283a-1fb1-471f-a45b-35e373034c5b None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:59.559559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0283a-1fb1-471f-a45b-35e373034c5b None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:59.559559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0283a-1fb1-471f-a45b-35e373034c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:59.578836 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-4de0283a-1fb1-471f-a45b-35e373034c5b None None] MFA Rules not processed for user `a1a2de663f8d4933a7661b4c1dd9a641`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:47:59.580014 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-4de0283a-1fb1-471f-a45b-35e373034c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:59.586862 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1292/2583] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:47:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:47:59.625564 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49527a61-a6ff-4059-afa5-a766b5a482c4 service cinder] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:47:59.627036 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-49527a61-a6ff-4059-afa5-a766b5a482c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:59.706220 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49527a61-a6ff-4059-afa5-a766b5a482c4 service cinder] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:47:59.709866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165d0df-31b8-402f-acd8-c8337fe6fd25 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9e8a7a5b8944272a2d1bd2140819ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:47:59.710465 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165d0df-31b8-402f-acd8-c8337fe6fd25 service glance] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:47:59.710741 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165d0df-31b8-402f-acd8-c8337fe6fd25 service glance] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:47:59.712821 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165d0df-31b8-402f-acd8-c8337fe6fd25 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:47:59.712821 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-3165d0df-31b8-402f-acd8-c8337fe6fd25 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:47:59.784813 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165d0df-31b8-402f-acd8-c8337fe6fd25 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:47:59.786249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165d0df-31b8-402f-acd8-c8337fe6fd25 service glance] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:47:59.797620 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1292/2584] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:47:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:48:00.003964 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0283a-1fb1-471f-a45b-35e373034c5b None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:48:00.013958 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0283a-1fb1-471f-a45b-35e373034c5b None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:48:00.017581 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c47c9-77ef-4a0a-9d8f-8c3cfb645d91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:48:00.021559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c47c9-77ef-4a0a-9d8f-8c3cfb645d91 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:48:00.021559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c47c9-77ef-4a0a-9d8f-8c3cfb645d91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:48:00.021559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c47c9-77ef-4a0a-9d8f-8c3cfb645d91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:48:00.021559 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-264c47c9-77ef-4a0a-9d8f-8c3cfb645d91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:48:00.030696 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c47c9-77ef-4a0a-9d8f-8c3cfb645d91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:48:00.032155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c47c9-77ef-4a0a-9d8f-8c3cfb645d91 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:48:00.041112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1293/2585] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:48:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:48:00.441804 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165d0df-31b8-402f-acd8-c8337fe6fd25 service glance] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:48:00.452140 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165d0df-31b8-402f-acd8-c8337fe6fd25 service glance] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:48:00.457870 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d028597-8c17-4ab0-a397-e8b15ed86f71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:48:00.458482 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d028597-8c17-4ab0-a397-e8b15ed86f71 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:48:00.458768 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d028597-8c17-4ab0-a397-e8b15ed86f71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:48:00.459079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d028597-8c17-4ab0-a397-e8b15ed86f71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:48:00.460947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-5d028597-8c17-4ab0-a397-e8b15ed86f71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:48:00.475073 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d028597-8c17-4ab0-a397-e8b15ed86f71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:48:00.479875 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d028597-8c17-4ab0-a397-e8b15ed86f71 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:48:00.482676 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=100 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:48:00.488534 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1293/2586] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:48:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:48:10.037250 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=66 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:48:15.522583 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c47c9-77ef-4a0a-9d8f-8c3cfb645d91 service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:48:15.524100 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-264c47c9-77ef-4a0a-9d8f-8c3cfb645d91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:48:15.541235 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c47c9-77ef-4a0a-9d8f-8c3cfb645d91 service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:48:15.546844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc28b9-b83d-473e-afbf-4f204fe921a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:48:15.547444 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc28b9-b83d-473e-afbf-4f204fe921a0 service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:48:15.547719 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc28b9-b83d-473e-afbf-4f204fe921a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:48:15.550936 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc28b9-b83d-473e-afbf-4f204fe921a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:48:15.550936 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-04fc28b9-b83d-473e-afbf-4f204fe921a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:48:15.562369 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc28b9-b83d-473e-afbf-4f204fe921a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:48:15.564001 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc28b9-b83d-473e-afbf-4f204fe921a0 service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:48:15.575583 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1294/2587] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:48:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 02:48:16.985029 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9c9d0-6d4f-48ef-bf56-020467e3c3ad None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:48:16.985539 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9c9d0-6d4f-48ef-bf56-020467e3c3ad None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:48:16.985645 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9c9d0-6d4f-48ef-bf56-020467e3c3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:48:17.005612 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-96e9c9d0-6d4f-48ef-bf56-020467e3c3ad None None] MFA Rules not processed for user `a1a2de663f8d4933a7661b4c1dd9a641`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:48:17.006803 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-96e9c9d0-6d4f-48ef-bf56-020467e3c3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:48:17.013529 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1294/2588] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:48:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:48:25.571122 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=6 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:48:26.316829 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc28b9-b83d-473e-afbf-4f204fe921a0 service nova] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:48:26.326151 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc28b9-b83d-473e-afbf-4f204fe921a0 service nova] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:48:26.329994 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddee6fa-a9ff-49f2-93bc-54b7aaaad04e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:48:26.330584 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddee6fa-a9ff-49f2-93bc-54b7aaaad04e service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:48:26.330896 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddee6fa-a9ff-49f2-93bc-54b7aaaad04e service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:48:26.331168 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddee6fa-a9ff-49f2-93bc-54b7aaaad04e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:48:26.332885 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-2ddee6fa-a9ff-49f2-93bc-54b7aaaad04e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:48:26.342874 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddee6fa-a9ff-49f2-93bc-54b7aaaad04e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:48:26.344289 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddee6fa-a9ff-49f2-93bc-54b7aaaad04e service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:48:26.352974 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1295/2589] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:48:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:48:26.999490 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:48:35.302993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf7a5e-6d09-4fd8-87c4-0e998c278d3f None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:48:35.303540 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf7a5e-6d09-4fd8-87c4-0e998c278d3f None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:48:35.303540 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf7a5e-6d09-4fd8-87c4-0e998c278d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:48:35.354079 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-9cdf7a5e-6d09-4fd8-87c4-0e998c278d3f None None] MFA Rules not processed for user `e58cdf090af44b508767e821be2f379f`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:48:35.355326 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-9cdf7a5e-6d09-4fd8-87c4-0e998c278d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:48:35.420697 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1295/2590] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 19 02:48:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:48:35.557413 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddee6fa-a9ff-49f2-93bc-54b7aaaad04e service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:48:35.558898 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-2ddee6fa-a9ff-49f2-93bc-54b7aaaad04e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:48:35.648060 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddee6fa-a9ff-49f2-93bc-54b7aaaad04e service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:48:35.653294 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e136f00-f72c-4874-903e-44a7cfc6df95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906e9835f5c4e709915c6553b41aeff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:48:35.653892 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e136f00-f72c-4874-903e-44a7cfc6df95 service swift] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:48:35.654169 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e136f00-f72c-4874-903e-44a7cfc6df95 service swift] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:48:35.654442 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e136f00-f72c-4874-903e-44a7cfc6df95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:48:35.662529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e136f00-f72c-4874-903e-44a7cfc6df95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:48:35.664582 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e136f00-f72c-4874-903e-44a7cfc6df95 service swift] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:48:35.672602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1296/2591] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 02:48:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:48:45.417887 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=40 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:48:45.669372 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=47 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:48:52.905817 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07501979-784a-4ca9-95c9-64458cd97a4c None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:48:52.906289 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07501979-784a-4ca9-95c9-64458cd97a4c None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:48:52.906400 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07501979-784a-4ca9-95c9-64458cd97a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:48:52.925977 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-07501979-784a-4ca9-95c9-64458cd97a4c None None] MFA Rules not processed for user `e58cdf090af44b508767e821be2f379f`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:48:52.927211 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-07501979-784a-4ca9-95c9-64458cd97a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:48:52.934689 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1296/2592] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 19 02:48:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:48:52.947261 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e136f00-f72c-4874-903e-44a7cfc6df95 service swift] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:48:52.958017 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e136f00-f72c-4874-903e-44a7cfc6df95 service swift] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:48:52.964156 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02841b-8cf1-45a5-8c69-4773fd8ca710 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906e9835f5c4e709915c6553b41aeff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:48:52.964764 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02841b-8cf1-45a5-8c69-4773fd8ca710 service swift] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:48:52.965038 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02841b-8cf1-45a5-8c69-4773fd8ca710 service swift] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:48:52.965306 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02841b-8cf1-45a5-8c69-4773fd8ca710 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:48:52.973164 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02841b-8cf1-45a5-8c69-4773fd8ca710 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:48:52.974759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02841b-8cf1-45a5-8c69-4773fd8ca710 service swift] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:48:52.983067 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1297/2593] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 19 02:48:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 02:48:55.880007 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07501979-784a-4ca9-95c9-64458cd97a4c None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:48:55.891624 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07501979-784a-4ca9-95c9-64458cd97a4c None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:48:55.896871 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9904c-3ff8-4757-af69-bb44056aaf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:48:55.897676 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9904c-3ff8-4757-af69-bb44056aaf8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:48:55.897988 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9904c-3ff8-4757-af69-bb44056aaf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:48:55.898395 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9904c-3ff8-4757-af69-bb44056aaf8d admin admin] PATH_INFO: `/v3/users/a1a2de663f8d4933a7661b4c1dd9a641` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:48:55.899626 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9904c-3ff8-4757-af69-bb44056aaf8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1a2de663f8d4933a7661b4c1dd9a641)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:48:55.901656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9904c-3ff8-4757-af69-bb44056aaf8d admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:48:56.086903 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-f7b9904c-3ff8-4757-af69-bb44056aaf8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1a2de663f8d4933a7661b4c1dd9a641'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:48:56.087497 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-f7b9904c-3ff8-4757-af69-bb44056aaf8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1a2de663f8d4933a7661b4c1dd9a641'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:48:56.169122 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-f7b9904c-3ff8-4757-af69-bb44056aaf8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1a2de663f8d4933a7661b4c1dd9a641'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:48:56.181464 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-f7b9904c-3ff8-4757-af69-bb44056aaf8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1a2de663f8d4933a7661b4c1dd9a641'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:48:56.182093 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-f7b9904c-3ff8-4757-af69-bb44056aaf8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1a2de663f8d4933a7661b4c1dd9a641'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:48:56.194487 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1297/2594] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:48:55 2022] DELETE /identity/v3/users/a1a2de663f8d4933a7661b4c1dd9a641 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:48:56.433889 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02841b-8cf1-45a5-8c69-4773fd8ca710 service swift] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:48:56.445063 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02841b-8cf1-45a5-8c69-4773fd8ca710 service swift] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:48:56.505155 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a8b5d-6405-4a03-91a6-9b221a0d0072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:48:56.505864 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a8b5d-6405-4a03-91a6-9b221a0d0072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:48:56.506127 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a8b5d-6405-4a03-91a6-9b221a0d0072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:48:56.506401 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a8b5d-6405-4a03-91a6-9b221a0d0072 admin admin] PATH_INFO: `/v3/projects/d043e782430246d4bf2ba19efd36b443` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:48:56.507541 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a8b5d-6405-4a03-91a6-9b221a0d0072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d043e782430246d4bf2ba19efd36b443)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:48:56.510151 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a8b5d-6405-4a03-91a6-9b221a0d0072 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:48:56.679358 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-f16a8b5d-6405-4a03-91a6-9b221a0d0072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd043e782430246d4bf2ba19efd36b443', 'request_id': 'req-f16a8b5d-6405-4a03-91a6-9b221a0d0072'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:48:56.685886 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-f16a8b5d-6405-4a03-91a6-9b221a0d0072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd043e782430246d4bf2ba19efd36b443', 'request_id': 'req-f16a8b5d-6405-4a03-91a6-9b221a0d0072'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:48:56.692152 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-f16a8b5d-6405-4a03-91a6-9b221a0d0072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd043e782430246d4bf2ba19efd36b443', 'request_id': 'req-f16a8b5d-6405-4a03-91a6-9b221a0d0072'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:48:56.803516 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-f16a8b5d-6405-4a03-91a6-9b221a0d0072 admin admin] The token cache is being invalidate because project d043e782430246d4bf2ba19efd36b443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:48:56.803803 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-f16a8b5d-6405-4a03-91a6-9b221a0d0072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:48:56.804427 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-f16a8b5d-6405-4a03-91a6-9b221a0d0072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:48:56.806471 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1298/2595] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:48:56 2022] DELETE /identity/v3/projects/d043e782430246d4bf2ba19efd36b443 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:48:56.811915 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c135cf-4291-4c3e-b336-c2a42a988bb4 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:48:56.814354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c135cf-4291-4c3e-b336-c2a42a988bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:48:56.814354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c135cf-4291-4c3e-b336-c2a42a988bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:48:56.834121 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-47c135cf-4291-4c3e-b336-c2a42a988bb4 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:48:56.837392 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-47c135cf-4291-4c3e-b336-c2a42a988bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:48:56.894118 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1298/2596] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:48:56.901759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9e82a-71df-462c-afc0-158d1e698e63 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:48:56.902041 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9e82a-71df-462c-afc0-158d1e698e63 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:48:56.902313 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9e82a-71df-462c-afc0-158d1e698e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:48:56.922488 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-38b9e82a-71df-462c-afc0-158d1e698e63 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:48:56.923710 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-38b9e82a-71df-462c-afc0-158d1e698e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:48:56.932175 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1299/2597] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 02:48:56.936462 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c135cf-4291-4c3e-b336-c2a42a988bb4 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:48:56.946064 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c135cf-4291-4c3e-b336-c2a42a988bb4 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:48:56.951204 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051856de-bc97-48b6-97f4-6667fcb12bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:48:56.951792 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051856de-bc97-48b6-97f4-6667fcb12bbc admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:48:56.952067 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051856de-bc97-48b6-97f4-6667fcb12bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:48:56.952335 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051856de-bc97-48b6-97f4-6667fcb12bbc admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:48:56.952978 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051856de-bc97-48b6-97f4-6667fcb12bbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:48:56.953540 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051856de-bc97-48b6-97f4-6667fcb12bbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:48:56.955151 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051856de-bc97-48b6-97f4-6667fcb12bbc admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:48:56.967778 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1299/2598] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 02:48:56.971883 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9e82a-71df-462c-afc0-158d1e698e63 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:48:56.982125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9e82a-71df-462c-afc0-158d1e698e63 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:48:56.986727 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f91a28-8aa7-43dd-8814-245f09b7f480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:48:56.987334 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f91a28-8aa7-43dd-8814-245f09b7f480 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:48:56.987610 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f91a28-8aa7-43dd-8814-245f09b7f480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:48:56.987876 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f91a28-8aa7-43dd-8814-245f09b7f480 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:48:56.988500 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f91a28-8aa7-43dd-8814-245f09b7f480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:48:56.990380 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f91a28-8aa7-43dd-8814-245f09b7f480 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:48:57.096376 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1300/2599] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:48:56 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:48:57.100483 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051856de-bc97-48b6-97f4-6667fcb12bbc admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:48:57.110845 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051856de-bc97-48b6-97f4-6667fcb12bbc admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:48:57.158903 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:48:57.168142 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070d5a7-825c-4b09-8465-f1bfc10cd8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:48:57.168763 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070d5a7-825c-4b09-8465-f1bfc10cd8e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:48:57.169216 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070d5a7-825c-4b09-8465-f1bfc10cd8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:48:57.169355 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070d5a7-825c-4b09-8465-f1bfc10cd8e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:48:57.169971 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070d5a7-825c-4b09-8465-f1bfc10cd8e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:48:57.171911 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070d5a7-825c-4b09-8465-f1bfc10cd8e3 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:48:57.262047 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1300/2600] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:48:57 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:48:57.266181 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f91a28-8aa7-43dd-8814-245f09b7f480 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:48:57.277171 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f91a28-8aa7-43dd-8814-245f09b7f480 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:48:57.281891 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc5c23-5f67-4cf3-9610-e1b052ecd274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:48:57.282482 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc5c23-5f67-4cf3-9610-e1b052ecd274 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:48:57.282759 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc5c23-5f67-4cf3-9610-e1b052ecd274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:48:57.283099 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc5c23-5f67-4cf3-9610-e1b052ecd274 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:48:57.283743 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc5c23-5f67-4cf3-9610-e1b052ecd274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:48:57.285329 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc5c23-5f67-4cf3-9610-e1b052ecd274 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:48:57.295386 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1301/2601] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:48:57.299286 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070d5a7-825c-4b09-8465-f1bfc10cd8e3 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:48:57.309957 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070d5a7-825c-4b09-8465-f1bfc10cd8e3 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:48:57.314638 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05232678-bf01-4861-b9a5-16168097bb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:48:57.315249 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05232678-bf01-4861-b9a5-16168097bb09 admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:48:57.315524 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05232678-bf01-4861-b9a5-16168097bb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:48:57.315832 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05232678-bf01-4861-b9a5-16168097bb09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:48:57.316457 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05232678-bf01-4861-b9a5-16168097bb09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:48:57.318024 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05232678-bf01-4861-b9a5-16168097bb09 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:48:57.329781 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1301/2602] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:48:57.333761 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc5c23-5f67-4cf3-9610-e1b052ecd274 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:48:57.344977 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc5c23-5f67-4cf3-9610-e1b052ecd274 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:48:57.349570 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f1683-2867-4f46-bb48-570b8c35c1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:48:57.350215 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f1683-2867-4f46-bb48-570b8c35c1a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:48:57.350485 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f1683-2867-4f46-bb48-570b8c35c1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:48:57.350761 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f1683-2867-4f46-bb48-570b8c35c1a1 admin admin] PATH_INFO: `/v3/projects/52e75472220a447b81aaf1473449fe15/users/772a3cfa7341451db71b629d533f0f7f/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:48:57.365031 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f1683-2867-4f46-bb48-570b8c35c1a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e75472220a447b81aaf1473449fe15, user_id=772a3cfa7341451db71b629d533f0f7f, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:48:57.367727 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f1683-2867-4f46-bb48-570b8c35c1a1 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:48:57.438656 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1302/2603] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:48:57 2022] PUT /identity/v3/projects/52e75472220a447b81aaf1473449fe15/users/772a3cfa7341451db71b629d533f0f7f/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:48:57.450337 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6705aee-ee6b-43f4-89ba-34b0d019db3b None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:48:57.450626 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6705aee-ee6b-43f4-89ba-34b0d019db3b None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:48:57.450933 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6705aee-ee6b-43f4-89ba-34b0d019db3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:48:57.480175 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-d6705aee-ee6b-43f4-89ba-34b0d019db3b None None] MFA Rules not processed for user `772a3cfa7341451db71b629d533f0f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:48:57.481333 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-d6705aee-ee6b-43f4-89ba-34b0d019db3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:48:57.545003 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1302/2604] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:48:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:48:57.555472 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f1683-2867-4f46-bb48-570b8c35c1a1 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:48:57.557799 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-524f1683-2867-4f46-bb48-570b8c35c1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:48:57.572633 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:48:57.615651 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f1683-2867-4f46-bb48-570b8c35c1a1 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:48:57.619868 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5c820-2189-4715-a28c-52e8e6b13875 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1f37f8136349edac3a52793e2fef8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:48:57.620511 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5c820-2189-4715-a28c-52e8e6b13875 service cinder] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:48:57.620789 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5c820-2189-4715-a28c-52e8e6b13875 service cinder] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:48:57.621061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5c820-2189-4715-a28c-52e8e6b13875 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:48:57.629379 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5c820-2189-4715-a28c-52e8e6b13875 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:48:57.630809 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5c820-2189-4715-a28c-52e8e6b13875 service cinder] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:48:57.640907 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1303/2605] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:48:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:49:07.542087 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:49:07.661085 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=20 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:49:09.039439 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6705aee-ee6b-43f4-89ba-34b0d019db3b None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:49:09.102741 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6705aee-ee6b-43f4-89ba-34b0d019db3b None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:49:09.107984 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b64329-f76c-4c19-b098-17e7e174a51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:49:09.108605 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b64329-f76c-4c19-b098-17e7e174a51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:49:09.108884 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b64329-f76c-4c19-b098-17e7e174a51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:49:09.109159 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b64329-f76c-4c19-b098-17e7e174a51b admin admin] PATH_INFO: `/v3/users/772a3cfa7341451db71b629d533f0f7f` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:49:09.110287 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b64329-f76c-4c19-b098-17e7e174a51b admin admin] RBAC: Authorizing `identity:delete_user(user_id=772a3cfa7341451db71b629d533f0f7f)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:49:09.112243 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b64329-f76c-4c19-b098-17e7e174a51b admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:49:09.310597 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-b5b64329-f76c-4c19-b098-17e7e174a51b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '772a3cfa7341451db71b629d533f0f7f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:49:09.311202 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-b5b64329-f76c-4c19-b098-17e7e174a51b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '772a3cfa7341451db71b629d533f0f7f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:49:09.375256 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-b5b64329-f76c-4c19-b098-17e7e174a51b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '772a3cfa7341451db71b629d533f0f7f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:49:09.387213 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-b5b64329-f76c-4c19-b098-17e7e174a51b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '772a3cfa7341451db71b629d533f0f7f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:49:09.393184 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-b5b64329-f76c-4c19-b098-17e7e174a51b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '772a3cfa7341451db71b629d533f0f7f'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:49:09.400414 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1303/2606] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:49:09 2022] DELETE /identity/v3/users/772a3cfa7341451db71b629d533f0f7f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:49:09.405388 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f82624-9972-46ae-92d4-273e84faa556 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:49:09.405886 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f82624-9972-46ae-92d4-273e84faa556 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:49:09.405996 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f82624-9972-46ae-92d4-273e84faa556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:49:09.426438 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-43f82624-9972-46ae-92d4-273e84faa556 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:49:09.427654 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-43f82624-9972-46ae-92d4-273e84faa556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:49:09.485718 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1304/2607] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:49:09.495332 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b64329-f76c-4c19-b098-17e7e174a51b admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:49:09.496740 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-b5b64329-f76c-4c19-b098-17e7e174a51b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:49:09.553451 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b64329-f76c-4c19-b098-17e7e174a51b admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:49:09.557070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f6670-1b7d-46f6-bcee-805d339c1d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:49:09.557661 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f6670-1b7d-46f6-bcee-805d339c1d98 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:49:09.557938 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f6670-1b7d-46f6-bcee-805d339c1d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:49:09.558206 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f6670-1b7d-46f6-bcee-805d339c1d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:49:09.567322 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f6670-1b7d-46f6-bcee-805d339c1d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:49:09.568748 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f6670-1b7d-46f6-bcee-805d339c1d98 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:49:09.578628 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1304/2608] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:49:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:49:09.965568 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f82624-9972-46ae-92d4-273e84faa556 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:49:09.967564 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-43f82624-9972-46ae-92d4-273e84faa556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:49:10.031713 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f82624-9972-46ae-92d4-273e84faa556 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:49:10.036285 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd67cb-a093-42f4-a71d-d6f72edb9ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:49:10.036905 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd67cb-a093-42f4-a71d-d6f72edb9ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:49:10.037180 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd67cb-a093-42f4-a71d-d6f72edb9ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:49:10.037450 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd67cb-a093-42f4-a71d-d6f72edb9ce1 admin admin] PATH_INFO: `/v3/projects/52e75472220a447b81aaf1473449fe15` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:49:10.038562 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd67cb-a093-42f4-a71d-d6f72edb9ce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52e75472220a447b81aaf1473449fe15)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:49:10.040551 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd67cb-a093-42f4-a71d-d6f72edb9ce1 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:49:10.129931 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-73dd67cb-a093-42f4-a71d-d6f72edb9ce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52e75472220a447b81aaf1473449fe15', 'request_id': 'req-73dd67cb-a093-42f4-a71d-d6f72edb9ce1'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:49:10.135526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-73dd67cb-a093-42f4-a71d-d6f72edb9ce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52e75472220a447b81aaf1473449fe15', 'request_id': 'req-73dd67cb-a093-42f4-a71d-d6f72edb9ce1'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:49:10.142932 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-73dd67cb-a093-42f4-a71d-d6f72edb9ce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52e75472220a447b81aaf1473449fe15', 'request_id': 'req-73dd67cb-a093-42f4-a71d-d6f72edb9ce1'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:49:10.209109 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-73dd67cb-a093-42f4-a71d-d6f72edb9ce1 admin admin] The token cache is being invalidate because project 52e75472220a447b81aaf1473449fe15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81671) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:49:10.209398 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-73dd67cb-a093-42f4-a71d-d6f72edb9ce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:49:10.210023 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-73dd67cb-a093-42f4-a71d-d6f72edb9ce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:49:10.211549 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1305/2609] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:49:09 2022] DELETE /identity/v3/projects/52e75472220a447b81aaf1473449fe15 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:49:10.216824 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62416e5-9b4d-4c2d-bd16-2bf68d95c9f8 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:49:10.217280 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62416e5-9b4d-4c2d-bd16-2bf68d95c9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:49:10.217424 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62416e5-9b4d-4c2d-bd16-2bf68d95c9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:49:10.237433 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-f62416e5-9b4d-4c2d-bd16-2bf68d95c9f8 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:49:10.238649 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-f62416e5-9b4d-4c2d-bd16-2bf68d95c9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:49:10.256543 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:49:10.299867 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1305/2610] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:49:10.307526 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf613e-f4d6-4d12-a3c8-9a62b3972eb3 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:49:10.313209 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf613e-f4d6-4d12-a3c8-9a62b3972eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:49:10.313209 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf613e-f4d6-4d12-a3c8-9a62b3972eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:49:10.329040 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-45cf613e-f4d6-4d12-a3c8-9a62b3972eb3 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:49:10.330256 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-45cf613e-f4d6-4d12-a3c8-9a62b3972eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:49:10.338237 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1306/2611] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:49:10.343216 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62416e5-9b4d-4c2d-bd16-2bf68d95c9f8 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:49:10.352764 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62416e5-9b4d-4c2d-bd16-2bf68d95c9f8 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:49:10.357899 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c830116-f829-4b9e-ae6d-c7cc9af2494e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:49:10.358745 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c830116-f829-4b9e-ae6d-c7cc9af2494e admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:49:10.359401 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c830116-f829-4b9e-ae6d-c7cc9af2494e admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:49:10.359678 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c830116-f829-4b9e-ae6d-c7cc9af2494e admin admin] PATH_INFO: `/v3/domains` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:49:10.360331 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c830116-f829-4b9e-ae6d-c7cc9af2494e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81670) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 02:49:10.360634 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c830116-f829-4b9e-ae6d-c7cc9af2494e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:49:10.362229 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c830116-f829-4b9e-ae6d-c7cc9af2494e admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:49:10.374210 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1306/2612] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 19 02:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 02:49:10.378410 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf613e-f4d6-4d12-a3c8-9a62b3972eb3 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:49:10.387629 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf613e-f4d6-4d12-a3c8-9a62b3972eb3 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:49:10.392943 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d0494-f231-4c4a-b058-d213135ede99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:49:10.393534 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d0494-f231-4c4a-b058-d213135ede99 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:49:10.393822 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d0494-f231-4c4a-b058-d213135ede99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:49:10.394094 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d0494-f231-4c4a-b058-d213135ede99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:49:10.394730 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d0494-f231-4c4a-b058-d213135ede99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:49:10.396661 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d0494-f231-4c4a-b058-d213135ede99 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:49:10.491611 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1307/2613] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:49:10 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:49:10.495542 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c830116-f829-4b9e-ae6d-c7cc9af2494e admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:49:10.507143 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c830116-f829-4b9e-ae6d-c7cc9af2494e admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:49:10.567814 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd6e38-7af1-4eb9-83bb-4040d2d08d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:49:10.568446 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd6e38-7af1-4eb9-83bb-4040d2d08d98 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:49:10.568739 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd6e38-7af1-4eb9-83bb-4040d2d08d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:49:10.569015 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd6e38-7af1-4eb9-83bb-4040d2d08d98 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:49:10.569652 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd6e38-7af1-4eb9-83bb-4040d2d08d98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:49:10.571600 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd6e38-7af1-4eb9-83bb-4040d2d08d98 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:49:10.683748 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1307/2614] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:49:10 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:49:10.688594 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d0494-f231-4c4a-b058-d213135ede99 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:49:10.698993 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d0494-f231-4c4a-b058-d213135ede99 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:49:10.703944 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fae40-9a46-48e0-b97a-203501eae48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:49:10.704535 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fae40-9a46-48e0-b97a-203501eae48a admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:49:10.704891 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fae40-9a46-48e0-b97a-203501eae48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:49:10.705158 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fae40-9a46-48e0-b97a-203501eae48a admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:49:10.705802 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9fae40-9a46-48e0-b97a-203501eae48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:49:10.707435 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9fae40-9a46-48e0-b97a-203501eae48a admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:49:10.712904 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:49:10.717883 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1308/2615] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 02:49:10.722012 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd6e38-7af1-4eb9-83bb-4040d2d08d98 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:49:10.733248 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd6e38-7af1-4eb9-83bb-4040d2d08d98 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:49:10.738036 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06175993-5253-457f-b705-ffe6902cc6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:49:10.738619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06175993-5253-457f-b705-ffe6902cc6bf admin admin] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:49:10.738952 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06175993-5253-457f-b705-ffe6902cc6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:49:10.739224 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06175993-5253-457f-b705-ffe6902cc6bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:49:10.739928 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06175993-5253-457f-b705-ffe6902cc6bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:49:10.741491 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06175993-5253-457f-b705-ffe6902cc6bf admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:49:10.753360 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1308/2616] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:49:10.757550 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fae40-9a46-48e0-b97a-203501eae48a admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:49:10.768171 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fae40-9a46-48e0-b97a-203501eae48a admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:49:10.772840 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93b626-0d5e-4dd2-bb42-540cab3eae9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:49:10.773481 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93b626-0d5e-4dd2-bb42-540cab3eae9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:49:10.773901 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93b626-0d5e-4dd2-bb42-540cab3eae9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:49:10.774106 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93b626-0d5e-4dd2-bb42-540cab3eae9a admin admin] PATH_INFO: `/v3/projects/01619a460317489d8e53b82234a5fc9d/users/ca195fb4527f4d57ba7916826f478c9c/roles/bacc420f29704ec89e015525d8143d62` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:49:10.788746 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93b626-0d5e-4dd2-bb42-540cab3eae9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=01619a460317489d8e53b82234a5fc9d, user_id=ca195fb4527f4d57ba7916826f478c9c, role_id=bacc420f29704ec89e015525d8143d62)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:49:10.791609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93b626-0d5e-4dd2-bb42-540cab3eae9a admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:49:10.872067 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1309/2617] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:49:10 2022] PUT /identity/v3/projects/01619a460317489d8e53b82234a5fc9d/users/ca195fb4527f4d57ba7916826f478c9c/roles/bacc420f29704ec89e015525d8143d62 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:49:10.877275 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8041013-37da-4800-ad80-a6a72a622800 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:49:10.877554 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8041013-37da-4800-ad80-a6a72a622800 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:49:10.877825 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8041013-37da-4800-ad80-a6a72a622800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:49:10.897130 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-a8041013-37da-4800-ad80-a6a72a622800 None None] MFA Rules not processed for user `517e3692b01845c4bdf9eea0a2aadadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:49:10.898318 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-a8041013-37da-4800-ad80-a6a72a622800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:49:10.957784 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1309/2618] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:49:10.967963 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93b626-0d5e-4dd2-bb42-540cab3eae9a admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:49:10.969609 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-8d93b626-0d5e-4dd2-bb42-540cab3eae9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:49:11.026588 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93b626-0d5e-4dd2-bb42-540cab3eae9a admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:49:11.031222 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98bddb-8570-4a45-a8da-a4f84f116d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:49:11.031817 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98bddb-8570-4a45-a8da-a4f84f116d2d service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:49:11.032091 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98bddb-8570-4a45-a8da-a4f84f116d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:49:11.032359 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98bddb-8570-4a45-a8da-a4f84f116d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:49:11.041192 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98bddb-8570-4a45-a8da-a4f84f116d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:49:11.042611 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98bddb-8570-4a45-a8da-a4f84f116d2d service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:49:11.053470 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1310/2619] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:49:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:49:16.384960 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d959b-5979-4249-8a23-b228de442895 None None] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:49:16.385542 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d959b-5979-4249-8a23-b228de442895 None None] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:49:16.385542 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d959b-5979-4249-8a23-b228de442895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:49:16.416668 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.auth.core [None req-855d959b-5979-4249-8a23-b228de442895 None None] MFA Rules not processed for user `ca195fb4527f4d57ba7916826f478c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81670) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:49:16.418070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-855d959b-5979-4249-8a23-b228de442895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:49:16.437751 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:49:16.508261 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1310/2620] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:49:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:49:16.512876 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98bddb-8570-4a45-a8da-a4f84f116d2d service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:49:16.543067 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98bddb-8570-4a45-a8da-a4f84f116d2d service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:49:16.549686 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70787f86-f823-4b13-b92a-34db5d4ef4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:49:16.550326 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70787f86-f823-4b13-b92a-34db5d4ef4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:49:16.550605 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70787f86-f823-4b13-b92a-34db5d4ef4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:49:16.550988 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70787f86-f823-4b13-b92a-34db5d4ef4a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:49:16.551643 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70787f86-f823-4b13-b92a-34db5d4ef4a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:49:16.553592 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70787f86-f823-4b13-b92a-34db5d4ef4a6 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:49:16.652314 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1311/2621] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 19 02:49:16 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:49:16.658258 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d959b-5979-4249-8a23-b228de442895 None None] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:49:16.667289 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d959b-5979-4249-8a23-b228de442895 None None] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:49:16.727606 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f845f-e341-4d82-bcfe-3db8479cafe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:49:16.728220 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f845f-e341-4d82-bcfe-3db8479cafe3 admin admin] REQUEST_METHOD: `POST` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:49:16.728494 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f845f-e341-4d82-bcfe-3db8479cafe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:49:16.732902 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f845f-e341-4d82-bcfe-3db8479cafe3 admin admin] PATH_INFO: `/v3/users` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:49:16.732902 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f845f-e341-4d82-bcfe-3db8479cafe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:49:16.732902 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f845f-e341-4d82-bcfe-3db8479cafe3 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:49:16.833338 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1311/2622] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 19 02:49:16 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 02:49:16.837482 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70787f86-f823-4b13-b92a-34db5d4ef4a6 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:49:16.848934 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70787f86-f823-4b13-b92a-34db5d4ef4a6 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:49:16.853978 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fea20a-be1c-4c36-a5ba-b1155f3ba6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:49:16.854529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fea20a-be1c-4c36-a5ba-b1155f3ba6f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:49:16.854806 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fea20a-be1c-4c36-a5ba-b1155f3ba6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:49:16.855114 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fea20a-be1c-4c36-a5ba-b1155f3ba6f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:49:16.855781 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fea20a-be1c-4c36-a5ba-b1155f3ba6f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:49:16.858117 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fea20a-be1c-4c36-a5ba-b1155f3ba6f6 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:49:16.868139 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1312/2623] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:49:16.872244 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f845f-e341-4d82-bcfe-3db8479cafe3 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:49:16.882339 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f845f-e341-4d82-bcfe-3db8479cafe3 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:49:16.886962 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7253e73-dba2-43f8-ad21-aa8c9713590a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:49:16.887622 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7253e73-dba2-43f8-ad21-aa8c9713590a admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:49:16.887910 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7253e73-dba2-43f8-ad21-aa8c9713590a admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:49:16.888183 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7253e73-dba2-43f8-ad21-aa8c9713590a admin admin] PATH_INFO: `/v3/projects/3a146f849d9d43d996abefc3b3e78497/users/23a2c4bce76c457ea379e0205157d8e1/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:49:16.903005 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7253e73-dba2-43f8-ad21-aa8c9713590a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a146f849d9d43d996abefc3b3e78497, user_id=23a2c4bce76c457ea379e0205157d8e1, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:49:16.906204 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7253e73-dba2-43f8-ad21-aa8c9713590a admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:49:16.959032 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1312/2624] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:49:16 2022] PUT /identity/v3/projects/3a146f849d9d43d996abefc3b3e78497/users/23a2c4bce76c457ea379e0205157d8e1/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:49:16.962970 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fea20a-be1c-4c36-a5ba-b1155f3ba6f6 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:49:16.973692 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fea20a-be1c-4c36-a5ba-b1155f3ba6f6 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:49:17.029898 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08945d4-352d-4f16-a68d-57048f569728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:49:17.030510 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08945d4-352d-4f16-a68d-57048f569728 admin admin] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:49:17.030897 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08945d4-352d-4f16-a68d-57048f569728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:49:17.031143 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08945d4-352d-4f16-a68d-57048f569728 admin admin] PATH_INFO: `/v3/roles` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:49:17.031781 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08945d4-352d-4f16-a68d-57048f569728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:49:17.033421 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08945d4-352d-4f16-a68d-57048f569728 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:49:17.042949 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1313/2625] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 19 02:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 02:49:17.047960 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7253e73-dba2-43f8-ad21-aa8c9713590a admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:49:17.058380 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7253e73-dba2-43f8-ad21-aa8c9713590a admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:49:17.063610 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e2e41-e999-4a0e-9ea0-735c771a8d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:49:17.064246 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e2e41-e999-4a0e-9ea0-735c771a8d49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:49:17.064521 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e2e41-e999-4a0e-9ea0-735c771a8d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:49:17.064790 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e2e41-e999-4a0e-9ea0-735c771a8d49 admin admin] PATH_INFO: `/v3/projects/3a146f849d9d43d996abefc3b3e78497/users/23a2c4bce76c457ea379e0205157d8e1/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:49:17.066679 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e2e41-e999-4a0e-9ea0-735c771a8d49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a146f849d9d43d996abefc3b3e78497, user_id=23a2c4bce76c457ea379e0205157d8e1, role_id=e2e7c80d19c141bc9f9bfc13c2ec2a12)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:49:17.070229 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e2e41-e999-4a0e-9ea0-735c771a8d49 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:49:17.081631 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1313/2626] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 19 02:49:17 2022] PUT /identity/v3/projects/3a146f849d9d43d996abefc3b3e78497/users/23a2c4bce76c457ea379e0205157d8e1/roles/e2e7c80d19c141bc9f9bfc13c2ec2a12 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:49:22.781640 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ed470-53af-4e5e-aa63-7ed8dbd852d8 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:49:22.782139 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ed470-53af-4e5e-aa63-7ed8dbd852d8 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:49:22.782238 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ed470-53af-4e5e-aa63-7ed8dbd852d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:49:22.812260 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-a55ed470-53af-4e5e-aa63-7ed8dbd852d8 None None] MFA Rules not processed for user `23a2c4bce76c457ea379e0205157d8e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:49:22.813522 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-a55ed470-53af-4e5e-aa63-7ed8dbd852d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:49:22.829702 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:49:22.889042 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1314/2627] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:49:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:49:22.903499 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e2e41-e999-4a0e-9ea0-735c771a8d49 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:49:22.906197 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-208e2e41-e999-4a0e-9ea0-735c771a8d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:49:22.965072 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:49:22.986692 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e2e41-e999-4a0e-9ea0-735c771a8d49 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:49:22.992534 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8f46c-989b-4a65-9048-bc6043e954d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:49:22.993143 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8f46c-989b-4a65-9048-bc6043e954d8 service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:49:22.993421 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8f46c-989b-4a65-9048-bc6043e954d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:49:22.993696 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8f46c-989b-4a65-9048-bc6043e954d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:49:23.050997 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8f46c-989b-4a65-9048-bc6043e954d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:49:23.052588 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8f46c-989b-4a65-9048-bc6043e954d8 service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:49:23.062394 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1314/2628] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:49:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:49:25.709144 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28109e5-b4a1-480a-b3e3-d42719871e50 None None] REQUEST_METHOD: `POST` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:49:25.709684 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28109e5-b4a1-480a-b3e3-d42719871e50 None None] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:49:25.709684 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28109e5-b4a1-480a-b3e3-d42719871e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:49:25.729877 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.auth.core [None req-f28109e5-b4a1-480a-b3e3-d42719871e50 None None] MFA Rules not processed for user `ca195fb4527f4d57ba7916826f478c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81671) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 02:49:25.731179 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-f28109e5-b4a1-480a-b3e3-d42719871e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:49:25.738632 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1315/2629] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 19 02:49:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 02:49:33.057501 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=32 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:49:35.724750 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=26 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:49:59.138544 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8f46c-989b-4a65-9048-bc6043e954d8 service nova] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:49:59.139993 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-fdf8f46c-989b-4a65-9048-bc6043e954d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:49:59.197528 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8f46c-989b-4a65-9048-bc6043e954d8 service nova] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:49:59.201089 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703aefe-359a-4479-8987-6f1b8ca93a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:49:59.201682 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703aefe-359a-4479-8987-6f1b8ca93a4c service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:49:59.201959 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703aefe-359a-4479-8987-6f1b8ca93a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:49:59.202229 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703aefe-359a-4479-8987-6f1b8ca93a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:49:59.212032 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703aefe-359a-4479-8987-6f1b8ca93a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:49:59.213458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703aefe-359a-4479-8987-6f1b8ca93a4c service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:49:59.223709 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1315/2630] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:49:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:50:09.218959 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=26 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:50:50.459940 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28109e5-b4a1-480a-b3e3-d42719871e50 None None] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:50:50.460436 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-f28109e5-b4a1-480a-b3e3-d42719871e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:50:50.567897 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28109e5-b4a1-480a-b3e3-d42719871e50 None None] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:50:50.572873 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4e463-bb12-4ac9-9ddd-57c604bf7d06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66b9bc695b44877a06f17ea6bbeb27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:50:50.574112 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4e463-bb12-4ac9-9ddd-57c604bf7d06 service placement] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:50:50.574385 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4e463-bb12-4ac9-9ddd-57c604bf7d06 service placement] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:50:50.574652 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4e463-bb12-4ac9-9ddd-57c604bf7d06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:50:50.576416 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-eaa4e463-bb12-4ac9-9ddd-57c604bf7d06 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:50:50.587975 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4e463-bb12-4ac9-9ddd-57c604bf7d06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:50:50.589587 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4e463-bb12-4ac9-9ddd-57c604bf7d06 service placement] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:50:50.599448 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1316/2631] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:50:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:51:00.595270 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=48 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:52:38.953034 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703aefe-359a-4479-8987-6f1b8ca93a4c service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:52:38.978356 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703aefe-359a-4479-8987-6f1b8ca93a4c service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:52:38.982026 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543242b-5ff4-402d-9a99-b1ff7ad0c111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:52:38.982616 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543242b-5ff4-402d-9a99-b1ff7ad0c111 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:52:38.982925 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543242b-5ff4-402d-9a99-b1ff7ad0c111 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:52:38.983203 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543242b-5ff4-402d-9a99-b1ff7ad0c111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:52:38.985587 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-6543242b-5ff4-402d-9a99-b1ff7ad0c111 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:52:39.007496 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543242b-5ff4-402d-9a99-b1ff7ad0c111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:52:39.008848 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543242b-5ff4-402d-9a99-b1ff7ad0c111 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:52:39.017435 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1316/2632] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:52:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:52:39.339999 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4e463-bb12-4ac9-9ddd-57c604bf7d06 service placement] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:52:39.350061 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4e463-bb12-4ac9-9ddd-57c604bf7d06 service placement] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:52:39.356580 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468e09f-e260-485d-896e-16334c29f621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:52:39.356580 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468e09f-e260-485d-896e-16334c29f621 service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:52:39.356580 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468e09f-e260-485d-896e-16334c29f621 service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:52:39.356580 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468e09f-e260-485d-896e-16334c29f621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:52:39.356971 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-1468e09f-e260-485d-896e-16334c29f621 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:52:39.367382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468e09f-e260-485d-896e-16334c29f621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:52:39.368906 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468e09f-e260-485d-896e-16334c29f621 service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:52:39.377647 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1317/2633] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:52:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:52:39.480689 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543242b-5ff4-402d-9a99-b1ff7ad0c111 service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:52:39.490287 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543242b-5ff4-402d-9a99-b1ff7ad0c111 service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:52:39.493843 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590d210-15d8-48d0-815b-5a56e6a5f733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:52:39.494466 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590d210-15d8-48d0-815b-5a56e6a5f733 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:52:39.494746 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590d210-15d8-48d0-815b-5a56e6a5f733 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:52:39.495048 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590d210-15d8-48d0-815b-5a56e6a5f733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:52:39.496741 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-c590d210-15d8-48d0-815b-5a56e6a5f733 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:52:39.529241 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590d210-15d8-48d0-815b-5a56e6a5f733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:52:39.530592 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590d210-15d8-48d0-815b-5a56e6a5f733 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:52:39.551388 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1317/2634] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:52:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:52:39.614973 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468e09f-e260-485d-896e-16334c29f621 service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:52:39.627050 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468e09f-e260-485d-896e-16334c29f621 service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:52:39.632229 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b1869-74b2-41f1-bc3b-a32ce3f482d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66b9bc695b44877a06f17ea6bbeb27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:52:39.632848 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b1869-74b2-41f1-bc3b-a32ce3f482d9 service placement] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:52:39.633119 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b1869-74b2-41f1-bc3b-a32ce3f482d9 service placement] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:52:39.633384 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b1869-74b2-41f1-bc3b-a32ce3f482d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:52:39.635097 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-d31b1869-74b2-41f1-bc3b-a32ce3f482d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:52:39.646969 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b1869-74b2-41f1-bc3b-a32ce3f482d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:52:39.648529 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b1869-74b2-41f1-bc3b-a32ce3f482d9 service placement] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:52:39.658989 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1318/2635] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:52:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:52:41.067271 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590d210-15d8-48d0-815b-5a56e6a5f733 service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:52:41.079483 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590d210-15d8-48d0-815b-5a56e6a5f733 service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:52:41.085101 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06018d89-0cfa-4567-8eaf-1a26786c62b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:52:41.089170 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06018d89-0cfa-4567-8eaf-1a26786c62b7 service nova] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:52:41.089170 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06018d89-0cfa-4567-8eaf-1a26786c62b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:52:41.089170 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06018d89-0cfa-4567-8eaf-1a26786c62b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:52:41.089170 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-06018d89-0cfa-4567-8eaf-1a26786c62b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:52:41.101061 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06018d89-0cfa-4567-8eaf-1a26786c62b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:52:41.102627 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06018d89-0cfa-4567-8eaf-1a26786c62b7 service nova] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:52:41.113559 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1318/2636] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:52:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:52:49.654168 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=12 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:52:51.108683 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=42 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:53:44.215844 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b1869-74b2-41f1-bc3b-a32ce3f482d9 service placement] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:53:44.226318 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b1869-74b2-41f1-bc3b-a32ce3f482d9 service placement] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:53:44.229906 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0be136-b8df-43dc-aa82-3006a23cf55f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:53:44.230498 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0be136-b8df-43dc-aa82-3006a23cf55f service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:53:44.230795 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0be136-b8df-43dc-aa82-3006a23cf55f service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:53:44.231093 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0be136-b8df-43dc-aa82-3006a23cf55f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:53:44.233079 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-4a0be136-b8df-43dc-aa82-3006a23cf55f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:53:44.242603 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0be136-b8df-43dc-aa82-3006a23cf55f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:53:44.244054 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0be136-b8df-43dc-aa82-3006a23cf55f service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:53:44.252133 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1319/2637] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:53:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:53:54.248512 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=6 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:54:34.640074 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06018d89-0cfa-4567-8eaf-1a26786c62b7 service nova] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:54:34.649610 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06018d89-0cfa-4567-8eaf-1a26786c62b7 service nova] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:54:34.653656 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de2e16-179f-40f3-addd-df2555c46eee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:54:34.654895 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de2e16-179f-40f3-addd-df2555c46eee service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:54:34.655539 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de2e16-179f-40f3-addd-df2555c46eee service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:54:34.655965 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de2e16-179f-40f3-addd-df2555c46eee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:54:34.665212 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de2e16-179f-40f3-addd-df2555c46eee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:54:34.666762 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de2e16-179f-40f3-addd-df2555c46eee service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:54:34.675947 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1319/2638] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:54:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:54:35.573914 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0be136-b8df-43dc-aa82-3006a23cf55f service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:54:35.591944 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0be136-b8df-43dc-aa82-3006a23cf55f service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:54:35.598218 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c594e42-110c-49ac-a15f-d811e25d30c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58a78f75a63e4d258a4afbeb748e59f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:54:35.598521 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c594e42-110c-49ac-a15f-d811e25d30c0 service nova] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:54:35.598760 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c594e42-110c-49ac-a15f-d811e25d30c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:54:35.599062 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c594e42-110c-49ac-a15f-d811e25d30c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:54:35.601583 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-8c594e42-110c-49ac-a15f-d811e25d30c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:54:35.615256 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c594e42-110c-49ac-a15f-d811e25d30c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:54:35.616901 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c594e42-110c-49ac-a15f-d811e25d30c0 service nova] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:54:35.630993 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1320/2639] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:54:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:54:36.012619 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de2e16-179f-40f3-addd-df2555c46eee service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:54:36.021508 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de2e16-179f-40f3-addd-df2555c46eee service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:54:36.025354 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207047a-ff1e-4df8-9ac0-9aec11dd8eb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:54:36.025956 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207047a-ff1e-4df8-9ac0-9aec11dd8eb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:54:36.026235 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207047a-ff1e-4df8-9ac0-9aec11dd8eb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:54:36.026509 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207047a-ff1e-4df8-9ac0-9aec11dd8eb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:54:36.028308 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-f207047a-ff1e-4df8-9ac0-9aec11dd8eb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:54:36.043091 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f207047a-ff1e-4df8-9ac0-9aec11dd8eb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:54:36.044513 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f207047a-ff1e-4df8-9ac0-9aec11dd8eb9 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:54:36.057037 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1320/2640] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:54:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:54:37.251293 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c594e42-110c-49ac-a15f-d811e25d30c0 service nova] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:54:37.260957 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c594e42-110c-49ac-a15f-d811e25d30c0 service nova] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:54:37.265254 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd898c0-36f8-4188-bf2d-912b9cca318f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:54:37.265843 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd898c0-36f8-4188-bf2d-912b9cca318f service neutron] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:54:37.266118 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd898c0-36f8-4188-bf2d-912b9cca318f service neutron] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:54:37.266387 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd898c0-36f8-4188-bf2d-912b9cca318f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:54:37.268118 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-1dd898c0-36f8-4188-bf2d-912b9cca318f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:54:37.281428 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd898c0-36f8-4188-bf2d-912b9cca318f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:54:37.282850 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd898c0-36f8-4188-bf2d-912b9cca318f service neutron] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:54:37.294142 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1321/2641] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:54:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:54:40.142514 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207047a-ff1e-4df8-9ac0-9aec11dd8eb9 service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:54:40.151431 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207047a-ff1e-4df8-9ac0-9aec11dd8eb9 service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:54:40.155816 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71e204-ba21-48fd-b802-0792b0e46d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e4640bd879468d81ec0281827687ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:54:40.156413 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71e204-ba21-48fd-b802-0792b0e46d50 service neutron] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:54:40.156692 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71e204-ba21-48fd-b802-0792b0e46d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:54:40.156965 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71e204-ba21-48fd-b802-0792b0e46d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:54:40.218077 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71e204-ba21-48fd-b802-0792b0e46d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:54:40.219562 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71e204-ba21-48fd-b802-0792b0e46d50 service neutron] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:54:40.229547 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1321/2642] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:54:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:54:43.480648 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd898c0-36f8-4188-bf2d-912b9cca318f service neutron] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:54:43.482031 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-1dd898c0-36f8-4188-bf2d-912b9cca318f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:54:43.497142 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd898c0-36f8-4188-bf2d-912b9cca318f service neutron] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:54:43.502667 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d5301-8ba5-41c4-808e-99ac2b1ff6fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66b9bc695b44877a06f17ea6bbeb27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:54:43.503301 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d5301-8ba5-41c4-808e-99ac2b1ff6fe service placement] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:54:43.503576 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d5301-8ba5-41c4-808e-99ac2b1ff6fe service placement] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:54:43.503842 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d5301-8ba5-41c4-808e-99ac2b1ff6fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:54:43.505546 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-713d5301-8ba5-41c4-808e-99ac2b1ff6fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:54:43.518125 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d5301-8ba5-41c4-808e-99ac2b1ff6fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:54:43.519735 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d5301-8ba5-41c4-808e-99ac2b1ff6fe service placement] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:54:43.530747 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1322/2643] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:54:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:54:47.150402 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71e204-ba21-48fd-b802-0792b0e46d50 service neutron] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:54:47.162196 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71e204-ba21-48fd-b802-0792b0e46d50 service neutron] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:54:47.167189 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165f704-2c9b-4d8d-a24f-be9f3152f596 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66b9bc695b44877a06f17ea6bbeb27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:54:47.167791 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165f704-2c9b-4d8d-a24f-be9f3152f596 service placement] REQUEST_METHOD: `GET` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:54:47.168070 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165f704-2c9b-4d8d-a24f-be9f3152f596 service placement] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:54:47.168342 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165f704-2c9b-4d8d-a24f-be9f3152f596 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:54:47.170077 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-e165f704-2c9b-4d8d-a24f-be9f3152f596 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:54:47.182065 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165f704-2c9b-4d8d-a24f-be9f3152f596 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:54:47.183702 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165f704-2c9b-4d8d-a24f-be9f3152f596 service placement] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:54:47.194509 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1322/2644] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:54:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:54:47.250966 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d5301-8ba5-41c4-808e-99ac2b1ff6fe service placement] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:54:47.261756 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d5301-8ba5-41c4-808e-99ac2b1ff6fe service placement] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:54:47.267129 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1c7b2-ab42-4526-afd8-58b4c13c840b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:54:47.267756 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1c7b2-ab42-4526-afd8-58b4c13c840b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:54:47.268033 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1c7b2-ab42-4526-afd8-58b4c13c840b admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:54:47.268307 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1c7b2-ab42-4526-afd8-58b4c13c840b admin admin] PATH_INFO: `/v3/users/ca195fb4527f4d57ba7916826f478c9c` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:54:47.269424 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1c7b2-ab42-4526-afd8-58b4c13c840b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca195fb4527f4d57ba7916826f478c9c)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:54:47.271420 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1c7b2-ab42-4526-afd8-58b4c13c840b admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:54:47.416226 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-47d1c7b2-ab42-4526-afd8-58b4c13c840b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca195fb4527f4d57ba7916826f478c9c'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:54:47.416784 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-47d1c7b2-ab42-4526-afd8-58b4c13c840b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca195fb4527f4d57ba7916826f478c9c'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:54:47.476753 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-47d1c7b2-ab42-4526-afd8-58b4c13c840b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca195fb4527f4d57ba7916826f478c9c'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:54:47.484950 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-47d1c7b2-ab42-4526-afd8-58b4c13c840b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca195fb4527f4d57ba7916826f478c9c'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:54:47.485585 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-47d1c7b2-ab42-4526-afd8-58b4c13c840b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca195fb4527f4d57ba7916826f478c9c'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:54:47.503777 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1323/2645] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:54:47 2022] DELETE /identity/v3/users/ca195fb4527f4d57ba7916826f478c9c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:54:47.719311 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165f704-2c9b-4d8d-a24f-be9f3152f596 service placement] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:54:47.732228 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165f704-2c9b-4d8d-a24f-be9f3152f596 service placement] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:54:47.792458 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63056c-f794-46b8-8d36-7ab4a992c610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:54:47.793094 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63056c-f794-46b8-8d36-7ab4a992c610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:54:47.793369 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63056c-f794-46b8-8d36-7ab4a992c610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:54:47.793644 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63056c-f794-46b8-8d36-7ab4a992c610 admin admin] PATH_INFO: `/v3/projects/01619a460317489d8e53b82234a5fc9d` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:54:47.794875 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63056c-f794-46b8-8d36-7ab4a992c610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01619a460317489d8e53b82234a5fc9d)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:54:47.796894 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63056c-f794-46b8-8d36-7ab4a992c610 admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:54:47.916803 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-6d63056c-f794-46b8-8d36-7ab4a992c610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01619a460317489d8e53b82234a5fc9d', 'request_id': 'req-6d63056c-f794-46b8-8d36-7ab4a992c610'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:54:47.921456 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:54:47.922880 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-6d63056c-f794-46b8-8d36-7ab4a992c610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01619a460317489d8e53b82234a5fc9d', 'request_id': 'req-6d63056c-f794-46b8-8d36-7ab4a992c610'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:54:47.996343 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-6d63056c-f794-46b8-8d36-7ab4a992c610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01619a460317489d8e53b82234a5fc9d', 'request_id': 'req-6d63056c-f794-46b8-8d36-7ab4a992c610'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:54:48.008809 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-6d63056c-f794-46b8-8d36-7ab4a992c610 admin admin] The token cache is being invalidate because project 01619a460317489d8e53b82234a5fc9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:54:48.009101 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-6d63056c-f794-46b8-8d36-7ab4a992c610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:54:48.009738 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-6d63056c-f794-46b8-8d36-7ab4a992c610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:54:48.011305 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1323/2646] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:54:47 2022] DELETE /identity/v3/projects/01619a460317489d8e53b82234a5fc9d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:54:48.015871 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1c7b2-ab42-4526-afd8-58b4c13c840b admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:54:48.017329 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-47d1c7b2-ab42-4526-afd8-58b4c13c840b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:54:48.030624 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1c7b2-ab42-4526-afd8-58b4c13c840b admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:54:48.089012 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6857104-d91d-4a72-98e6-df3ac3a52b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:54:48.089646 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6857104-d91d-4a72-98e6-df3ac3a52b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:54:48.089922 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6857104-d91d-4a72-98e6-df3ac3a52b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:54:48.090189 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6857104-d91d-4a72-98e6-df3ac3a52b75 admin admin] PATH_INFO: `/v3/users/23a2c4bce76c457ea379e0205157d8e1` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:54:48.091382 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6857104-d91d-4a72-98e6-df3ac3a52b75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23a2c4bce76c457ea379e0205157d8e1)` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:54:48.093347 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6857104-d91d-4a72-98e6-df3ac3a52b75 admin admin] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:54:48.236883 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:54:48.246076 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-d6857104-d91d-4a72-98e6-df3ac3a52b75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23a2c4bce76c457ea379e0205157d8e1'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:54:48.246884 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-d6857104-d91d-4a72-98e6-df3ac3a52b75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23a2c4bce76c457ea379e0205157d8e1'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:54:48.310515 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-d6857104-d91d-4a72-98e6-df3ac3a52b75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23a2c4bce76c457ea379e0205157d8e1'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:54:48.318742 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-d6857104-d91d-4a72-98e6-df3ac3a52b75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23a2c4bce76c457ea379e0205157d8e1'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:54:48.319411 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.notifications [None req-d6857104-d91d-4a72-98e6-df3ac3a52b75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23a2c4bce76c457ea379e0205157d8e1'} {{(pid=81671) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:54:48.337929 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1324/2647] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 19 02:54:48 2022] DELETE /identity/v3/users/23a2c4bce76c457ea379e0205157d8e1 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:54:48.592699 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63056c-f794-46b8-8d36-7ab4a992c610 admin admin] Authenticating user token {{(pid=81670) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:54:48.594941 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.fernet_utils [None req-6d63056c-f794-46b8-8d36-7ab4a992c610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81670) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:54:48.609727 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63056c-f794-46b8-8d36-7ab4a992c610 admin admin] Validating token access rules against request {{(pid=81670) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:54:48.667866 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c8823-391a-47bb-9bbd-a4eff11c8eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '517e3692b01845c4bdf9eea0a2aadadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223a4736f80b47779a253b8ee6250bb6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81670) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:54:48.668527 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c8823-391a-47bb-9bbd-a4eff11c8eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:54:48.668807 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c8823-391a-47bb-9bbd-a4eff11c8eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:54:48.669082 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c8823-391a-47bb-9bbd-a4eff11c8eab admin admin] PATH_INFO: `/v3/projects/3a146f849d9d43d996abefc3b3e78497` {{(pid=81670) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:54:48.670231 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c8823-391a-47bb-9bbd-a4eff11c8eab admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a146f849d9d43d996abefc3b3e78497)` {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:54:48.672805 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c8823-391a-47bb-9bbd-a4eff11c8eab admin admin] RBAC: Authorization granted {{(pid=81670) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:54:48.798279 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-267c8823-391a-47bb-9bbd-a4eff11c8eab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a146f849d9d43d996abefc3b3e78497', 'request_id': 'req-267c8823-391a-47bb-9bbd-a4eff11c8eab'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:54:48.803823 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-267c8823-391a-47bb-9bbd-a4eff11c8eab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a146f849d9d43d996abefc3b3e78497', 'request_id': 'req-267c8823-391a-47bb-9bbd-a4eff11c8eab'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:54:48.870651 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-267c8823-391a-47bb-9bbd-a4eff11c8eab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a146f849d9d43d996abefc3b3e78497', 'request_id': 'req-267c8823-391a-47bb-9bbd-a4eff11c8eab'} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:54:48.882601 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-267c8823-391a-47bb-9bbd-a4eff11c8eab admin admin] The token cache is being invalidate because project 3a146f849d9d43d996abefc3b3e78497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81670) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 02:54:48.882920 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-267c8823-391a-47bb-9bbd-a4eff11c8eab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:54:48.883546 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG keystone.notifications [None req-267c8823-391a-47bb-9bbd-a4eff11c8eab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81670) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 02:54:48.885043 dv-cinder-861491-4-smb devstack@keystone.service[81670]: [pid: 81670|app: 0|req: 1324/2648] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 19 02:54:48 2022] DELETE /identity/v3/projects/3a146f849d9d43d996abefc3b3e78497 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 02:54:58.367763 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=16,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:54:58.879223 dv-cinder-861491-4-smb devstack@keystone.service[81670]: DEBUG dbcounter [-] [81670] Writing DB stats keystone:SELECT=56,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:55:55.425602 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6857104-d91d-4a72-98e6-df3ac3a52b75 admin admin] Authenticating user token {{(pid=81671) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 02:55:55.427088 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-d6857104-d91d-4a72-98e6-df3ac3a52b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:55:55.496936 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6857104-d91d-4a72-98e6-df3ac3a52b75 admin admin] Validating token access rules against request {{(pid=81671) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 02:55:55.555523 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd9086-4081-46a8-88bc-81665cf2fecb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66b9bc695b44877a06f17ea6bbeb27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91449401454c493cbf423888db8b8454', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81671) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 02:55:55.556130 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd9086-4081-46a8-88bc-81665cf2fecb service placement] REQUEST_METHOD: `GET` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 02:55:55.556416 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd9086-4081-46a8-88bc-81665cf2fecb service placement] SCRIPT_NAME: `/identity` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 02:55:55.556692 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd9086-4081-46a8-88bc-81665cf2fecb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81671) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 02:55:55.558432 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.fernet_utils [None req-70fd9086-4081-46a8-88bc-81665cf2fecb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81671) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 02:55:55.570174 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd9086-4081-46a8-88bc-81665cf2fecb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 02:55:55.571786 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd9086-4081-46a8-88bc-81665cf2fecb service placement] RBAC: Authorization granted {{(pid=81671) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 02:55:55.582121 dv-cinder-861491-4-smb devstack@keystone.service[81671]: [pid: 81671|app: 0|req: 1325/2649] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 19 02:55:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 02:56:05.577697 dv-cinder-861491-4-smb devstack@keystone.service[81671]: DEBUG dbcounter [-] [81671] Writing DB stats keystone:SELECT=58 {{(pid=81671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}